[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424853995437-27391-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 05:07:34 dist-test-slave-x5fp krb5kdc[27401](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 05:07:34 dist-test-slave-x5fp krb5kdc[27401](info): set up 2 sockets
Aug 11 05:07:34 dist-test-slave-x5fp krb5kdc[27401](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260811 05:07:35.387534 27391 mini_kdc.cc:121] Time spent starting KDC: real 1.365s user 0.007s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424853995437-27391-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424853995437-27391-0/krb5kdc/test-user.keytab.
Aug 11 05:07:35 dist-test-slave-x5fp krb5kdc[27401](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424855, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T05:07:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:07:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.191.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.191.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.191.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab.
Entry for principal kudu/127.26.191.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab.
I20260811 05:07:35.534135 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424853995437-27391-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424853995437-27391-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424853995437-27391-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.254:33515
--webserver_interface=127.26.191.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab
--principal=kudu/127.26.191.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:34635
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.191.254:33515
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:07:35.634408 27424 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:07:35.634708 27424 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:07:35.634753 27424 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:07:35.636188 27424 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:07:35.636260 27424 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:07:35.636284 27424 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:07:35.636318 27424 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:07:35.636346 27424 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:07:35.638741 27424 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:34635
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424853995437-27391-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424853995437-27391-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.191.254:33515
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab
--principal=kudu/127.26.191.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.254:33515
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.191.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27424
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424853995437-27391-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:07:35.639230 27424 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:07:35.639537 27424 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:07:35.648169 27437 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:07:35.648277 27424 server_base.cc:1034] running on GCE node
W20260811 05:07:35.649004 27429 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:35.649344 27430 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:07:35.649827 27424 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:07:35.650250 27424 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:07:35.651430 27424 hybrid_clock.cc:648] HybridClock initialized: now 1786424855651397 us; error 64 us; skew 500 ppm
Aug 11 05:07:35 dist-test-slave-x5fp krb5kdc[27401](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424855, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:07:35.654626 27424 init.cc:377] Logged in from keytab as kudu/127.26.191.254@KRBTEST.COM (short username kudu)
I20260811 05:07:35.655318 27424 webserver.cc:460] Webserver started at http://127.26.191.254:44351/ using document root <none> and password file <none>
I20260811 05:07:35.655663 27424 fs_manager.cc:359] Metadata directory not provided
I20260811 05:07:35.655723 27424 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:07:35.655956 27424 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:07:35.657337 27424 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424853995437-27391-0/minicluster-data/master-0/data/instance:
uuid: "3298818a0190464387785faecda8cd0e"
format_stamp: "Formatted at 2026-08-11 05:07:35 on dist-test-slave-x5fp"
server_key: "62aa6258473e99e231ed5f7362ae3921"
server_key_iv: "28ae1d995d164e6c3cbc54c735aa1f1a"
server_key_version: "encryptionkey@0"
I20260811 05:07:35.657738 27424 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424853995437-27391-0/minicluster-data/master-0/wal/instance:
uuid: "3298818a0190464387785faecda8cd0e"
format_stamp: "Formatted at 2026-08-11 05:07:35 on dist-test-slave-x5fp"
server_key: "62aa6258473e99e231ed5f7362ae3921"
server_key_iv: "28ae1d995d164e6c3cbc54c735aa1f1a"
server_key_version: "encryptionkey@0"
I20260811 05:07:35.659703 27424 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.001s
I20260811 05:07:35.661026 27446 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:35.661412 27424 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.001s
I20260811 05:07:35.661533 27424 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424853995437-27391-0/minicluster-data/master-0/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424853995437-27391-0/minicluster-data/master-0/wal
uuid: "3298818a0190464387785faecda8cd0e"
format_stamp: "Formatted at 2026-08-11 05:07:35 on dist-test-slave-x5fp"
server_key: "62aa6258473e99e231ed5f7362ae3921"
server_key_iv: "28ae1d995d164e6c3cbc54c735aa1f1a"
server_key_version: "encryptionkey@0"
I20260811 05:07:35.661612 27424 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424853995437-27391-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424853995437-27391-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424853995437-27391-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:07:35.695910 27424 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:07:35.699103 27424 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:07:35.699306 27424 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:07:35.711537 27424 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.254:33515
I20260811 05:07:35.711796 27521 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.254:33515 every 8 connection(s)
I20260811 05:07:35.712421 27424 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
I20260811 05:07:35.714300 27522 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:07:35.718988 27522 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3298818a0190464387785faecda8cd0e: Bootstrap starting.
I20260811 05:07:35.720598 27522 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3298818a0190464387785faecda8cd0e: Neither blocks nor log segments found. Creating new log.
I20260811 05:07:35.721522 27522 log.cc:824] T 00000000000000000000000000000000 P 3298818a0190464387785faecda8cd0e: Log is configured to *not* fsync() on all Append() calls
I20260811 05:07:35.722157 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 27424
I20260811 05:07:35.722297 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424853995437-27391-0/minicluster-data/master-0/wal/instance
I20260811 05:07:35.722774 27522 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3298818a0190464387785faecda8cd0e: No bootstrap required, opened a new log
I20260811 05:07:35.723163 27391 external_mini_cluster.cc:1428] Setting key 488048726d14b3c81bc775594884130b
I20260811 05:07:35.726869 27522 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3298818a0190464387785faecda8cd0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3298818a0190464387785faecda8cd0e" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 33515 } }
I20260811 05:07:35.727092 27522 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3298818a0190464387785faecda8cd0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:07:35.727203 27522 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3298818a0190464387785faecda8cd0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3298818a0190464387785faecda8cd0e, State: Initialized, Role: FOLLOWER
I20260811 05:07:35.727425 27522 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3298818a0190464387785faecda8cd0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3298818a0190464387785faecda8cd0e" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 33515 } }
I20260811 05:07:35.727638 27522 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3298818a0190464387785faecda8cd0e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:07:35.727692 27522 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3298818a0190464387785faecda8cd0e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:07:35.727769 27522 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3298818a0190464387785faecda8cd0e [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:07:35.729151 27522 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3298818a0190464387785faecda8cd0e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3298818a0190464387785faecda8cd0e" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 33515 } }
I20260811 05:07:35.729367 27522 leader_election.cc:302] T 00000000000000000000000000000000 P 3298818a0190464387785faecda8cd0e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3298818a0190464387785faecda8cd0e; no voters:
I20260811 05:07:35.729619 27522 leader_election.cc:288] T 00000000000000000000000000000000 P 3298818a0190464387785faecda8cd0e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 05:07:35.729719 27530 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3298818a0190464387785faecda8cd0e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:07:35.730125 27530 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3298818a0190464387785faecda8cd0e [term 1 LEADER]: Becoming Leader. State: Replica: 3298818a0190464387785faecda8cd0e, State: Running, Role: LEADER
I20260811 05:07:35.730298 27522 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3298818a0190464387785faecda8cd0e [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:07:35.730372 27530 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3298818a0190464387785faecda8cd0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3298818a0190464387785faecda8cd0e" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 33515 } }
I20260811 05:07:35.734174 27531 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3298818a0190464387785faecda8cd0e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3298818a0190464387785faecda8cd0e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3298818a0190464387785faecda8cd0e" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 33515 } } }
I20260811 05:07:35.734308 27531 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3298818a0190464387785faecda8cd0e [sys.catalog]: This master's current role is: LEADER
I20260811 05:07:35.734964 27543 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:07:35.735090 27533 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3298818a0190464387785faecda8cd0e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3298818a0190464387785faecda8cd0e. Latest consensus state: current_term: 1 leader_uuid: "3298818a0190464387785faecda8cd0e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3298818a0190464387785faecda8cd0e" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 33515 } } }
I20260811 05:07:35.735257 27533 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3298818a0190464387785faecda8cd0e [sys.catalog]: This master's current role is: LEADER
I20260811 05:07:35.736527 27543 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:07:35.739845 27543 catalog_manager.cc:1347] Generated new cluster ID: 71d61082381c48e9b0cfe38831df66c9
I20260811 05:07:35.739913 27543 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 05:07:35 dist-test-slave-x5fp krb5kdc[27401](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424855, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
I20260811 05:07:35.752311 27527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:35.724788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36580 (local address 127.26.191.254:33515)
0811 05:07:35.725316 (+ 528us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:35.725326 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:35.727493 (+ 2167us) server_negotiation.cc:407] Connection header received
0811 05:07:35.731732 (+ 4239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:35.731739 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:35.731837 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:35.731971 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:35.734997 (+ 3026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:35.737592 (+ 2595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:35.739525 (+ 1933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:35.740287 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:35.740432 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:35.746434 (+ 6002us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:35.746439 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:35.746440 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:07:35.746453 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:35.749530 (+ 3077us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:35.750271 (+ 741us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:35.750276 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:35.750276 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:35.750455 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:35.750864 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:35.750865 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:35.750865 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:35.751215 (+ 350us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:35.751549 (+ 334us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:35.751816 (+ 267us) server_negotiation.cc:299] Negotiation successful
0811 05:07:35.752008 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":285,"thread_start_us":158,"threads_started":1}
I20260811 05:07:35.758096 27543 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:07:35.758925 27543 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:07:35.772084 27543 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3298818a0190464387785faecda8cd0e: Generated new TSK 0
I20260811 05:07:35.772351 27543 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.191.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.191.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.191.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.193.keytab.
Entry for principal kudu/127.26.191.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.193.keytab.
I20260811 05:07:35.812503 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424853995437-27391-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424853995437-27391-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424853995437-27391-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424853995437-27391-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.191.193:0
--local_ip_for_outbound_sockets=127.26.191.193
--webserver_interface=127.26.191.193
--webserver_port=0
--tserver_master_addrs=127.26.191.254:33515
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.193.keytab
--principal=kudu/127.26.191.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:34635
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:07:35.937960 27562 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:07:35.938225 27562 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:07:35.938271 27562 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:07:35.939783 27562 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:07:35.939858 27562 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:07:35.939908 27562 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.191.193
I20260811 05:07:35.941922 27562 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:34635
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424853995437-27391-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424853995437-27391-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.193.keytab
--principal=kudu/127.26.191.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.191.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424853995437-27391-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.191.193
--webserver_port=0
--tserver_master_addrs=127.26.191.254:33515
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27562
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.191.193
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424853995437-27391-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:07:35.942368 27562 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:07:35.942651 27562 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:07:35.949009 27570 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:35.949143 27574 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:35.949110 27571 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:07:35.949441 27562 server_base.cc:1034] running on GCE node
I20260811 05:07:35.949653 27562 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:07:35.949950 27562 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:07:35.951149 27562 hybrid_clock.cc:648] HybridClock initialized: now 1786424855951102 us; error 60 us; skew 500 ppm
Aug 11 05:07:35 dist-test-slave-x5fp krb5kdc[27401](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424855, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:07:35.955168 27562 init.cc:377] Logged in from keytab as kudu/127.26.191.193@KRBTEST.COM (short username kudu)
I20260811 05:07:35.955912 27562 webserver.cc:460] Webserver started at http://127.26.191.193:42737/ using document root <none> and password file <none>
I20260811 05:07:35.956278 27562 fs_manager.cc:359] Metadata directory not provided
I20260811 05:07:35.956418 27562 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:07:35.956589 27562 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:07:35.958796 27562 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424853995437-27391-0/minicluster-data/ts-0/data/instance:
uuid: "f36201eb53b9425c93d6f7b4ac733ad9"
format_stamp: "Formatted at 2026-08-11 05:07:35 on dist-test-slave-x5fp"
server_key: "f7d24e37e74d8fd5e7aa476aedd2626b"
server_key_iv: "082b4df483b19ab0089e842bbfbf7aea"
server_key_version: "encryptionkey@0"
I20260811 05:07:35.959350 27562 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424853995437-27391-0/minicluster-data/ts-0/wal/instance:
uuid: "f36201eb53b9425c93d6f7b4ac733ad9"
format_stamp: "Formatted at 2026-08-11 05:07:35 on dist-test-slave-x5fp"
server_key: "f7d24e37e74d8fd5e7aa476aedd2626b"
server_key_iv: "082b4df483b19ab0089e842bbfbf7aea"
server_key_version: "encryptionkey@0"
I20260811 05:07:35.961889 27562 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260811 05:07:35.963315 27586 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:35.963552 27562 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:07:35.963662 27562 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424853995437-27391-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424853995437-27391-0/minicluster-data/ts-0/wal
uuid: "f36201eb53b9425c93d6f7b4ac733ad9"
format_stamp: "Formatted at 2026-08-11 05:07:35 on dist-test-slave-x5fp"
server_key: "f7d24e37e74d8fd5e7aa476aedd2626b"
server_key_iv: "082b4df483b19ab0089e842bbfbf7aea"
server_key_version: "encryptionkey@0"
I20260811 05:07:35.963750 27562 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424853995437-27391-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424853995437-27391-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424853995437-27391-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:07:35.973268 27562 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:07:35.975807 27562 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:07:35.976032 27562 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:07:35.976408 27562 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:07:35.976924 27562 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:07:35.977031 27562 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:35.977087 27562 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:07:35.977123 27562 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:35.989207 27562 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.193:36285
I20260811 05:07:35.989259 27765 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.193:36285 every 8 connection(s)
I20260811 05:07:35.989645 27562 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424853995437-27391-0/minicluster-data/ts-0/data/info.pb
I20260811 05:07:35.994035 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 27562
I20260811 05:07:35.994165 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424853995437-27391-0/minicluster-data/ts-0/wal/instance
I20260811 05:07:35.994333 27391 external_mini_cluster.cc:1428] Setting key ddf8641dcd67a5ffcd806d40c7f84841
Aug 11 05:07:35 dist-test-slave-x5fp krb5kdc[27401](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424855, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.193@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
I20260811 05:07:36.001960 27775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:35.990732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:33515 (local address 127.26.191.193:39845)
0811 05:07:35.990985 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:35.991043 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:35.991608 (+ 565us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:35.991978 (+ 370us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:35.991982 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:35.992873 (+ 891us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:07:35.993094 (+ 221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:35.993099 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:35.993842 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:35.993843 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:35.995019 (+ 1176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:35.995022 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:35.995393 (+ 371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:35.995395 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:35.995554 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:35.996140 (+ 586us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:07:35.996148 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:07:35.997904 (+ 1756us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:07:36.000081 (+ 2177us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:07:36.000091 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:07:36.000093 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:07:36.000359 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:07:36.000628 (+ 269us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:07:36.000629 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:07:36.000630 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:07:36.000869 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:07:36.001381 (+ 512us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:07:36.001389 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:07:36.001533 (+ 144us) client_negotiation.cc:769] Sending connection context
0811 05:07:36.001623 (+ 90us) client_negotiation.cc:240] Negotiation successful
0811 05:07:36.001771 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":109,"threads_started":1}
I20260811 05:07:36.002014 27527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:35.990833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.193:39845 (local address 127.26.191.254:33515)
0811 05:07:35.990946 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:35.990948 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:35.991135 (+ 187us) server_negotiation.cc:407] Connection header received
0811 05:07:35.991768 (+ 633us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:35.991770 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:35.991785 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:35.991865 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:35.993213 (+ 1348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:35.993741 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:35.995090 (+ 1349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:35.995304 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:35.995383 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:35.998013 (+ 2630us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:35.998015 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:35.998016 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:07:35.998026 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:35.999956 (+ 1930us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:36.000446 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:36.000447 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:36.000448 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:36.000524 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:36.000978 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:36.000980 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:36.000981 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:36.001168 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:36.001389 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:36.001731 (+ 342us) server_negotiation.cc:299] Negotiation successful
0811 05:07:36.001856 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260811 05:07:36.002622 27769 heartbeater.cc:347] Connected to a master server at 127.26.191.254:33515
I20260811 05:07:36.002774 27769 heartbeater.cc:464] Registering TS with master...
I20260811 05:07:36.003042 27769 heartbeater.cc:511] Master 127.26.191.254:33515 requested a full tablet report, sending...
I20260811 05:07:36.004246 27470 ts_manager.cc:194] Registered new tserver with Master: f36201eb53b9425c93d6f7b4ac733ad9 (127.26.191.193:36285)
I20260811 05:07:36.005113 27470 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.191.193@KRBTEST.COM'} at 127.26.191.193:39845
WARNING: no policy specified for kudu/127.26.191.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.191.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.191.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.194.keytab.
Entry for principal kudu/127.26.191.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.194.keytab.
I20260811 05:07:36.029707 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424853995437-27391-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424853995437-27391-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424853995437-27391-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424853995437-27391-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.191.194:0
--local_ip_for_outbound_sockets=127.26.191.194
--webserver_interface=127.26.191.194
--webserver_port=0
--tserver_master_addrs=127.26.191.254:33515
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.194.keytab
--principal=kudu/127.26.191.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:34635
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:07:36.120950 27779 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:07:36.121182 27779 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:07:36.121208 27779 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:07:36.122328 27779 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:07:36.122366 27779 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:07:36.122392 27779 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.191.194
I20260811 05:07:36.123836 27779 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:34635
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424853995437-27391-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424853995437-27391-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.194.keytab
--principal=kudu/127.26.191.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.191.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424853995437-27391-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.191.194
--webserver_port=0
--tserver_master_addrs=127.26.191.254:33515
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27779
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.191.194
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424853995437-27391-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:07:36.124045 27779 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:07:36.124234 27779 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:07:36.130290 27785 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:36.130262 27796 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:36.130342 27792 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:07:36.130635 27779 server_base.cc:1034] running on GCE node
I20260811 05:07:36.130905 27779 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:07:36.131191 27779 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:07:36.132367 27779 hybrid_clock.cc:648] HybridClock initialized: now 1786424856132341 us; error 40 us; skew 500 ppm
Aug 11 05:07:36 dist-test-slave-x5fp krb5kdc[27401](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424856, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:07:36.135710 27779 init.cc:377] Logged in from keytab as kudu/127.26.191.194@KRBTEST.COM (short username kudu)
I20260811 05:07:36.136289 27779 webserver.cc:460] Webserver started at http://127.26.191.194:34245/ using document root <none> and password file <none>
I20260811 05:07:36.136544 27779 fs_manager.cc:359] Metadata directory not provided
I20260811 05:07:36.136595 27779 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:07:36.136839 27779 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:07:36.138082 27779 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424853995437-27391-0/minicluster-data/ts-1/data/instance:
uuid: "d1e270f6bdc34d46b055efd8a9e37992"
format_stamp: "Formatted at 2026-08-11 05:07:36 on dist-test-slave-x5fp"
server_key: "97f703cb680b53792a329349e70d4aec"
server_key_iv: "5423c171d9027af3983f7033409d190d"
server_key_version: "encryptionkey@0"
I20260811 05:07:36.138496 27779 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424853995437-27391-0/minicluster-data/ts-1/wal/instance:
uuid: "d1e270f6bdc34d46b055efd8a9e37992"
format_stamp: "Formatted at 2026-08-11 05:07:36 on dist-test-slave-x5fp"
server_key: "97f703cb680b53792a329349e70d4aec"
server_key_iv: "5423c171d9027af3983f7033409d190d"
server_key_version: "encryptionkey@0"
I20260811 05:07:36.140301 27779 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260811 05:07:36.141332 27809 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:36.141559 27779 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 05:07:36.141665 27779 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424853995437-27391-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424853995437-27391-0/minicluster-data/ts-1/wal
uuid: "d1e270f6bdc34d46b055efd8a9e37992"
format_stamp: "Formatted at 2026-08-11 05:07:36 on dist-test-slave-x5fp"
server_key: "97f703cb680b53792a329349e70d4aec"
server_key_iv: "5423c171d9027af3983f7033409d190d"
server_key_version: "encryptionkey@0"
I20260811 05:07:36.141759 27779 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424853995437-27391-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424853995437-27391-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424853995437-27391-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:07:36.158726 27779 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:07:36.161504 27779 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:07:36.161639 27779 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:07:36.161909 27779 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:07:36.162302 27779 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:07:36.162351 27779 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:36.162377 27779 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:07:36.162390 27779 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:36.170375 27779 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.194:44995
I20260811 05:07:36.170435 27991 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.194:44995 every 8 connection(s)
I20260811 05:07:36.170804 27779 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424853995437-27391-0/minicluster-data/ts-1/data/info.pb
I20260811 05:07:36.176920 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 27779
I20260811 05:07:36.177035 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424853995437-27391-0/minicluster-data/ts-1/wal/instance
I20260811 05:07:36.177238 27391 external_mini_cluster.cc:1428] Setting key bddd29e1422179530018b963cd2760c6
Aug 11 05:07:36 dist-test-slave-x5fp krb5kdc[27401](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424856, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.194@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
I20260811 05:07:36.183650 27527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:36.171735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.194:33099 (local address 127.26.191.254:33515)
0811 05:07:36.171864 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:36.171867 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:36.172062 (+ 195us) server_negotiation.cc:407] Connection header received
0811 05:07:36.172684 (+ 622us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:36.172685 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:36.172700 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:36.172788 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:36.173931 (+ 1143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:36.174505 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:36.175631 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:36.175878 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:36.175969 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:36.179318 (+ 3349us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:36.179321 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:36.179321 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:07:36.179331 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:36.181570 (+ 2239us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:36.182239 (+ 669us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:36.182241 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:36.182241 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:36.182324 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:36.182674 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:36.182675 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:36.182675 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:36.182903 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:36.182989 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:36.183341 (+ 352us) server_negotiation.cc:299] Negotiation successful
0811 05:07:36.183482 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260811 05:07:36.183624 27995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:36.171644 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:33515 (local address 127.26.191.194:33099)
0811 05:07:36.171899 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:36.171965 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:36.172560 (+ 595us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:36.172875 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:36.172879 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:36.173558 (+ 679us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:07:36.173795 (+ 237us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:36.173823 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:36.174617 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:36.174619 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:36.175527 (+ 908us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:36.175529 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:36.175975 (+ 446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:36.175977 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:36.176140 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:36.177266 (+ 1126us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:07:36.177297 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:07:36.179198 (+ 1901us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:07:36.181741 (+ 2543us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:07:36.181750 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:07:36.181753 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:07:36.182073 (+ 320us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:07:36.182443 (+ 370us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:07:36.182444 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:07:36.182445 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:07:36.182586 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:07:36.183003 (+ 417us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:07:36.183011 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:07:36.183166 (+ 155us) client_negotiation.cc:769] Sending connection context
0811 05:07:36.183273 (+ 107us) client_negotiation.cc:240] Negotiation successful
0811 05:07:36.183426 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":101,"threads_started":1}
I20260811 05:07:36.184470 27993 heartbeater.cc:347] Connected to a master server at 127.26.191.254:33515
I20260811 05:07:36.184609 27993 heartbeater.cc:464] Registering TS with master...
I20260811 05:07:36.184918 27993 heartbeater.cc:511] Master 127.26.191.254:33515 requested a full tablet report, sending...
I20260811 05:07:36.185432 27470 ts_manager.cc:194] Registered new tserver with Master: d1e270f6bdc34d46b055efd8a9e37992 (127.26.191.194:44995)
I20260811 05:07:36.185846 27470 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.191.194@KRBTEST.COM'} at 127.26.191.194:33099
WARNING: no policy specified for kudu/127.26.191.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.191.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.191.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.195.keytab.
Entry for principal kudu/127.26.191.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.195.keytab.
I20260811 05:07:36.212931 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424853995437-27391-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424853995437-27391-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424853995437-27391-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424853995437-27391-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.191.195:0
--local_ip_for_outbound_sockets=127.26.191.195
--webserver_interface=127.26.191.195
--webserver_port=0
--tserver_master_addrs=127.26.191.254:33515
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.195.keytab
--principal=kudu/127.26.191.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:34635
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:07:36.304445 28001 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:07:36.304694 28001 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:07:36.304740 28001 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:07:36.305971 28001 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:07:36.306023 28001 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:07:36.306053 28001 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.191.195
I20260811 05:07:36.307667 28001 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:34635
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424853995437-27391-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424853995437-27391-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.195.keytab
--principal=kudu/127.26.191.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.191.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424853995437-27391-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.191.195
--webserver_port=0
--tserver_master_addrs=127.26.191.254:33515
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28001
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.191.195
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424853995437-27391-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:07:36.307940 28001 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:07:36.308233 28001 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:07:36.314411 28017 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:36.314427 28020 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:07:36.314464 28001 server_base.cc:1034] running on GCE node
W20260811 05:07:36.314424 28016 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:07:36.314935 28001 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:07:36.315229 28001 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:07:36.316386 28001 hybrid_clock.cc:648] HybridClock initialized: now 1786424856316366 us; error 38 us; skew 500 ppm
Aug 11 05:07:36 dist-test-slave-x5fp krb5kdc[27401](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424856, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:07:36.319121 28001 init.cc:377] Logged in from keytab as kudu/127.26.191.195@KRBTEST.COM (short username kudu)
I20260811 05:07:36.319599 28001 webserver.cc:460] Webserver started at http://127.26.191.195:35527/ using document root <none> and password file <none>
I20260811 05:07:36.319809 28001 fs_manager.cc:359] Metadata directory not provided
I20260811 05:07:36.319854 28001 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:07:36.319953 28001 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:07:36.321065 28001 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424853995437-27391-0/minicluster-data/ts-2/data/instance:
uuid: "6af2909c551a4ab9b45f2533c99a11ef"
format_stamp: "Formatted at 2026-08-11 05:07:36 on dist-test-slave-x5fp"
server_key: "faec2b6675f03a67e0e984f4f64442e4"
server_key_iv: "29950cf2640e51848ff0017365d5515c"
server_key_version: "encryptionkey@0"
I20260811 05:07:36.321390 28001 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424853995437-27391-0/minicluster-data/ts-2/wal/instance:
uuid: "6af2909c551a4ab9b45f2533c99a11ef"
format_stamp: "Formatted at 2026-08-11 05:07:36 on dist-test-slave-x5fp"
server_key: "faec2b6675f03a67e0e984f4f64442e4"
server_key_iv: "29950cf2640e51848ff0017365d5515c"
server_key_version: "encryptionkey@0"
I20260811 05:07:36.322804 28001 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:07:36.323597 28032 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:36.323818 28001 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:07:36.323941 28001 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424853995437-27391-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424853995437-27391-0/minicluster-data/ts-2/wal
uuid: "6af2909c551a4ab9b45f2533c99a11ef"
format_stamp: "Formatted at 2026-08-11 05:07:36 on dist-test-slave-x5fp"
server_key: "faec2b6675f03a67e0e984f4f64442e4"
server_key_iv: "29950cf2640e51848ff0017365d5515c"
server_key_version: "encryptionkey@0"
I20260811 05:07:36.324020 28001 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424853995437-27391-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424853995437-27391-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424853995437-27391-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:07:36.332870 28001 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:07:36.335326 28001 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:07:36.335505 28001 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:07:36.335803 28001 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:07:36.336171 28001 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:07:36.336241 28001 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:36.336290 28001 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:07:36.336324 28001 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:36.344385 28001 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.195:36009
I20260811 05:07:36.344466 28219 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.195:36009 every 8 connection(s)
I20260811 05:07:36.344899 28001 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424853995437-27391-0/minicluster-data/ts-2/data/info.pb
I20260811 05:07:36.349732 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 28001
I20260811 05:07:36.349870 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424853995437-27391-0/minicluster-data/ts-2/wal/instance
I20260811 05:07:36.350082 27391 external_mini_cluster.cc:1428] Setting key d0c6014c5fda104dcac3aededc6e68ce
Aug 11 05:07:36 dist-test-slave-x5fp krb5kdc[27401](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424856, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.195@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
I20260811 05:07:36.355937 27527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:36.345817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.195:52841 (local address 127.26.191.254:33515)
0811 05:07:36.345913 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:36.345915 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:36.346121 (+ 206us) server_negotiation.cc:407] Connection header received
0811 05:07:36.346710 (+ 589us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:36.346711 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:36.346723 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:36.346801 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:36.347833 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:36.348397 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:36.349562 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:36.349910 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:36.349996 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:36.352849 (+ 2853us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:36.352851 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:36.352851 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:07:36.352866 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:36.354388 (+ 1522us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:36.354853 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:36.354854 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:36.354855 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:36.354922 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:36.355224 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:36.355226 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:36.355226 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:36.355363 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:36.355445 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:36.355741 (+ 296us) server_negotiation.cc:299] Negotiation successful
0811 05:07:36.355831 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 05:07:36.356175 28222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:36.345775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:33515 (local address 127.26.191.195:52841)
0811 05:07:36.345973 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:36.346019 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:36.346612 (+ 593us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:36.346861 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:36.346864 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:36.347498 (+ 634us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:07:36.347717 (+ 219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:36.347723 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:36.348498 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:36.348500 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:36.349446 (+ 946us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:36.349449 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:36.350038 (+ 589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:36.350039 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:36.350194 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:36.350843 (+ 649us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:07:36.350854 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:07:36.352678 (+ 1824us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:07:36.354496 (+ 1818us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:07:36.354505 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:07:36.354508 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:07:36.354763 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:07:36.354995 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:07:36.354996 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:07:36.354996 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:07:36.355150 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:07:36.355436 (+ 286us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:07:36.355444 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:07:36.355595 (+ 151us) client_negotiation.cc:769] Sending connection context
0811 05:07:36.355716 (+ 121us) client_negotiation.cc:240] Negotiation successful
0811 05:07:36.355908 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":120,"threads_started":1}
I20260811 05:07:36.356863 28220 heartbeater.cc:347] Connected to a master server at 127.26.191.254:33515
I20260811 05:07:36.356971 28220 heartbeater.cc:464] Registering TS with master...
I20260811 05:07:36.357169 28220 heartbeater.cc:511] Master 127.26.191.254:33515 requested a full tablet report, sending...
I20260811 05:07:36.357631 27470 ts_manager.cc:194] Registered new tserver with Master: 6af2909c551a4ab9b45f2533c99a11ef (127.26.191.195:36009)
I20260811 05:07:36.358031 27470 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.191.195@KRBTEST.COM'} at 127.26.191.195:52841
I20260811 05:07:36.362756 27391 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 05:07:36 dist-test-slave-x5fp krb5kdc[27401](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424856, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 05:07:36 dist-test-slave-x5fp krb5kdc[27401](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424856, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.26.191.193@KRBTEST.COM
I20260811 05:07:36.391906 28230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:36.382883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42940 (local address 127.26.191.193:36285)
0811 05:07:36.383159 (+ 276us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:36.383166 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:36.383179 (+ 13us) server_negotiation.cc:407] Connection header received
0811 05:07:36.383209 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:36.383211 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:36.383227 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:36.383304 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:36.384019 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:36.384929 (+ 910us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:36.385735 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:36.386096 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:36.386151 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:36.388845 (+ 2694us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:36.388854 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:36.388855 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:07:36.388862 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:36.390569 (+ 1707us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:36.390970 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:36.390976 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:36.390976 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:36.391053 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:36.391269 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:36.391270 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:36.391270 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:36.391429 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:36.391589 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:36.391664 (+ 75us) server_negotiation.cc:299] Negotiation successful
0811 05:07:36.391752 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":236,"thread_start_us":177,"threads_started":1}
W20260811 05:07:36.392441 27642 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:42940
Aug 11 05:07:36 dist-test-slave-x5fp krb5kdc[27401](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424856, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 05:07:36 dist-test-slave-x5fp krb5kdc[27401](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424856, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.191.193@KRBTEST.COM
I20260811 05:07:36.419231 28230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:36.410824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42950 (local address 127.26.191.193:36285)
0811 05:07:36.410927 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:36.410930 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:36.411046 (+ 116us) server_negotiation.cc:407] Connection header received
0811 05:07:36.411165 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:36.411166 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:36.411178 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:36.411267 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:36.411913 (+ 646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:36.412501 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:36.413428 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:36.413664 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:36.413757 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:36.416345 (+ 2588us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:36.416347 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:36.416349 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:07:36.416362 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:36.417940 (+ 1578us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:36.418364 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:36.418366 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:36.418366 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:36.418432 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:36.418642 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:36.418644 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:36.418644 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:36.418756 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:36.418930 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:36.419021 (+ 91us) server_negotiation.cc:299] Negotiation successful
0811 05:07:36.419112 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 05:07:36.419956 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 27562
I20260811 05:07:36.440533 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 27779
I20260811 05:07:36.462301 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 28001
I20260811 05:07:36.479766 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 27424
2026-08-11T05:07:36Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (2496 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424853995437-27391-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 05:07:37 dist-test-slave-x5fp krb5kdc[28240](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 05:07:37 dist-test-slave-x5fp krb5kdc[28240](info): set up 2 sockets
Aug 11 05:07:37 dist-test-slave-x5fp krb5kdc[28240](info): commencing operation
krb5kdc: starting...
W20260811 05:07:39.132959 27391 mini_kdc.cc:121] Time spent starting KDC: real 2.621s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424853995437-27391-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424853995437-27391-0/krb5kdc/test-user.keytab.
Aug 11 05:07:39 dist-test-slave-x5fp krb5kdc[28240](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424859, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T05:07:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:07:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.191.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.191.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.191.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab.
Entry for principal kudu/127.26.191.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab.
I20260811 05:07:39.269503 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424853995437-27391-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424853995437-27391-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424853995437-27391-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.254:46005
--webserver_interface=127.26.191.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab
--principal=kudu/127.26.191.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:35095
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.191.254:46005
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:07:39.355306 28263 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:07:39.355604 28263 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:07:39.355648 28263 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:07:39.356873 28263 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:07:39.356947 28263 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:07:39.356973 28263 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:07:39.356994 28263 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:07:39.357024 28263 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:07:39.358578 28263 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:35095
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424853995437-27391-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424853995437-27391-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.191.254:46005
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab
--principal=kudu/127.26.191.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.254:46005
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.191.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28263
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424853995437-27391-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:07:39.358883 28263 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:07:39.359136 28263 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:07:39.364521 28277 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:39.364514 28280 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:07:39.364570 28263 server_base.cc:1034] running on GCE node
W20260811 05:07:39.364514 28274 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:07:39.365149 28263 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:07:39.365485 28263 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:07:39.366658 28263 hybrid_clock.cc:648] HybridClock initialized: now 1786424859366635 us; error 40 us; skew 500 ppm
Aug 11 05:07:39 dist-test-slave-x5fp krb5kdc[28240](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424859, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:07:39.375581 28263 init.cc:377] Logged in from keytab as kudu/127.26.191.254@KRBTEST.COM (short username kudu)
I20260811 05:07:39.376240 28263 webserver.cc:460] Webserver started at http://127.26.191.254:37493/ using document root <none> and password file <none>
I20260811 05:07:39.376533 28263 fs_manager.cc:359] Metadata directory not provided
I20260811 05:07:39.376587 28263 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:07:39.376796 28263 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:07:39.377997 28263 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424853995437-27391-0/minicluster-data/master-0/data/instance:
uuid: "0fefb400f99f4a999b8a0883ff0f3e1a"
format_stamp: "Formatted at 2026-08-11 05:07:39 on dist-test-slave-x5fp"
server_key: "51c153161eb3301bf0713fd6d091cc4c"
server_key_iv: "daa0794de564f81f80d74f86d57472b5"
server_key_version: "encryptionkey@0"
I20260811 05:07:39.378407 28263 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424853995437-27391-0/minicluster-data/master-0/wal/instance:
uuid: "0fefb400f99f4a999b8a0883ff0f3e1a"
format_stamp: "Formatted at 2026-08-11 05:07:39 on dist-test-slave-x5fp"
server_key: "51c153161eb3301bf0713fd6d091cc4c"
server_key_iv: "daa0794de564f81f80d74f86d57472b5"
server_key_version: "encryptionkey@0"
I20260811 05:07:39.380048 28263 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 05:07:39.381207 28291 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:39.381531 28263 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:07:39.381712 28263 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424853995437-27391-0/minicluster-data/master-0/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424853995437-27391-0/minicluster-data/master-0/wal
uuid: "0fefb400f99f4a999b8a0883ff0f3e1a"
format_stamp: "Formatted at 2026-08-11 05:07:39 on dist-test-slave-x5fp"
server_key: "51c153161eb3301bf0713fd6d091cc4c"
server_key_iv: "daa0794de564f81f80d74f86d57472b5"
server_key_version: "encryptionkey@0"
I20260811 05:07:39.381820 28263 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424853995437-27391-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424853995437-27391-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424853995437-27391-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:07:39.395653 28263 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:07:39.398777 28263 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:07:39.398998 28263 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:07:39.403676 28263 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.254:46005
I20260811 05:07:39.403725 28372 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.254:46005 every 8 connection(s)
I20260811 05:07:39.404134 28263 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
I20260811 05:07:39.405141 28374 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:07:39.405987 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 28263
I20260811 05:07:39.406064 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424853995437-27391-0/minicluster-data/master-0/wal/instance
I20260811 05:07:39.406342 27391 external_mini_cluster.cc:1428] Setting key 7beb793c34991a31da5b15fcfabbe666
I20260811 05:07:39.408833 28374 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0fefb400f99f4a999b8a0883ff0f3e1a: Bootstrap starting.
I20260811 05:07:39.409516 28374 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0fefb400f99f4a999b8a0883ff0f3e1a: Neither blocks nor log segments found. Creating new log.
I20260811 05:07:39.409844 28374 log.cc:824] T 00000000000000000000000000000000 P 0fefb400f99f4a999b8a0883ff0f3e1a: Log is configured to *not* fsync() on all Append() calls
I20260811 05:07:39.410841 28374 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0fefb400f99f4a999b8a0883ff0f3e1a: No bootstrap required, opened a new log
I20260811 05:07:39.413717 28374 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0fefb400f99f4a999b8a0883ff0f3e1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fefb400f99f4a999b8a0883ff0f3e1a" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 46005 } }
I20260811 05:07:39.413902 28374 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0fefb400f99f4a999b8a0883ff0f3e1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:07:39.413956 28374 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0fefb400f99f4a999b8a0883ff0f3e1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fefb400f99f4a999b8a0883ff0f3e1a, State: Initialized, Role: FOLLOWER
I20260811 05:07:39.414141 28374 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0fefb400f99f4a999b8a0883ff0f3e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fefb400f99f4a999b8a0883ff0f3e1a" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 46005 } }
Aug 11 05:07:39 dist-test-slave-x5fp krb5kdc[28240](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424859, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
I20260811 05:07:39.414239 28374 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0fefb400f99f4a999b8a0883ff0f3e1a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:07:39.414287 28374 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0fefb400f99f4a999b8a0883ff0f3e1a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:07:39.414366 28374 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0fefb400f99f4a999b8a0883ff0f3e1a [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:07:39.415107 28374 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0fefb400f99f4a999b8a0883ff0f3e1a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fefb400f99f4a999b8a0883ff0f3e1a" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 46005 } }
I20260811 05:07:39.415239 28374 leader_election.cc:302] T 00000000000000000000000000000000 P 0fefb400f99f4a999b8a0883ff0f3e1a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0fefb400f99f4a999b8a0883ff0f3e1a; no voters:
I20260811 05:07:39.415439 28374 leader_election.cc:288] T 00000000000000000000000000000000 P 0fefb400f99f4a999b8a0883ff0f3e1a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 05:07:39.415488 28382 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0fefb400f99f4a999b8a0883ff0f3e1a [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:07:39.415673 28382 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0fefb400f99f4a999b8a0883ff0f3e1a [term 1 LEADER]: Becoming Leader. State: Replica: 0fefb400f99f4a999b8a0883ff0f3e1a, State: Running, Role: LEADER
I20260811 05:07:39.415752 28374 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0fefb400f99f4a999b8a0883ff0f3e1a [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:07:39.415761 28382 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0fefb400f99f4a999b8a0883ff0f3e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fefb400f99f4a999b8a0883ff0f3e1a" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 46005 } }
I20260811 05:07:39.416186 28383 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0fefb400f99f4a999b8a0883ff0f3e1a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0fefb400f99f4a999b8a0883ff0f3e1a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fefb400f99f4a999b8a0883ff0f3e1a" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 46005 } } }
I20260811 05:07:39.416293 28383 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0fefb400f99f4a999b8a0883ff0f3e1a [sys.catalog]: This master's current role is: LEADER
I20260811 05:07:39.416499 28388 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0fefb400f99f4a999b8a0883ff0f3e1a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0fefb400f99f4a999b8a0883ff0f3e1a. Latest consensus state: current_term: 1 leader_uuid: "0fefb400f99f4a999b8a0883ff0f3e1a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fefb400f99f4a999b8a0883ff0f3e1a" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 46005 } } }
I20260811 05:07:39.416551 28396 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:07:39.416657 28388 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0fefb400f99f4a999b8a0883ff0f3e1a [sys.catalog]: This master's current role is: LEADER
I20260811 05:07:39.417519 28396 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:07:39.419337 28379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:39.406965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42302 (local address 127.26.191.254:46005)
0811 05:07:39.407138 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:39.407146 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:39.407174 (+ 28us) server_negotiation.cc:407] Connection header received
0811 05:07:39.407627 (+ 453us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:39.407634 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:39.407683 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:39.407803 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:39.408698 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:39.409894 (+ 1196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:39.410880 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:39.411496 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:39.411597 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:39.414823 (+ 3226us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:39.414827 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:39.414828 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:07:39.414840 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:39.417330 (+ 2490us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:39.417942 (+ 612us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:39.417945 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:39.417946 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:39.418047 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:39.418288 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:39.418289 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:39.418290 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:39.418555 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:39.418774 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:39.419006 (+ 232us) server_negotiation.cc:299] Negotiation successful
0811 05:07:39.419158 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":85,"threads_started":1}
I20260811 05:07:39.419955 28396 catalog_manager.cc:1347] Generated new cluster ID: 9b2f6778288842ba82f246b20170ba72
I20260811 05:07:39.420059 28396 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:07:39.433463 28396 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:07:39.434239 28396 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:07:39.442286 28396 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0fefb400f99f4a999b8a0883ff0f3e1a: Generated new TSK 0
I20260811 05:07:39.442524 28396 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.191.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.191.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.191.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.193.keytab.
Entry for principal kudu/127.26.191.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.193.keytab.
I20260811 05:07:39.485471 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424853995437-27391-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424853995437-27391-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424853995437-27391-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424853995437-27391-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.191.193:0
--local_ip_for_outbound_sockets=127.26.191.193
--webserver_interface=127.26.191.193
--webserver_port=0
--tserver_master_addrs=127.26.191.254:46005
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.193.keytab
--principal=kudu/127.26.191.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:35095
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:07:39.592340 28419 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:07:39.592594 28419 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:07:39.592621 28419 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:07:39.593854 28419 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:07:39.593907 28419 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:07:39.593937 28419 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.191.193
I20260811 05:07:39.595456 28419 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:35095
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424853995437-27391-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424853995437-27391-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.193.keytab
--principal=kudu/127.26.191.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.191.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424853995437-27391-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.191.193
--webserver_port=0
--tserver_master_addrs=127.26.191.254:46005
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28419
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.191.193
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424853995437-27391-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:07:39.595661 28419 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:07:39.595858 28419 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:07:39.601353 28427 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:39.601382 28432 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:39.601426 28428 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:07:39.601774 28419 server_base.cc:1034] running on GCE node
I20260811 05:07:39.602033 28419 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:07:39.602339 28419 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:07:39.603516 28419 hybrid_clock.cc:648] HybridClock initialized: now 1786424859603487 us; error 74 us; skew 500 ppm
Aug 11 05:07:39 dist-test-slave-x5fp krb5kdc[28240](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424859, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:07:39.606320 28419 init.cc:377] Logged in from keytab as kudu/127.26.191.193@KRBTEST.COM (short username kudu)
I20260811 05:07:39.606817 28419 webserver.cc:460] Webserver started at http://127.26.191.193:44423/ using document root <none> and password file <none>
I20260811 05:07:39.607111 28419 fs_manager.cc:359] Metadata directory not provided
I20260811 05:07:39.607182 28419 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:07:39.607328 28419 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:07:39.608466 28419 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424853995437-27391-0/minicluster-data/ts-0/data/instance:
uuid: "fa4b4f789a724a9d83221cc62909b87b"
format_stamp: "Formatted at 2026-08-11 05:07:39 on dist-test-slave-x5fp"
server_key: "bd96191d1698d4a5e77f64b9edfdf2e7"
server_key_iv: "5fcbf383be0701dab910892b260972f5"
server_key_version: "encryptionkey@0"
I20260811 05:07:39.608907 28419 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424853995437-27391-0/minicluster-data/ts-0/wal/instance:
uuid: "fa4b4f789a724a9d83221cc62909b87b"
format_stamp: "Formatted at 2026-08-11 05:07:39 on dist-test-slave-x5fp"
server_key: "bd96191d1698d4a5e77f64b9edfdf2e7"
server_key_iv: "5fcbf383be0701dab910892b260972f5"
server_key_version: "encryptionkey@0"
I20260811 05:07:39.610385 28419 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 05:07:39.611295 28443 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:39.611548 28419 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:07:39.611675 28419 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424853995437-27391-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424853995437-27391-0/minicluster-data/ts-0/wal
uuid: "fa4b4f789a724a9d83221cc62909b87b"
format_stamp: "Formatted at 2026-08-11 05:07:39 on dist-test-slave-x5fp"
server_key: "bd96191d1698d4a5e77f64b9edfdf2e7"
server_key_iv: "5fcbf383be0701dab910892b260972f5"
server_key_version: "encryptionkey@0"
I20260811 05:07:39.611760 28419 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424853995437-27391-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424853995437-27391-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424853995437-27391-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:07:39.634274 28419 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:07:39.636886 28419 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:07:39.637074 28419 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:07:39.637367 28419 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:07:39.637753 28419 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:07:39.637820 28419 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:39.637862 28419 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:07:39.637912 28419 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:39.644977 28419 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.193:39577
I20260811 05:07:39.645051 28632 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.193:39577 every 8 connection(s)
I20260811 05:07:39.645443 28419 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424853995437-27391-0/minicluster-data/ts-0/data/info.pb
Aug 11 05:07:39 dist-test-slave-x5fp krb5kdc[28240](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424859, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.193@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
I20260811 05:07:39.653666 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 28419
I20260811 05:07:39.653781 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424853995437-27391-0/minicluster-data/ts-0/wal/instance
I20260811 05:07:39.654031 27391 external_mini_cluster.cc:1428] Setting key 97bc33373cb2fe8fcd554e93c7d7d8cd
I20260811 05:07:39.656653 28379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:39.646354 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.193:50261 (local address 127.26.191.254:46005)
0811 05:07:39.646455 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:39.646458 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:39.646652 (+ 194us) server_negotiation.cc:407] Connection header received
0811 05:07:39.647794 (+ 1142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:39.647796 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:39.647811 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:39.647876 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:39.648581 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:39.649184 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:39.650383 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:39.650616 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:39.650704 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:39.653195 (+ 2491us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:39.653197 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:39.653197 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:07:39.653206 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:39.655116 (+ 1910us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:39.655586 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:39.655588 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:39.655588 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:39.655660 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:39.655912 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:39.655913 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:39.655913 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:39.656069 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:39.656150 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:39.656405 (+ 255us) server_negotiation.cc:299] Negotiation successful
0811 05:07:39.656513 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 05:07:39.656852 28635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:39.646312 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:46005 (local address 127.26.191.193:50261)
0811 05:07:39.646513 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:39.646554 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:39.647590 (+ 1036us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:39.647966 (+ 376us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:39.647970 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:39.648247 (+ 277us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:07:39.648473 (+ 226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:39.648477 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:39.649306 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:39.649307 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:39.650284 (+ 977us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:39.650287 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:39.650719 (+ 432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:39.650721 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:39.650858 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:39.651453 (+ 595us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:07:39.651463 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:07:39.653088 (+ 1625us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:07:39.655217 (+ 2129us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:07:39.655226 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:07:39.655228 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:07:39.655506 (+ 278us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:07:39.655728 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:07:39.655728 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:07:39.655729 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:07:39.655839 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:07:39.656138 (+ 299us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:07:39.656143 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:07:39.656271 (+ 128us) client_negotiation.cc:769] Sending connection context
0811 05:07:39.656376 (+ 105us) client_negotiation.cc:240] Negotiation successful
0811 05:07:39.656510 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":112,"threads_started":1}
I20260811 05:07:39.657451 28633 heartbeater.cc:347] Connected to a master server at 127.26.191.254:46005
I20260811 05:07:39.657577 28633 heartbeater.cc:464] Registering TS with master...
I20260811 05:07:39.657795 28633 heartbeater.cc:511] Master 127.26.191.254:46005 requested a full tablet report, sending...
I20260811 05:07:39.658401 28324 ts_manager.cc:194] Registered new tserver with Master: fa4b4f789a724a9d83221cc62909b87b (127.26.191.193:39577)
I20260811 05:07:39.659368 28324 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.191.193@KRBTEST.COM'} at 127.26.191.193:50261
WARNING: no policy specified for kudu/127.26.191.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.191.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.191.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.194.keytab.
Entry for principal kudu/127.26.191.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.194.keytab.
I20260811 05:07:39.687109 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424853995437-27391-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424853995437-27391-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424853995437-27391-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424853995437-27391-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.191.194:0
--local_ip_for_outbound_sockets=127.26.191.194
--webserver_interface=127.26.191.194
--webserver_port=0
--tserver_master_addrs=127.26.191.254:46005
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.194.keytab
--principal=kudu/127.26.191.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:35095
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:07:39.777809 28643 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:07:39.778295 28643 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:07:39.778406 28643 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:07:39.779697 28643 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:07:39.779762 28643 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:07:39.779809 28643 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.191.194
I20260811 05:07:39.781570 28643 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:35095
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424853995437-27391-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424853995437-27391-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.194.keytab
--principal=kudu/127.26.191.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.191.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424853995437-27391-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.191.194
--webserver_port=0
--tserver_master_addrs=127.26.191.254:46005
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28643
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.191.194
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424853995437-27391-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:07:39.781865 28643 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:07:39.782130 28643 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:07:39.788102 28655 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:39.788211 28660 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:39.788319 28653 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:07:39.788439 28643 server_base.cc:1034] running on GCE node
I20260811 05:07:39.788964 28643 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:07:39.789214 28643 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:07:39.790386 28643 hybrid_clock.cc:648] HybridClock initialized: now 1786424859790374 us; error 38 us; skew 500 ppm
Aug 11 05:07:39 dist-test-slave-x5fp krb5kdc[28240](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424859, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:07:39.793902 28643 init.cc:377] Logged in from keytab as kudu/127.26.191.194@KRBTEST.COM (short username kudu)
I20260811 05:07:39.794438 28643 webserver.cc:460] Webserver started at http://127.26.191.194:39909/ using document root <none> and password file <none>
I20260811 05:07:39.794725 28643 fs_manager.cc:359] Metadata directory not provided
I20260811 05:07:39.794777 28643 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:07:39.794917 28643 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:07:39.796072 28643 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424853995437-27391-0/minicluster-data/ts-1/data/instance:
uuid: "b6760a2e389d44d89df1682c994bdf02"
format_stamp: "Formatted at 2026-08-11 05:07:39 on dist-test-slave-x5fp"
server_key: "2f33120e76e504e59db52ee87eee869a"
server_key_iv: "63d0b3d97e13d01ce1915914c0035e2e"
server_key_version: "encryptionkey@0"
I20260811 05:07:39.796458 28643 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424853995437-27391-0/minicluster-data/ts-1/wal/instance:
uuid: "b6760a2e389d44d89df1682c994bdf02"
format_stamp: "Formatted at 2026-08-11 05:07:39 on dist-test-slave-x5fp"
server_key: "2f33120e76e504e59db52ee87eee869a"
server_key_iv: "63d0b3d97e13d01ce1915914c0035e2e"
server_key_version: "encryptionkey@0"
I20260811 05:07:39.798080 28643 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260811 05:07:39.799080 28669 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:39.799404 28643 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:07:39.799557 28643 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424853995437-27391-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424853995437-27391-0/minicluster-data/ts-1/wal
uuid: "b6760a2e389d44d89df1682c994bdf02"
format_stamp: "Formatted at 2026-08-11 05:07:39 on dist-test-slave-x5fp"
server_key: "2f33120e76e504e59db52ee87eee869a"
server_key_iv: "63d0b3d97e13d01ce1915914c0035e2e"
server_key_version: "encryptionkey@0"
I20260811 05:07:39.799651 28643 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424853995437-27391-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424853995437-27391-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424853995437-27391-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:07:39.820379 28643 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:07:39.823311 28643 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:07:39.823508 28643 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:07:39.823796 28643 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:07:39.824160 28643 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:07:39.824220 28643 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:39.824270 28643 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:07:39.824314 28643 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:39.830765 28643 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.194:36435
I20260811 05:07:39.830818 28863 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.194:36435 every 8 connection(s)
I20260811 05:07:39.831187 28643 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424853995437-27391-0/minicluster-data/ts-1/data/info.pb
I20260811 05:07:39.834249 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 28643
I20260811 05:07:39.834379 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424853995437-27391-0/minicluster-data/ts-1/wal/instance
I20260811 05:07:39.834568 27391 external_mini_cluster.cc:1428] Setting key 051938245ccf2ecfb79f04c254c4acb0
Aug 11 05:07:39 dist-test-slave-x5fp krb5kdc[28240](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424859, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.194@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
I20260811 05:07:39.844305 28379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:39.832073 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.194:35127 (local address 127.26.191.254:46005)
0811 05:07:39.832197 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:39.832199 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:39.832390 (+ 191us) server_negotiation.cc:407] Connection header received
0811 05:07:39.833797 (+ 1407us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:39.833799 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:39.833815 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:39.833917 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:39.835646 (+ 1729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:39.836182 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:39.837356 (+ 1174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:39.837565 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:39.837663 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:39.840524 (+ 2861us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:39.840525 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:39.840526 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:07:39.840536 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:39.842468 (+ 1932us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:39.843064 (+ 596us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:39.843066 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:39.843066 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:39.843133 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:39.843492 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:39.843493 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:39.843494 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:39.843637 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:39.843706 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:39.844133 (+ 427us) server_negotiation.cc:299] Negotiation successful
0811 05:07:39.844217 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260811 05:07:39.844650 28867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:39.831986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:46005 (local address 127.26.191.194:35127)
0811 05:07:39.832177 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:39.832224 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:39.833428 (+ 1204us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:39.834115 (+ 687us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:39.834121 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:39.835077 (+ 956us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:07:39.835470 (+ 393us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:39.835481 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:39.836293 (+ 812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:39.836294 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:39.837260 (+ 966us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:39.837263 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:39.837676 (+ 413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:39.837677 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:39.837811 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:39.838438 (+ 627us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:07:39.838450 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:07:39.840377 (+ 1927us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:07:39.842573 (+ 2196us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:07:39.842582 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:07:39.842586 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:07:39.842955 (+ 369us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:07:39.843219 (+ 264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:07:39.843220 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:07:39.843221 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:07:39.843394 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:07:39.843725 (+ 331us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:07:39.843741 (+ 16us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:07:39.843935 (+ 194us) client_negotiation.cc:769] Sending connection context
0811 05:07:39.844078 (+ 143us) client_negotiation.cc:240] Negotiation successful
0811 05:07:39.844302 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":92,"threads_started":1}
WARNING: no policy specified for kudu/127.26.191.195@KRBTEST.COM; defaulting to no policy
I20260811 05:07:39.845342 28864 heartbeater.cc:347] Connected to a master server at 127.26.191.254:46005
I20260811 05:07:39.845438 28864 heartbeater.cc:464] Registering TS with master...
I20260811 05:07:39.845599 28864 heartbeater.cc:511] Master 127.26.191.254:46005 requested a full tablet report, sending...
I20260811 05:07:39.846006 28324 ts_manager.cc:194] Registered new tserver with Master: b6760a2e389d44d89df1682c994bdf02 (127.26.191.194:36435)
I20260811 05:07:39.846437 28324 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.191.194@KRBTEST.COM'} at 127.26.191.194:35127
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.191.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.191.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.195.keytab.
Entry for principal kudu/127.26.191.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.195.keytab.
I20260811 05:07:39.870005 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424853995437-27391-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424853995437-27391-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424853995437-27391-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424853995437-27391-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.191.195:0
--local_ip_for_outbound_sockets=127.26.191.195
--webserver_interface=127.26.191.195
--webserver_port=0
--tserver_master_addrs=127.26.191.254:46005
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.195.keytab
--principal=kudu/127.26.191.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:35095
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:07:39.970270 28873 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:07:39.970543 28873 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:07:39.970602 28873 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:07:39.971966 28873 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:07:39.972041 28873 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:07:39.972095 28873 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.191.195
I20260811 05:07:39.974104 28873 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:35095
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424853995437-27391-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424853995437-27391-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.195.keytab
--principal=kudu/127.26.191.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.191.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424853995437-27391-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.191.195
--webserver_port=0
--tserver_master_addrs=127.26.191.254:46005
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28873
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.191.195
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424853995437-27391-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:07:39.974416 28873 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:07:39.974681 28873 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:07:39.980934 28882 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:39.981048 28884 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:07:39.981187 28873 server_base.cc:1034] running on GCE node
W20260811 05:07:39.981417 28881 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:07:39.981827 28873 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:07:39.982143 28873 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:07:39.983325 28873 hybrid_clock.cc:648] HybridClock initialized: now 1786424859983287 us; error 43 us; skew 500 ppm
Aug 11 05:07:39 dist-test-slave-x5fp krb5kdc[28240](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424859, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:07:39.986364 28873 init.cc:377] Logged in from keytab as kudu/127.26.191.195@KRBTEST.COM (short username kudu)
I20260811 05:07:39.987083 28873 webserver.cc:460] Webserver started at http://127.26.191.195:44607/ using document root <none> and password file <none>
I20260811 05:07:39.987361 28873 fs_manager.cc:359] Metadata directory not provided
I20260811 05:07:39.987414 28873 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:07:39.987558 28873 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:07:39.988929 28873 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424853995437-27391-0/minicluster-data/ts-2/data/instance:
uuid: "d7baf4c73c9d45b1b24cddff78ea056b"
format_stamp: "Formatted at 2026-08-11 05:07:39 on dist-test-slave-x5fp"
server_key: "fae0a2e2e2aca0df7d62c3acef4b39d7"
server_key_iv: "f46b001b77af62fdd5446961895fb26a"
server_key_version: "encryptionkey@0"
I20260811 05:07:39.989334 28873 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424853995437-27391-0/minicluster-data/ts-2/wal/instance:
uuid: "d7baf4c73c9d45b1b24cddff78ea056b"
format_stamp: "Formatted at 2026-08-11 05:07:39 on dist-test-slave-x5fp"
server_key: "fae0a2e2e2aca0df7d62c3acef4b39d7"
server_key_iv: "f46b001b77af62fdd5446961895fb26a"
server_key_version: "encryptionkey@0"
I20260811 05:07:39.990888 28873 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260811 05:07:39.991966 28895 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:39.992252 28873 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:07:39.992353 28873 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424853995437-27391-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424853995437-27391-0/minicluster-data/ts-2/wal
uuid: "d7baf4c73c9d45b1b24cddff78ea056b"
format_stamp: "Formatted at 2026-08-11 05:07:39 on dist-test-slave-x5fp"
server_key: "fae0a2e2e2aca0df7d62c3acef4b39d7"
server_key_iv: "f46b001b77af62fdd5446961895fb26a"
server_key_version: "encryptionkey@0"
I20260811 05:07:39.992480 28873 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424853995437-27391-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424853995437-27391-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424853995437-27391-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:07:40.012861 28873 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:07:40.015681 28873 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:07:40.015938 28873 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:07:40.016256 28873 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:07:40.016641 28873 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:07:40.016700 28873 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:40.016762 28873 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:07:40.016813 28873 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:40.023123 28873 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.195:34903
I20260811 05:07:40.023183 29079 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.195:34903 every 8 connection(s)
I20260811 05:07:40.023581 28873 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424853995437-27391-0/minicluster-data/ts-2/data/info.pb
I20260811 05:07:40.027336 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 28873
I20260811 05:07:40.027561 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424853995437-27391-0/minicluster-data/ts-2/wal/instance
I20260811 05:07:40.027742 27391 external_mini_cluster.cc:1428] Setting key d0ca88c8c8868af55748e986c56113fd
Aug 11 05:07:40 dist-test-slave-x5fp krb5kdc[28240](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424859, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.195@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
I20260811 05:07:40.035392 28379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:40.024484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.195:38803 (local address 127.26.191.254:46005)
0811 05:07:40.024575 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:40.024578 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:40.024752 (+ 174us) server_negotiation.cc:407] Connection header received
0811 05:07:40.025874 (+ 1122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:40.025875 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:40.025887 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:40.025954 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:40.026771 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:40.027337 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:40.029194 (+ 1857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:40.029416 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:40.029485 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:40.032016 (+ 2531us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:40.032018 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:40.032018 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:07:40.032026 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:40.033698 (+ 1672us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:40.034305 (+ 607us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:40.034306 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:40.034307 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:40.034374 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:40.034686 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:40.034687 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:40.034687 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:40.034869 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:40.034932 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:40.035244 (+ 312us) server_negotiation.cc:299] Negotiation successful
0811 05:07:40.035317 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 05:07:40.035593 29084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:40.024422 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:46005 (local address 127.26.191.195:38803)
0811 05:07:40.024598 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:40.024639 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:40.025669 (+ 1030us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:40.026145 (+ 476us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:40.026150 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:40.026446 (+ 296us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:07:40.026649 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:40.026654 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:40.027570 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:40.027571 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:40.029078 (+ 1507us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:40.029081 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:40.029520 (+ 439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:40.029521 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:40.029639 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:40.030268 (+ 629us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:07:40.030283 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:07:40.031870 (+ 1587us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:07:40.033793 (+ 1923us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:07:40.033800 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:07:40.033802 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:07:40.034054 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:07:40.034468 (+ 414us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:07:40.034470 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:07:40.034470 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:07:40.034595 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:07:40.034966 (+ 371us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:07:40.034973 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:07:40.035109 (+ 136us) client_negotiation.cc:769] Sending connection context
0811 05:07:40.035215 (+ 106us) client_negotiation.cc:240] Negotiation successful
0811 05:07:40.035353 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":105,"threads_started":1}
I20260811 05:07:40.036136 29082 heartbeater.cc:347] Connected to a master server at 127.26.191.254:46005
I20260811 05:07:40.036257 29082 heartbeater.cc:464] Registering TS with master...
I20260811 05:07:40.036453 29082 heartbeater.cc:511] Master 127.26.191.254:46005 requested a full tablet report, sending...
I20260811 05:07:40.037011 28324 ts_manager.cc:194] Registered new tserver with Master: d7baf4c73c9d45b1b24cddff78ea056b (127.26.191.195:34903)
I20260811 05:07:40.037439 28324 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.191.195@KRBTEST.COM'} at 127.26.191.195:38803
I20260811 05:07:40.040006 27391 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 05:07:40.048667 28379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:40.042089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42306 (local address 127.26.191.254:46005)
0811 05:07:40.042169 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:40.042171 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:40.042220 (+ 49us) server_negotiation.cc:407] Connection header received
0811 05:07:40.042267 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:40.042268 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:40.042277 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:40.042330 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:40.042910 (+ 580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:40.043397 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:40.044199 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:40.044393 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:40.044451 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:40.045780 (+ 1329us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:40.045781 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:40.045782 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:07:40.045788 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:40.047250 (+ 1462us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:40.047602 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:40.047603 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:40.047603 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:40.047668 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:40.047922 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:40.047923 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:40.047924 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:40.048142 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:40.048245 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:40.048421 (+ 176us) server_negotiation.cc:299] Negotiation successful
0811 05:07:40.048498 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 05:07:40.052034 28324 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42306:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 05:07:40.054208 28324 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 05:07:40.062458 29101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:40.057724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.194:36435 (local address 127.0.0.1:39162)
0811 05:07:40.057913 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:40.057960 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:40.058035 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:40.059065 (+ 1030us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:40.059066 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:40.059069 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:07:40.059117 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:40.059119 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:40.060361 (+ 1242us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:40.060362 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:40.061252 (+ 890us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:40.061255 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:40.062130 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:40.062131 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:40.062218 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:40.062232 (+ 14us) client_negotiation.cc:769] Sending connection context
0811 05:07:40.062309 (+ 77us) client_negotiation.cc:240] Negotiation successful
0811 05:07:40.062364 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":63,"threads_started":1}
I20260811 05:07:40.062496 29106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:40.058006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39162 (local address 127.26.191.194:36435)
0811 05:07:40.058889 (+ 883us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:40.058895 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:40.058904 (+ 9us) server_negotiation.cc:407] Connection header received
0811 05:07:40.058942 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:40.058944 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:40.058959 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:40.059188 (+ 229us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:07:40.059262 (+ 74us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:40.060227 (+ 965us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:40.061355 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:40.061960 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:40.062036 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:40.062092 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:40.062350 (+ 258us) server_negotiation.cc:299] Negotiation successful
0811 05:07:40.062401 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":845,"thread_start_us":102,"threads_started":1}
I20260811 05:07:40.062937 29104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:40.057724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.193:39577 (local address 127.0.0.1:40784)
0811 05:07:40.057996 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:40.058005 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:40.058049 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:40.058592 (+ 543us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:40.058595 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:40.058597 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:07:40.058710 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:40.058712 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:40.060136 (+ 1424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:40.060137 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:40.061689 (+ 1552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:40.061692 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:40.062691 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:40.062692 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:40.062750 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:40.062755 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 05:07:40.062809 (+ 54us) client_negotiation.cc:240] Negotiation successful
0811 05:07:40.062852 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":250,"mutex_wait_us":124,"thread_start_us":87,"threads_started":1}
I20260811 05:07:40.063055 29105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:40.058004 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40784 (local address 127.26.191.193:39577)
0811 05:07:40.058404 (+ 400us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:40.058409 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:40.058419 (+ 10us) server_negotiation.cc:407] Connection header received
0811 05:07:40.058454 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:40.058456 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:40.058470 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:40.058541 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:07:40.058844 (+ 303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:40.060010 (+ 1166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:40.061788 (+ 1778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:40.062514 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:40.062592 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:40.062655 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:40.062883 (+ 228us) server_negotiation.cc:299] Negotiation successful
0811 05:07:40.062932 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":365,"thread_start_us":94,"threads_started":1}
I20260811 05:07:40.063381 29103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:40.057738 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.195:34903 (local address 127.0.0.1:51786)
0811 05:07:40.058637 (+ 899us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:40.058673 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:40.058734 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:40.059112 (+ 378us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:40.059113 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:40.059122 (+ 9us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:07:40.059179 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:40.059181 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:40.060185 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:40.060186 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:40.061934 (+ 1748us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:40.061937 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:40.062966 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:40.062967 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:40.063147 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:40.063154 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 05:07:40.063211 (+ 57us) client_negotiation.cc:240] Negotiation successful
0811 05:07:40.063264 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":881,"mutex_wait_us":39,"thread_start_us":162,"threads_started":1}
I20260811 05:07:40.063740 29107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:40.058214 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51786 (local address 127.26.191.195:34903)
0811 05:07:40.058418 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:40.058422 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:40.058854 (+ 432us) server_negotiation.cc:407] Connection header received
0811 05:07:40.058910 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:40.058913 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:40.058931 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:40.059014 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:07:40.059284 (+ 270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:40.060034 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:40.062031 (+ 1997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:40.062748 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:40.062869 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:40.062932 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:40.063567 (+ 635us) server_negotiation.cc:299] Negotiation successful
0811 05:07:40.063646 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":169,"thread_start_us":77,"threads_started":1}
I20260811 05:07:40.063848 28522 tablet_service.cc:1467] Processing CreateTablet for tablet a30e0b8768834055936692db96d2e875 (DEFAULT_TABLE table=test-table [id=8e846da430394689b510d9ab11e1c310]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:07:40.063849 28754 tablet_service.cc:1467] Processing CreateTablet for tablet a30e0b8768834055936692db96d2e875 (DEFAULT_TABLE table=test-table [id=8e846da430394689b510d9ab11e1c310]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:07:40.064284 28522 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a30e0b8768834055936692db96d2e875. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:07:40.064277 28754 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a30e0b8768834055936692db96d2e875. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:07:40.064402 28982 tablet_service.cc:1467] Processing CreateTablet for tablet a30e0b8768834055936692db96d2e875 (DEFAULT_TABLE table=test-table [id=8e846da430394689b510d9ab11e1c310]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:07:40.064800 28982 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a30e0b8768834055936692db96d2e875. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:07:40.067725 29109 tablet_bootstrap.cc:492] T a30e0b8768834055936692db96d2e875 P fa4b4f789a724a9d83221cc62909b87b: Bootstrap starting.
I20260811 05:07:40.068320 29111 tablet_bootstrap.cc:492] T a30e0b8768834055936692db96d2e875 P b6760a2e389d44d89df1682c994bdf02: Bootstrap starting.
I20260811 05:07:40.068571 29109 tablet_bootstrap.cc:654] T a30e0b8768834055936692db96d2e875 P fa4b4f789a724a9d83221cc62909b87b: Neither blocks nor log segments found. Creating new log.
I20260811 05:07:40.068622 29114 tablet_bootstrap.cc:492] T a30e0b8768834055936692db96d2e875 P d7baf4c73c9d45b1b24cddff78ea056b: Bootstrap starting.
I20260811 05:07:40.069191 29111 tablet_bootstrap.cc:654] T a30e0b8768834055936692db96d2e875 P b6760a2e389d44d89df1682c994bdf02: Neither blocks nor log segments found. Creating new log.
I20260811 05:07:40.069288 29114 tablet_bootstrap.cc:654] T a30e0b8768834055936692db96d2e875 P d7baf4c73c9d45b1b24cddff78ea056b: Neither blocks nor log segments found. Creating new log.
I20260811 05:07:40.069561 29109 log.cc:824] T a30e0b8768834055936692db96d2e875 P fa4b4f789a724a9d83221cc62909b87b: Log is configured to *not* fsync() on all Append() calls
I20260811 05:07:40.069818 29114 log.cc:824] T a30e0b8768834055936692db96d2e875 P d7baf4c73c9d45b1b24cddff78ea056b: Log is configured to *not* fsync() on all Append() calls
I20260811 05:07:40.069890 29111 log.cc:824] T a30e0b8768834055936692db96d2e875 P b6760a2e389d44d89df1682c994bdf02: Log is configured to *not* fsync() on all Append() calls
I20260811 05:07:40.070642 29109 tablet_bootstrap.cc:492] T a30e0b8768834055936692db96d2e875 P fa4b4f789a724a9d83221cc62909b87b: No bootstrap required, opened a new log
I20260811 05:07:40.070713 29109 ts_tablet_manager.cc:1397] T a30e0b8768834055936692db96d2e875 P fa4b4f789a724a9d83221cc62909b87b: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260811 05:07:40.070778 29114 tablet_bootstrap.cc:492] T a30e0b8768834055936692db96d2e875 P d7baf4c73c9d45b1b24cddff78ea056b: No bootstrap required, opened a new log
I20260811 05:07:40.070793 29111 tablet_bootstrap.cc:492] T a30e0b8768834055936692db96d2e875 P b6760a2e389d44d89df1682c994bdf02: No bootstrap required, opened a new log
I20260811 05:07:40.070851 29114 ts_tablet_manager.cc:1397] T a30e0b8768834055936692db96d2e875 P d7baf4c73c9d45b1b24cddff78ea056b: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 05:07:40.070873 29111 ts_tablet_manager.cc:1397] T a30e0b8768834055936692db96d2e875 P b6760a2e389d44d89df1682c994bdf02: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260811 05:07:40.072299 29114 raft_consensus.cc:348] T a30e0b8768834055936692db96d2e875 P d7baf4c73c9d45b1b24cddff78ea056b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa4b4f789a724a9d83221cc62909b87b" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 39577 } } peers { permanent_uuid: "d7baf4c73c9d45b1b24cddff78ea056b" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 34903 } } peers { permanent_uuid: "b6760a2e389d44d89df1682c994bdf02" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 36435 } }
I20260811 05:07:40.072491 29114 raft_consensus.cc:374] T a30e0b8768834055936692db96d2e875 P d7baf4c73c9d45b1b24cddff78ea056b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:07:40.072539 29114 raft_consensus.cc:729] T a30e0b8768834055936692db96d2e875 P d7baf4c73c9d45b1b24cddff78ea056b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7baf4c73c9d45b1b24cddff78ea056b, State: Initialized, Role: FOLLOWER
I20260811 05:07:40.072656 29114 consensus_queue.cc:260] T a30e0b8768834055936692db96d2e875 P d7baf4c73c9d45b1b24cddff78ea056b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa4b4f789a724a9d83221cc62909b87b" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 39577 } } peers { permanent_uuid: "d7baf4c73c9d45b1b24cddff78ea056b" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 34903 } } peers { permanent_uuid: "b6760a2e389d44d89df1682c994bdf02" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 36435 } }
I20260811 05:07:40.073011 29114 ts_tablet_manager.cc:1428] T a30e0b8768834055936692db96d2e875 P d7baf4c73c9d45b1b24cddff78ea056b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 05:07:40.073171 29082 heartbeater.cc:503] Master 127.26.191.254:46005 was elected leader, sending a full tablet report...
I20260811 05:07:40.073146 29111 raft_consensus.cc:348] T a30e0b8768834055936692db96d2e875 P b6760a2e389d44d89df1682c994bdf02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa4b4f789a724a9d83221cc62909b87b" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 39577 } } peers { permanent_uuid: "d7baf4c73c9d45b1b24cddff78ea056b" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 34903 } } peers { permanent_uuid: "b6760a2e389d44d89df1682c994bdf02" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 36435 } }
I20260811 05:07:40.073146 29109 raft_consensus.cc:348] T a30e0b8768834055936692db96d2e875 P fa4b4f789a724a9d83221cc62909b87b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa4b4f789a724a9d83221cc62909b87b" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 39577 } } peers { permanent_uuid: "d7baf4c73c9d45b1b24cddff78ea056b" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 34903 } } peers { permanent_uuid: "b6760a2e389d44d89df1682c994bdf02" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 36435 } }
I20260811 05:07:40.073335 29109 raft_consensus.cc:374] T a30e0b8768834055936692db96d2e875 P fa4b4f789a724a9d83221cc62909b87b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:07:40.073334 29111 raft_consensus.cc:374] T a30e0b8768834055936692db96d2e875 P b6760a2e389d44d89df1682c994bdf02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:07:40.073376 29109 raft_consensus.cc:729] T a30e0b8768834055936692db96d2e875 P fa4b4f789a724a9d83221cc62909b87b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa4b4f789a724a9d83221cc62909b87b, State: Initialized, Role: FOLLOWER
I20260811 05:07:40.073376 29111 raft_consensus.cc:729] T a30e0b8768834055936692db96d2e875 P b6760a2e389d44d89df1682c994bdf02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6760a2e389d44d89df1682c994bdf02, State: Initialized, Role: FOLLOWER
I20260811 05:07:40.073514 29111 consensus_queue.cc:260] T a30e0b8768834055936692db96d2e875 P b6760a2e389d44d89df1682c994bdf02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa4b4f789a724a9d83221cc62909b87b" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 39577 } } peers { permanent_uuid: "d7baf4c73c9d45b1b24cddff78ea056b" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 34903 } } peers { permanent_uuid: "b6760a2e389d44d89df1682c994bdf02" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 36435 } }
I20260811 05:07:40.073514 29109 consensus_queue.cc:260] T a30e0b8768834055936692db96d2e875 P fa4b4f789a724a9d83221cc62909b87b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa4b4f789a724a9d83221cc62909b87b" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 39577 } } peers { permanent_uuid: "d7baf4c73c9d45b1b24cddff78ea056b" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 34903 } } peers { permanent_uuid: "b6760a2e389d44d89df1682c994bdf02" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 36435 } }
I20260811 05:07:40.073856 29109 ts_tablet_manager.cc:1428] T a30e0b8768834055936692db96d2e875 P fa4b4f789a724a9d83221cc62909b87b: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260811 05:07:40.074021 28633 heartbeater.cc:503] Master 127.26.191.254:46005 was elected leader, sending a full tablet report...
I20260811 05:07:40.074357 29111 ts_tablet_manager.cc:1428] T a30e0b8768834055936692db96d2e875 P b6760a2e389d44d89df1682c994bdf02: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 05:07:40.074535 28864 heartbeater.cc:503] Master 127.26.191.254:46005 was elected leader, sending a full tablet report...
W20260811 05:07:40.082185 28866 tablet.cc:2369] T a30e0b8768834055936692db96d2e875 P b6760a2e389d44d89df1682c994bdf02: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 05:07:40.146349 28634 tablet.cc:2369] T a30e0b8768834055936692db96d2e875 P fa4b4f789a724a9d83221cc62909b87b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 05:07:40.274456 29083 tablet.cc:2369] T a30e0b8768834055936692db96d2e875 P d7baf4c73c9d45b1b24cddff78ea056b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 05:07:40.293375 29122 raft_consensus.cc:482] T a30e0b8768834055936692db96d2e875 P fa4b4f789a724a9d83221cc62909b87b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 05:07:40.293524 29122 raft_consensus.cc:504] T a30e0b8768834055936692db96d2e875 P fa4b4f789a724a9d83221cc62909b87b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa4b4f789a724a9d83221cc62909b87b" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 39577 } } peers { permanent_uuid: "d7baf4c73c9d45b1b24cddff78ea056b" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 34903 } } peers { permanent_uuid: "b6760a2e389d44d89df1682c994bdf02" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 36435 } }
I20260811 05:07:40.294270 29122 leader_election.cc:288] T a30e0b8768834055936692db96d2e875 P fa4b4f789a724a9d83221cc62909b87b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7baf4c73c9d45b1b24cddff78ea056b (127.26.191.195:34903), b6760a2e389d44d89df1682c994bdf02 (127.26.191.194:36435)
I20260811 05:07:40.297490 29106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:40.294554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.193:42441 (local address 127.26.191.194:36435)
0811 05:07:40.294609 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:40.294618 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:40.294681 (+ 63us) server_negotiation.cc:407] Connection header received
0811 05:07:40.294783 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:40.294784 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:40.294795 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:40.294881 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:07:40.295048 (+ 167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:40.295580 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:40.296662 (+ 1082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:40.297123 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:40.297212 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:40.297222 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:40.297368 (+ 146us) server_negotiation.cc:299] Negotiation successful
0811 05:07:40.297408 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 05:07:40.297511 29125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:40.294452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.194:36435 (local address 127.26.191.193:42441)
0811 05:07:40.294608 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:40.294621 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:40.294700 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:40.294878 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:40.294879 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:40.294881 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:07:40.294975 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:40.294977 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:40.295661 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:40.295662 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:40.296571 (+ 909us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:40.296574 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:40.297209 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:40.297210 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:40.297282 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:40.297286 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 05:07:40.297362 (+ 76us) client_negotiation.cc:240] Negotiation successful
0811 05:07:40.297408 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":69,"threads_started":1}
I20260811 05:07:40.297909 29126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:40.294507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.195:34903 (local address 127.26.191.193:50945)
0811 05:07:40.294667 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:40.294679 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:40.294772 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:40.295011 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:40.295012 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:40.295014 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:07:40.295104 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:40.295106 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:40.295920 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:40.295921 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:40.296978 (+ 1057us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:40.296980 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:40.297603 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:40.297605 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:40.297714 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:40.297719 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 05:07:40.297785 (+ 66us) client_negotiation.cc:240] Negotiation successful
0811 05:07:40.297825 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":65,"threads_started":1}
I20260811 05:07:40.297991 28784 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a30e0b8768834055936692db96d2e875" candidate_uuid: "fa4b4f789a724a9d83221cc62909b87b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6760a2e389d44d89df1682c994bdf02" is_pre_election: true
I20260811 05:07:40.298202 29107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:40.294614 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.193:50945 (local address 127.26.191.195:34903)
0811 05:07:40.294684 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:40.294686 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:40.294755 (+ 69us) server_negotiation.cc:407] Connection header received
0811 05:07:40.294881 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:40.294882 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:40.294894 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:40.295003 (+ 109us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:07:40.295190 (+ 187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:40.295790 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:40.297083 (+ 1293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:40.297506 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:40.297603 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:40.297612 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:40.298072 (+ 460us) server_negotiation.cc:299] Negotiation successful
0811 05:07:40.298131 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 05:07:40.298243 28784 raft_consensus.cc:2454] T a30e0b8768834055936692db96d2e875 P b6760a2e389d44d89df1682c994bdf02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa4b4f789a724a9d83221cc62909b87b in term 0.
I20260811 05:07:40.298540 29014 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a30e0b8768834055936692db96d2e875" candidate_uuid: "fa4b4f789a724a9d83221cc62909b87b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7baf4c73c9d45b1b24cddff78ea056b" is_pre_election: true
I20260811 05:07:40.298597 28446 leader_election.cc:302] T a30e0b8768834055936692db96d2e875 P fa4b4f789a724a9d83221cc62909b87b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6760a2e389d44d89df1682c994bdf02, fa4b4f789a724a9d83221cc62909b87b; no voters:
I20260811 05:07:40.298704 29014 raft_consensus.cc:2454] T a30e0b8768834055936692db96d2e875 P d7baf4c73c9d45b1b24cddff78ea056b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa4b4f789a724a9d83221cc62909b87b in term 0.
I20260811 05:07:40.298743 29122 raft_consensus.cc:2781] T a30e0b8768834055936692db96d2e875 P fa4b4f789a724a9d83221cc62909b87b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 05:07:40.298810 29122 raft_consensus.cc:482] T a30e0b8768834055936692db96d2e875 P fa4b4f789a724a9d83221cc62909b87b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 05:07:40.298839 29122 raft_consensus.cc:3037] T a30e0b8768834055936692db96d2e875 P fa4b4f789a724a9d83221cc62909b87b [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:07:40.299607 29122 raft_consensus.cc:504] T a30e0b8768834055936692db96d2e875 P fa4b4f789a724a9d83221cc62909b87b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa4b4f789a724a9d83221cc62909b87b" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 39577 } } peers { permanent_uuid: "d7baf4c73c9d45b1b24cddff78ea056b" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 34903 } } peers { permanent_uuid: "b6760a2e389d44d89df1682c994bdf02" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 36435 } }
I20260811 05:07:40.299731 29122 leader_election.cc:288] T a30e0b8768834055936692db96d2e875 P fa4b4f789a724a9d83221cc62909b87b [CANDIDATE]: Term 1 election: Requested vote from peers d7baf4c73c9d45b1b24cddff78ea056b (127.26.191.195:34903), b6760a2e389d44d89df1682c994bdf02 (127.26.191.194:36435)
I20260811 05:07:40.299988 28784 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a30e0b8768834055936692db96d2e875" candidate_uuid: "fa4b4f789a724a9d83221cc62909b87b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6760a2e389d44d89df1682c994bdf02"
I20260811 05:07:40.299995 29014 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a30e0b8768834055936692db96d2e875" candidate_uuid: "fa4b4f789a724a9d83221cc62909b87b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7baf4c73c9d45b1b24cddff78ea056b"
I20260811 05:07:40.300076 28784 raft_consensus.cc:3037] T a30e0b8768834055936692db96d2e875 P b6760a2e389d44d89df1682c994bdf02 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:07:40.300076 29014 raft_consensus.cc:3037] T a30e0b8768834055936692db96d2e875 P d7baf4c73c9d45b1b24cddff78ea056b [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:07:40.301072 29014 raft_consensus.cc:2454] T a30e0b8768834055936692db96d2e875 P d7baf4c73c9d45b1b24cddff78ea056b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa4b4f789a724a9d83221cc62909b87b in term 1.
I20260811 05:07:40.301086 28784 raft_consensus.cc:2454] T a30e0b8768834055936692db96d2e875 P b6760a2e389d44d89df1682c994bdf02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa4b4f789a724a9d83221cc62909b87b in term 1.
I20260811 05:07:40.301311 28446 leader_election.cc:302] T a30e0b8768834055936692db96d2e875 P fa4b4f789a724a9d83221cc62909b87b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6760a2e389d44d89df1682c994bdf02, fa4b4f789a724a9d83221cc62909b87b; no voters:
I20260811 05:07:40.301429 29122 raft_consensus.cc:2781] T a30e0b8768834055936692db96d2e875 P fa4b4f789a724a9d83221cc62909b87b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:07:40.301615 29122 raft_consensus.cc:686] T a30e0b8768834055936692db96d2e875 P fa4b4f789a724a9d83221cc62909b87b [term 1 LEADER]: Becoming Leader. State: Replica: fa4b4f789a724a9d83221cc62909b87b, State: Running, Role: LEADER
I20260811 05:07:40.301726 29122 consensus_queue.cc:237] T a30e0b8768834055936692db96d2e875 P fa4b4f789a724a9d83221cc62909b87b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa4b4f789a724a9d83221cc62909b87b" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 39577 } } peers { permanent_uuid: "d7baf4c73c9d45b1b24cddff78ea056b" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 34903 } } peers { permanent_uuid: "b6760a2e389d44d89df1682c994bdf02" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 36435 } }
I20260811 05:07:40.302817 28324 catalog_manager.cc:5495] T a30e0b8768834055936692db96d2e875 P fa4b4f789a724a9d83221cc62909b87b reported cstate change: term changed from 0 to 1, leader changed from <none> to fa4b4f789a724a9d83221cc62909b87b (127.26.191.193). New cstate: current_term: 1 leader_uuid: "fa4b4f789a724a9d83221cc62909b87b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa4b4f789a724a9d83221cc62909b87b" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 39577 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7baf4c73c9d45b1b24cddff78ea056b" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 34903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6760a2e389d44d89df1682c994bdf02" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 36435 } health_report { overall_health: UNKNOWN } } }
Aug 11 05:07:40 dist-test-slave-x5fp krb5kdc[28240](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424859, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.191.193@KRBTEST.COM
I20260811 05:07:40.353804 29105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:40.344760 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36904 (local address 127.26.191.193:39577)
0811 05:07:40.344832 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:40.344834 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:40.344910 (+ 76us) server_negotiation.cc:407] Connection header received
0811 05:07:40.344962 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:40.344964 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:40.344978 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:40.345054 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:40.345677 (+ 623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:40.346174 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:40.347053 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:40.347250 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:40.347318 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:40.350292 (+ 2974us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:40.350306 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:40.350306 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:07:40.350313 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:40.352387 (+ 2074us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:40.352898 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:40.352902 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:40.352902 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:40.352989 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:40.353215 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:40.353216 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:40.353216 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:40.353395 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:40.353539 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:40.353579 (+ 40us) server_negotiation.cc:299] Negotiation successful
0811 05:07:40.353659 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
Aug 11 05:07:40 dist-test-slave-x5fp krb5kdc[28240](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424860, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 05:07:40 dist-test-slave-x5fp krb5kdc[28240](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424860, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.26.191.193@KRBTEST.COM
I20260811 05:07:40.381470 29105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:40.372699 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36918 (local address 127.26.191.193:39577)
0811 05:07:40.372910 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:40.372913 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:40.373010 (+ 97us) server_negotiation.cc:407] Connection header received
0811 05:07:40.373116 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:40.373118 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:40.373128 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:40.373247 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:40.373864 (+ 617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:40.374362 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:40.375103 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:40.375315 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:40.375395 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:40.378277 (+ 2882us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:40.378279 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:40.378279 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:07:40.378287 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:40.379889 (+ 1602us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:40.380364 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:40.380365 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:40.380366 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:40.380445 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:40.380710 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:40.380711 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:40.380711 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:40.380924 (+ 213us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:40.381046 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:40.381290 (+ 244us) server_negotiation.cc:299] Negotiation successful
0811 05:07:40.381388 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":175}
Aug 11 05:07:40 dist-test-slave-x5fp krb5kdc[28240](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424860, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 05:07:40 dist-test-slave-x5fp krb5kdc[28240](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424860, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.191.193@KRBTEST.COM
I20260811 05:07:40.410913 29105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:40.401803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36930 (local address 127.26.191.193:39577)
0811 05:07:40.401925 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:40.401927 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:40.401938 (+ 11us) server_negotiation.cc:407] Connection header received
0811 05:07:40.401967 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:40.401968 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:40.401978 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:40.402038 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:40.402833 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:40.403445 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:40.404296 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:40.404500 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:40.404587 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:40.408032 (+ 3445us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:40.408034 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:40.408034 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:07:40.408051 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:40.409599 (+ 1548us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:40.410029 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:40.410030 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:40.410031 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:40.410097 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:40.410321 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:40.410322 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:40.410323 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:40.410439 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:40.410573 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:40.410701 (+ 128us) server_negotiation.cc:299] Negotiation successful
0811 05:07:40.410802 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
W20260811 05:07:40.411725 28486 tablet_service.cc:2908] Rejecting scan request for tablet a30e0b8768834055936692db96d2e875: Uninitialized: clean time has not yet been initialized
I20260811 05:07:40.413100 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 28419
I20260811 05:07:40.422392 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 28643
I20260811 05:07:40.439203 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 28873
I20260811 05:07:40.451740 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 28263
2026-08-11T05:07:40Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (3970 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 05:07:40 dist-test-slave-x5fp krb5kdc[29161](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 05:07:40 dist-test-slave-x5fp krb5kdc[29161](info): set up 2 sockets
Aug 11 05:07:40 dist-test-slave-x5fp krb5kdc[29161](info): commencing operation
krb5kdc: starting...
W20260811 05:07:41.761924 27391 mini_kdc.cc:121] Time spent starting KDC: real 1.280s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/krb5kdc/test-user.keytab.
Aug 11 05:07:41 dist-test-slave-x5fp krb5kdc[29161](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424861, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T05:07:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:07:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.191.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.191.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.191.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab.
Entry for principal kudu/127.26.191.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab.
I20260811 05:07:41.910009 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.254:44529
--webserver_interface=127.26.191.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab
--principal=kudu/127.26.191.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:39187
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.191.254:44529
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:07:42.009696 29181 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:07:42.009977 29181 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:07:42.010020 29181 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:07:42.011368 29181 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:07:42.011442 29181 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260811 05:07:42.011466 29181 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:07:42.011487 29181 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:07:42.011519 29181 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:07:42.011547 29181 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:07:42.013366 29181 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:39187
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.191.254:44529
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab
--principal=kudu/127.26.191.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.254:44529
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.191.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29181
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:07:42.013680 29181 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:07:42.013944 29181 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:07:42.019604 29196 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:42.019588 29192 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:42.019589 29194 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:07:42.020077 29181 server_base.cc:1034] running on GCE node
I20260811 05:07:42.020360 29181 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:07:42.020653 29181 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:07:42.021871 29181 hybrid_clock.cc:648] HybridClock initialized: now 1786424862021794 us; error 90 us; skew 500 ppm
Aug 11 05:07:42 dist-test-slave-x5fp krb5kdc[29161](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424862, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:07:42.024933 29181 init.cc:377] Logged in from keytab as kudu/127.26.191.254@KRBTEST.COM (short username kudu)
I20260811 05:07:42.025516 29181 webserver.cc:460] Webserver started at http://127.26.191.254:38237/ using document root <none> and password file <none>
I20260811 05:07:42.025776 29181 fs_manager.cc:359] Metadata directory not provided
I20260811 05:07:42.025851 29181 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:07:42.026016 29181 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:07:42.027185 29181 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/minicluster-data/master-0/data/instance:
uuid: "def2ffedbb54427aaf84618c15e016d9"
format_stamp: "Formatted at 2026-08-11 05:07:42 on dist-test-slave-x5fp"
server_key: "a3243ec42d2c8e4d0b1612cbabb49615"
server_key_iv: "e965886fe896f35e517110e8e29fa3d1"
server_key_version: "encryptionkey@0"
I20260811 05:07:42.027590 29181 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/minicluster-data/master-0/wal/instance:
uuid: "def2ffedbb54427aaf84618c15e016d9"
format_stamp: "Formatted at 2026-08-11 05:07:42 on dist-test-slave-x5fp"
server_key: "a3243ec42d2c8e4d0b1612cbabb49615"
server_key_iv: "e965886fe896f35e517110e8e29fa3d1"
server_key_version: "encryptionkey@0"
I20260811 05:07:42.029314 29181 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 05:07:42.030315 29204 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:42.030598 29181 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:07:42.030730 29181 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/minicluster-data/master-0/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/minicluster-data/master-0/wal
uuid: "def2ffedbb54427aaf84618c15e016d9"
format_stamp: "Formatted at 2026-08-11 05:07:42 on dist-test-slave-x5fp"
server_key: "a3243ec42d2c8e4d0b1612cbabb49615"
server_key_iv: "e965886fe896f35e517110e8e29fa3d1"
server_key_version: "encryptionkey@0"
I20260811 05:07:42.030829 29181 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:07:42.046345 29181 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:07:42.049227 29181 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:07:42.049422 29181 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:07:42.055287 29181 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.254:44529
I20260811 05:07:42.055342 29300 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.254:44529 every 8 connection(s)
I20260811 05:07:42.055701 29181 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
I20260811 05:07:42.056416 29301 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:07:42.057572 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 29181
I20260811 05:07:42.057701 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/minicluster-data/master-0/wal/instance
I20260811 05:07:42.057893 27391 external_mini_cluster.cc:1428] Setting key 890e14ee0706a467213c38e1819ebc3f
I20260811 05:07:42.059396 29301 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P def2ffedbb54427aaf84618c15e016d9: Bootstrap starting.
I20260811 05:07:42.060240 29301 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P def2ffedbb54427aaf84618c15e016d9: Neither blocks nor log segments found. Creating new log.
I20260811 05:07:42.060570 29301 log.cc:824] T 00000000000000000000000000000000 P def2ffedbb54427aaf84618c15e016d9: Log is configured to *not* fsync() on all Append() calls
I20260811 05:07:42.061347 29301 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P def2ffedbb54427aaf84618c15e016d9: No bootstrap required, opened a new log
I20260811 05:07:42.063980 29301 raft_consensus.cc:348] T 00000000000000000000000000000000 P def2ffedbb54427aaf84618c15e016d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "def2ffedbb54427aaf84618c15e016d9" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 44529 } }
I20260811 05:07:42.064203 29301 raft_consensus.cc:374] T 00000000000000000000000000000000 P def2ffedbb54427aaf84618c15e016d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:07:42.064260 29301 raft_consensus.cc:729] T 00000000000000000000000000000000 P def2ffedbb54427aaf84618c15e016d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: def2ffedbb54427aaf84618c15e016d9, State: Initialized, Role: FOLLOWER
I20260811 05:07:42.064419 29301 consensus_queue.cc:260] T 00000000000000000000000000000000 P def2ffedbb54427aaf84618c15e016d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "def2ffedbb54427aaf84618c15e016d9" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 44529 } }
I20260811 05:07:42.064504 29301 raft_consensus.cc:388] T 00000000000000000000000000000000 P def2ffedbb54427aaf84618c15e016d9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:07:42.064538 29301 raft_consensus.cc:482] T 00000000000000000000000000000000 P def2ffedbb54427aaf84618c15e016d9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:07:42.064589 29301 raft_consensus.cc:3037] T 00000000000000000000000000000000 P def2ffedbb54427aaf84618c15e016d9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:07:42.065217 29301 raft_consensus.cc:504] T 00000000000000000000000000000000 P def2ffedbb54427aaf84618c15e016d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "def2ffedbb54427aaf84618c15e016d9" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 44529 } }
Aug 11 05:07:42 dist-test-slave-x5fp krb5kdc[29161](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424861, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
I20260811 05:07:42.065320 29301 leader_election.cc:302] T 00000000000000000000000000000000 P def2ffedbb54427aaf84618c15e016d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: def2ffedbb54427aaf84618c15e016d9; no voters:
I20260811 05:07:42.065616 29301 leader_election.cc:288] T 00000000000000000000000000000000 P def2ffedbb54427aaf84618c15e016d9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 05:07:42.065645 29306 raft_consensus.cc:2781] T 00000000000000000000000000000000 P def2ffedbb54427aaf84618c15e016d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:07:42.065788 29306 raft_consensus.cc:686] T 00000000000000000000000000000000 P def2ffedbb54427aaf84618c15e016d9 [term 1 LEADER]: Becoming Leader. State: Replica: def2ffedbb54427aaf84618c15e016d9, State: Running, Role: LEADER
I20260811 05:07:42.065886 29306 consensus_queue.cc:237] T 00000000000000000000000000000000 P def2ffedbb54427aaf84618c15e016d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "def2ffedbb54427aaf84618c15e016d9" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 44529 } }
I20260811 05:07:42.065914 29301 sys_catalog.cc:564] T 00000000000000000000000000000000 P def2ffedbb54427aaf84618c15e016d9 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:07:42.066239 29306 sys_catalog.cc:455] T 00000000000000000000000000000000 P def2ffedbb54427aaf84618c15e016d9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader def2ffedbb54427aaf84618c15e016d9. Latest consensus state: current_term: 1 leader_uuid: "def2ffedbb54427aaf84618c15e016d9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "def2ffedbb54427aaf84618c15e016d9" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 44529 } } }
I20260811 05:07:42.066262 29309 sys_catalog.cc:455] T 00000000000000000000000000000000 P def2ffedbb54427aaf84618c15e016d9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "def2ffedbb54427aaf84618c15e016d9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "def2ffedbb54427aaf84618c15e016d9" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 44529 } } }
I20260811 05:07:42.066305 29306 sys_catalog.cc:458] T 00000000000000000000000000000000 P def2ffedbb54427aaf84618c15e016d9 [sys.catalog]: This master's current role is: LEADER
I20260811 05:07:42.066346 29309 sys_catalog.cc:458] T 00000000000000000000000000000000 P def2ffedbb54427aaf84618c15e016d9 [sys.catalog]: This master's current role is: LEADER
I20260811 05:07:42.066593 29317 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:07:42.067152 29317 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:07:42.069152 29317 catalog_manager.cc:1347] Generated new cluster ID: d7ea4c35addc4e378865dc4e9d06e585
I20260811 05:07:42.069208 29317 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:07:42.071081 29304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:42.058533 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58344 (local address 127.26.191.254:44529)
0811 05:07:42.058732 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:42.058740 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:42.058766 (+ 26us) server_negotiation.cc:407] Connection header received
0811 05:07:42.059190 (+ 424us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:42.059196 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:42.059254 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:42.059374 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:42.060195 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:42.061311 (+ 1116us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:42.062400 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:42.062881 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:42.062973 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:42.065920 (+ 2947us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:42.065925 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:42.065925 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:07:42.065939 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:42.069437 (+ 3498us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:42.069850 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:42.069853 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:42.069853 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:42.069953 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:42.070176 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:42.070177 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:42.070177 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:42.070433 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:42.070614 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:42.070703 (+ 89us) server_negotiation.cc:299] Negotiation successful
0811 05:07:42.070864 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":99,"threads_started":1}
I20260811 05:07:42.082455 29317 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:07:42.083119 29317 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:07:42.089947 29317 catalog_manager.cc:5868] T 00000000000000000000000000000000 P def2ffedbb54427aaf84618c15e016d9: Generated new TSK 0
I20260811 05:07:42.090286 29317 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.191.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.191.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.191.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.193.keytab.
Entry for principal kudu/127.26.191.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.193.keytab.
I20260811 05:07:42.140189 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.191.193:0
--local_ip_for_outbound_sockets=127.26.191.193
--webserver_interface=127.26.191.193
--webserver_port=0
--tserver_master_addrs=127.26.191.254:44529
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.193.keytab
--principal=kudu/127.26.191.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:39187
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:07:42.239331 29353 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:07:42.239557 29353 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:07:42.239584 29353 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:07:42.240811 29353 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:07:42.240859 29353 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:07:42.240881 29353 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 05:07:42.240926 29353 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.191.193
I20260811 05:07:42.242427 29353 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:39187
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.193.keytab
--principal=kudu/127.26.191.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.191.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.191.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.26.191.254:44529
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29353
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.191.193
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:07:42.242635 29353 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:07:42.242823 29353 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:07:42.248301 29362 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:42.248412 29361 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:42.248564 29364 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:07:42.248428 29353 server_base.cc:1034] running on GCE node
I20260811 05:07:42.249161 29353 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:07:42.249516 29353 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:07:42.250743 29353 hybrid_clock.cc:648] HybridClock initialized: now 1786424862250731 us; error 36 us; skew 500 ppm
Aug 11 05:07:42 dist-test-slave-x5fp krb5kdc[29161](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424862, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:07:42.253957 29353 init.cc:377] Logged in from keytab as kudu/127.26.191.193@KRBTEST.COM (short username kudu)
I20260811 05:07:42.254552 29353 webserver.cc:460] Webserver started at http://127.26.191.193:37013/ using document root <none> and password file <none>
I20260811 05:07:42.254805 29353 fs_manager.cc:359] Metadata directory not provided
I20260811 05:07:42.254877 29353 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:07:42.255041 29353 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:07:42.256177 29353 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/minicluster-data/ts-0/data/instance:
uuid: "00456d58a3de4c319ed39dd6e42fbd6e"
format_stamp: "Formatted at 2026-08-11 05:07:42 on dist-test-slave-x5fp"
server_key: "b78cd7a2e40cba3be3aa595d345ae85f"
server_key_iv: "61fed26f3a631ca8532185a765f7d653"
server_key_version: "encryptionkey@0"
I20260811 05:07:42.256577 29353 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/minicluster-data/ts-0/wal/instance:
uuid: "00456d58a3de4c319ed39dd6e42fbd6e"
format_stamp: "Formatted at 2026-08-11 05:07:42 on dist-test-slave-x5fp"
server_key: "b78cd7a2e40cba3be3aa595d345ae85f"
server_key_iv: "61fed26f3a631ca8532185a765f7d653"
server_key_version: "encryptionkey@0"
I20260811 05:07:42.258167 29353 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:07:42.259246 29378 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:42.259527 29353 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:07:42.259658 29353 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/minicluster-data/ts-0/wal
uuid: "00456d58a3de4c319ed39dd6e42fbd6e"
format_stamp: "Formatted at 2026-08-11 05:07:42 on dist-test-slave-x5fp"
server_key: "b78cd7a2e40cba3be3aa595d345ae85f"
server_key_iv: "61fed26f3a631ca8532185a765f7d653"
server_key_version: "encryptionkey@0"
I20260811 05:07:42.259747 29353 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:07:42.284901 29353 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:07:42.287920 29353 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:07:42.288285 29353 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:07:42.289238 29353 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:07:42.289321 29353 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:42.289387 29353 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:07:42.289422 29353 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 05:07:42 dist-test-slave-x5fp krb5kdc[29161](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424862, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.193@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
I20260811 05:07:42.297962 29353 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.193:46269
I20260811 05:07:42.298069 29559 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.193:46269 every 8 connection(s)
I20260811 05:07:42.298501 29353 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/minicluster-data/ts-0/data/info.pb
I20260811 05:07:42.301362 29394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:42.289988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:44529 (local address 127.26.191.193:36315)
0811 05:07:42.290222 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:42.290270 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:42.290819 (+ 549us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:42.291090 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:42.291095 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:42.291559 (+ 464us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:07:42.291888 (+ 329us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:42.291895 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:42.293201 (+ 1306us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:42.293202 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:42.294085 (+ 883us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:42.294088 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:42.294556 (+ 468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:42.294558 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:42.294703 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:42.295362 (+ 659us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:07:42.295371 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:07:42.297003 (+ 1632us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:07:42.299333 (+ 2330us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:07:42.299340 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:07:42.299342 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:07:42.299744 (+ 402us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:07:42.300122 (+ 378us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:07:42.300123 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:07:42.300123 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:07:42.300281 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:07:42.300668 (+ 387us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:07:42.300675 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:07:42.300916 (+ 241us) client_negotiation.cc:769] Sending connection context
0811 05:07:42.301027 (+ 111us) client_negotiation.cc:240] Negotiation successful
0811 05:07:42.301174 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":95,"threads_started":1}
I20260811 05:07:42.301610 29304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:42.290052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.193:36315 (local address 127.26.191.254:44529)
0811 05:07:42.290117 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:42.290119 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:42.290371 (+ 252us) server_negotiation.cc:407] Connection header received
0811 05:07:42.290932 (+ 561us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:42.290933 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:42.290946 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:42.291018 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:42.292020 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:42.293089 (+ 1069us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:42.294201 (+ 1112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:42.294429 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:42.294526 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:42.297105 (+ 2579us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:42.297107 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:42.297107 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:07:42.297119 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:42.299101 (+ 1982us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:42.299840 (+ 739us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:42.299842 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:42.299842 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:42.299952 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:42.300387 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:42.300388 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:42.300388 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:42.300542 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:42.300629 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:42.301376 (+ 747us) server_negotiation.cc:299] Negotiation successful
0811 05:07:42.301467 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 05:07:42.302129 29561 heartbeater.cc:347] Connected to a master server at 127.26.191.254:44529
I20260811 05:07:42.302242 29561 heartbeater.cc:464] Registering TS with master...
I20260811 05:07:42.302454 29561 heartbeater.cc:511] Master 127.26.191.254:44529 requested a full tablet report, sending...
I20260811 05:07:42.303129 29232 ts_manager.cc:194] Registered new tserver with Master: 00456d58a3de4c319ed39dd6e42fbd6e (127.26.191.193:46269)
I20260811 05:07:42.303916 29232 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.191.193@KRBTEST.COM'} at 127.26.191.193:36315
I20260811 05:07:42.308518 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 29353
I20260811 05:07:42.308645 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/minicluster-data/ts-0/wal/instance
I20260811 05:07:42.308909 27391 external_mini_cluster.cc:1428] Setting key 9da6fd88ce269011c98073771e70c275
I20260811 05:07:42.311152 29304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:42.303356 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.193:57953 (local address 127.26.191.254:44529)
0811 05:07:42.304130 (+ 774us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:42.304132 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:42.304140 (+ 8us) server_negotiation.cc:407] Connection header received
0811 05:07:42.304161 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:42.304161 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:42.304172 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:42.304234 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:42.304795 (+ 561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:42.305316 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:42.306323 (+ 1007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:42.306513 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:42.306580 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:42.307720 (+ 1140us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:42.307721 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:42.307722 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:07:42.307729 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:42.309611 (+ 1882us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:42.310139 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:42.310141 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:42.310141 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:42.310226 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:42.310492 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:42.310493 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:42.310493 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:42.310632 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:42.310717 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:42.310947 (+ 230us) server_negotiation.cc:299] Negotiation successful
0811 05:07:42.311041 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":755}
I20260811 05:07:42.311170 29568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:42.303236 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:44529 (local address 127.26.191.193:57953)
0811 05:07:42.303430 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:42.303441 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:42.303492 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:42.304242 (+ 750us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:42.304243 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:42.304508 (+ 265us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:07:42.304590 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:42.304593 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:42.305473 (+ 880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:42.305474 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:42.306207 (+ 733us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:42.306210 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:42.306612 (+ 402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:42.306613 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:42.306683 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:42.307261 (+ 578us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:07:42.307266 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:07:42.307584 (+ 318us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:07:42.309715 (+ 2131us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:07:42.309717 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:07:42.309717 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:07:42.310027 (+ 310us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:07:42.310325 (+ 298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:07:42.310326 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:07:42.310327 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:07:42.310409 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:07:42.310720 (+ 311us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:07:42.310721 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:07:42.310791 (+ 70us) client_negotiation.cc:769] Sending connection context
0811 05:07:42.310898 (+ 107us) client_negotiation.cc:240] Negotiation successful
0811 05:07:42.311044 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":121,"threads_started":1}
WARNING: no policy specified for kudu/127.26.191.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.191.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.191.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.194.keytab.
Entry for principal kudu/127.26.191.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.194.keytab.
I20260811 05:07:42.341570 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.191.194:0
--local_ip_for_outbound_sockets=127.26.191.194
--webserver_interface=127.26.191.194
--webserver_port=0
--tserver_master_addrs=127.26.191.254:44529
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.194.keytab
--principal=kudu/127.26.191.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:39187
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:07:42.428543 29571 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:07:42.428795 29571 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:07:42.428821 29571 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:07:42.429956 29571 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:07:42.429991 29571 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:07:42.430011 29571 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 05:07:42.430028 29571 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.191.194
I20260811 05:07:42.431475 29571 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:39187
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.194.keytab
--principal=kudu/127.26.191.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.191.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.191.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.26.191.254:44529
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29571
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.191.194
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:07:42.431691 29571 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:07:42.431883 29571 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:07:42.437290 29582 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:42.437302 29584 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:42.437255 29587 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:07:42.437454 29571 server_base.cc:1034] running on GCE node
I20260811 05:07:42.437824 29571 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:07:42.438112 29571 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:07:42.439276 29571 hybrid_clock.cc:648] HybridClock initialized: now 1786424862439254 us; error 33 us; skew 500 ppm
Aug 11 05:07:42 dist-test-slave-x5fp krb5kdc[29161](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424862, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:07:42.442147 29571 init.cc:377] Logged in from keytab as kudu/127.26.191.194@KRBTEST.COM (short username kudu)
I20260811 05:07:42.442587 29571 webserver.cc:460] Webserver started at http://127.26.191.194:43967/ using document root <none> and password file <none>
I20260811 05:07:42.442864 29571 fs_manager.cc:359] Metadata directory not provided
I20260811 05:07:42.442939 29571 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:07:42.443100 29571 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:07:42.444219 29571 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/minicluster-data/ts-1/data/instance:
uuid: "febd06bf13f54e28946ea55aa125ee29"
format_stamp: "Formatted at 2026-08-11 05:07:42 on dist-test-slave-x5fp"
server_key: "c95e4b90f617f84da7a46f69e4eab2b0"
server_key_iv: "bdf7ced7992c05c3dcebb1f194d80861"
server_key_version: "encryptionkey@0"
I20260811 05:07:42.444650 29571 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/minicluster-data/ts-1/wal/instance:
uuid: "febd06bf13f54e28946ea55aa125ee29"
format_stamp: "Formatted at 2026-08-11 05:07:42 on dist-test-slave-x5fp"
server_key: "c95e4b90f617f84da7a46f69e4eab2b0"
server_key_iv: "bdf7ced7992c05c3dcebb1f194d80861"
server_key_version: "encryptionkey@0"
I20260811 05:07:42.446108 29571 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 05:07:42.446975 29601 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:42.447187 29571 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 05:07:42.447310 29571 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/minicluster-data/ts-1/wal
uuid: "febd06bf13f54e28946ea55aa125ee29"
format_stamp: "Formatted at 2026-08-11 05:07:42 on dist-test-slave-x5fp"
server_key: "c95e4b90f617f84da7a46f69e4eab2b0"
server_key_iv: "bdf7ced7992c05c3dcebb1f194d80861"
server_key_version: "encryptionkey@0"
I20260811 05:07:42.447399 29571 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:07:42.461968 29571 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:07:42.465008 29571 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:07:42.465207 29571 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:07:42.466012 29571 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:07:42.466092 29571 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:42.466138 29571 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:07:42.466167 29571 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 05:07:42 dist-test-slave-x5fp krb5kdc[29161](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424862, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.194@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
I20260811 05:07:42.474714 29571 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.194:40653
I20260811 05:07:42.474828 29787 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.194:40653 every 8 connection(s)
I20260811 05:07:42.475201 29571 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/minicluster-data/ts-1/data/info.pb
I20260811 05:07:42.478444 29304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:42.466433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.194:60547 (local address 127.26.191.254:44529)
0811 05:07:42.466504 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:42.466507 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:42.466903 (+ 396us) server_negotiation.cc:407] Connection header received
0811 05:07:42.467922 (+ 1019us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:42.467923 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:42.467937 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:42.468031 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:42.469098 (+ 1067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:42.469624 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:42.470957 (+ 1333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:42.471200 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:42.471305 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:42.474258 (+ 2953us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:42.474260 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:42.474261 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:07:42.474272 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:42.476027 (+ 1755us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:42.476552 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:42.476553 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:42.476554 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:42.476626 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:42.477211 (+ 585us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:42.477212 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:42.477212 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:42.477368 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:42.477556 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:42.478258 (+ 702us) server_negotiation.cc:299] Negotiation successful
0811 05:07:42.478346 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 05:07:42.478430 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 29571
I20260811 05:07:42.478552 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/minicluster-data/ts-1/wal/instance
I20260811 05:07:42.478657 29619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:42.466465 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:44529 (local address 127.26.191.194:60547)
0811 05:07:42.466701 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:42.466762 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:42.467668 (+ 906us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:42.468146 (+ 478us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:42.468152 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:42.468680 (+ 528us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:07:42.468993 (+ 313us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:42.468999 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:42.469729 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:42.469730 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:42.470595 (+ 865us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:42.470598 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:42.471335 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:42.471336 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:42.471484 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:42.472173 (+ 689us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:07:42.472185 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:07:42.474132 (+ 1947us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:07:42.476129 (+ 1997us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:07:42.476136 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:07:42.476138 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:07:42.476405 (+ 267us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:07:42.476952 (+ 547us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:07:42.476953 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:07:42.476953 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:07:42.477081 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:07:42.477536 (+ 455us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:07:42.477544 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:07:42.477703 (+ 159us) client_negotiation.cc:769] Sending connection context
0811 05:07:42.478105 (+ 402us) client_negotiation.cc:240] Negotiation successful
0811 05:07:42.478366 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":91,"threads_started":1}
I20260811 05:07:42.478812 27391 external_mini_cluster.cc:1428] Setting key e37461badc3dd2678d8e4543cec0989a
I20260811 05:07:42.479401 29788 heartbeater.cc:347] Connected to a master server at 127.26.191.254:44529
I20260811 05:07:42.479524 29788 heartbeater.cc:464] Registering TS with master...
I20260811 05:07:42.479724 29788 heartbeater.cc:511] Master 127.26.191.254:44529 requested a full tablet report, sending...
I20260811 05:07:42.480120 29238 ts_manager.cc:194] Registered new tserver with Master: febd06bf13f54e28946ea55aa125ee29 (127.26.191.194:40653)
I20260811 05:07:42.480623 29238 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.191.194@KRBTEST.COM'} at 127.26.191.194:60547
I20260811 05:07:42.489902 29304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:42.480751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.194:41267 (local address 127.26.191.254:44529)
0811 05:07:42.481025 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:42.481027 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:42.482237 (+ 1210us) server_negotiation.cc:407] Connection header received
0811 05:07:42.482269 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:42.482270 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:42.482284 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:42.482365 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:42.482696 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:42.483639 (+ 943us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:42.484929 (+ 1290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:42.485132 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:42.485191 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:42.486557 (+ 1366us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:42.486558 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:42.486559 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:07:42.486567 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:42.488228 (+ 1661us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:42.488925 (+ 697us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:42.488926 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:42.488926 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:42.488988 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:42.489263 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:42.489264 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:42.489264 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:42.489446 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:42.489513 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:42.489715 (+ 202us) server_negotiation.cc:299] Negotiation successful
0811 05:07:42.489816 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":250}
I20260811 05:07:42.489974 29795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:42.480685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:44529 (local address 127.26.191.194:41267)
0811 05:07:42.482143 (+ 1458us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:42.482154 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:42.482215 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:42.482370 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:42.482370 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:42.482569 (+ 199us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:07:42.482623 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:42.482625 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:42.483752 (+ 1127us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:42.483754 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:42.484629 (+ 875us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:42.484633 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:42.485226 (+ 593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:42.485227 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:42.485342 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:42.485949 (+ 607us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:07:42.485955 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:07:42.486437 (+ 482us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:07:42.488365 (+ 1928us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:07:42.488366 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:07:42.488366 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:07:42.488635 (+ 269us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:07:42.489068 (+ 433us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:07:42.489069 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:07:42.489069 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:07:42.489146 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:07:42.489530 (+ 384us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:07:42.489532 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:07:42.489593 (+ 61us) client_negotiation.cc:769] Sending connection context
0811 05:07:42.489681 (+ 88us) client_negotiation.cc:240] Negotiation successful
0811 05:07:42.489821 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1432,"thread_start_us":115,"threads_started":1}
WARNING: no policy specified for kudu/127.26.191.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.191.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.191.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.195.keytab.
Entry for principal kudu/127.26.191.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.195.keytab.
I20260811 05:07:42.517050 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.191.195:0
--local_ip_for_outbound_sockets=127.26.191.195
--webserver_interface=127.26.191.195
--webserver_port=0
--tserver_master_addrs=127.26.191.254:44529
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.195.keytab
--principal=kudu/127.26.191.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:39187
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:07:42.606801 29803 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:07:42.607079 29803 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:07:42.607125 29803 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:07:42.608460 29803 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:07:42.608539 29803 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:07:42.608575 29803 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 05:07:42.608618 29803 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.191.195
I20260811 05:07:42.610293 29803 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:39187
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.195.keytab
--principal=kudu/127.26.191.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.191.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.191.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.26.191.254:44529
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29803
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.191.195
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:07:42.610605 29803 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:07:42.610869 29803 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 05:07:42.616519 29803 server_base.cc:1034] running on GCE node
W20260811 05:07:42.616472 29809 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:42.616457 29810 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:42.616457 29812 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:07:42.617063 29803 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:07:42.617353 29803 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:07:42.618526 29803 hybrid_clock.cc:648] HybridClock initialized: now 1786424862618511 us; error 27 us; skew 500 ppm
Aug 11 05:07:42 dist-test-slave-x5fp krb5kdc[29161](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424862, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:07:42.621498 29803 init.cc:377] Logged in from keytab as kudu/127.26.191.195@KRBTEST.COM (short username kudu)
I20260811 05:07:42.621999 29803 webserver.cc:460] Webserver started at http://127.26.191.195:40883/ using document root <none> and password file <none>
I20260811 05:07:42.622279 29803 fs_manager.cc:359] Metadata directory not provided
I20260811 05:07:42.622363 29803 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:07:42.622516 29803 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:07:42.623639 29803 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/minicluster-data/ts-2/data/instance:
uuid: "01604ce87f6d43e882a846aff8569b08"
format_stamp: "Formatted at 2026-08-11 05:07:42 on dist-test-slave-x5fp"
server_key: "b76f9ab83fe072b769d320eb1322e030"
server_key_iv: "07bb18adaf3b4555c6f0c12ef12da10a"
server_key_version: "encryptionkey@0"
I20260811 05:07:42.624022 29803 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/minicluster-data/ts-2/wal/instance:
uuid: "01604ce87f6d43e882a846aff8569b08"
format_stamp: "Formatted at 2026-08-11 05:07:42 on dist-test-slave-x5fp"
server_key: "b76f9ab83fe072b769d320eb1322e030"
server_key_iv: "07bb18adaf3b4555c6f0c12ef12da10a"
server_key_version: "encryptionkey@0"
I20260811 05:07:42.625499 29803 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 05:07:42.626278 29821 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:42.626492 29803 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:07:42.626587 29803 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/minicluster-data/ts-2/wal
uuid: "01604ce87f6d43e882a846aff8569b08"
format_stamp: "Formatted at 2026-08-11 05:07:42 on dist-test-slave-x5fp"
server_key: "b76f9ab83fe072b769d320eb1322e030"
server_key_iv: "07bb18adaf3b4555c6f0c12ef12da10a"
server_key_version: "encryptionkey@0"
I20260811 05:07:42.626643 29803 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:07:42.650346 29803 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:07:42.652843 29803 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:07:42.653007 29803 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:07:42.653636 29803 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:07:42.653676 29803 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:42.653720 29803 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:07:42.653748 29803 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 05:07:42 dist-test-slave-x5fp krb5kdc[29161](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424862, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.195@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
I20260811 05:07:42.662314 29803 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.195:35287
I20260811 05:07:42.662468 29993 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.195:35287 every 8 connection(s)
I20260811 05:07:42.663029 29803 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/minicluster-data/ts-2/data/info.pb
I20260811 05:07:42.663985 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 29803
I20260811 05:07:42.664088 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/minicluster-data/ts-2/wal/instance
I20260811 05:07:42.664709 27391 external_mini_cluster.cc:1428] Setting key 9d45b09215ca589d43f90ac13908ca1a
I20260811 05:07:42.667084 29304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:42.654319 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.195:57553 (local address 127.26.191.254:44529)
0811 05:07:42.654396 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:42.654399 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:42.654696 (+ 297us) server_negotiation.cc:407] Connection header received
0811 05:07:42.655482 (+ 786us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:42.655484 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:42.655497 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:42.655573 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:42.656566 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:42.657361 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:42.659114 (+ 1753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:42.659346 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:42.659429 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:42.662898 (+ 3469us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:42.662900 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:42.662901 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:07:42.662909 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:42.665204 (+ 2295us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:42.665722 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:42.665722 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:42.665723 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:42.665801 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:42.666307 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:42.666308 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:42.666309 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:42.666448 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:42.666524 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:42.666939 (+ 415us) server_negotiation.cc:299] Negotiation successful
0811 05:07:42.667017 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 05:07:42.667256 29835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:42.654293 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:44529 (local address 127.26.191.195:57553)
0811 05:07:42.654498 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:42.654553 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:42.655350 (+ 797us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:42.655660 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:42.655664 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:42.656127 (+ 463us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:07:42.656453 (+ 326us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:42.656460 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:42.657483 (+ 1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:42.657485 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:42.659004 (+ 1519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:42.659009 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:42.659548 (+ 539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:42.659549 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:42.659745 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:42.660407 (+ 662us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:07:42.660419 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:07:42.662750 (+ 2331us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:07:42.665322 (+ 2572us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:07:42.665328 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:07:42.665349 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:07:42.665631 (+ 282us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:07:42.665949 (+ 318us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:07:42.665950 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:07:42.665951 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:07:42.666175 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:07:42.666579 (+ 404us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:07:42.666586 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:07:42.666734 (+ 148us) client_negotiation.cc:769] Sending connection context
0811 05:07:42.666846 (+ 112us) client_negotiation.cc:240] Negotiation successful
0811 05:07:42.667006 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":109,"threads_started":1}
I20260811 05:07:42.667934 29994 heartbeater.cc:347] Connected to a master server at 127.26.191.254:44529
I20260811 05:07:42.668020 29994 heartbeater.cc:464] Registering TS with master...
I20260811 05:07:42.668246 29994 heartbeater.cc:511] Master 127.26.191.254:44529 requested a full tablet report, sending...
I20260811 05:07:42.668876 29237 ts_manager.cc:194] Registered new tserver with Master: 01604ce87f6d43e882a846aff8569b08 (127.26.191.195:35287)
I20260811 05:07:42.669312 29237 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.191.195@KRBTEST.COM'} at 127.26.191.195:57553
I20260811 05:07:42.675248 29304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:42.669199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.195:43815 (local address 127.26.191.254:44529)
0811 05:07:42.669246 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:42.669248 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:42.669319 (+ 71us) server_negotiation.cc:407] Connection header received
0811 05:07:42.669405 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:42.669406 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:42.669417 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:42.669509 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:42.669863 (+ 354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:42.670349 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:42.671049 (+ 700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:42.671266 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:42.671337 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:42.672351 (+ 1014us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:42.672352 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:42.672352 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:07:42.672360 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:42.673994 (+ 1634us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:42.674402 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:42.674403 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:42.674404 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:42.674467 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:42.674688 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:42.674689 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:42.674689 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:42.674810 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:42.674881 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:42.675062 (+ 181us) server_negotiation.cc:299] Negotiation successful
0811 05:07:42.675139 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 05:07:42.675248 30002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:42.669126 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:44529 (local address 127.26.191.195:43815)
0811 05:07:42.669263 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:42.669274 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:42.669334 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:42.669516 (+ 182us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:42.669517 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:42.669715 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:07:42.669773 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:42.669775 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:42.670443 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:42.670444 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:42.670964 (+ 520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:42.670965 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:42.671351 (+ 386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:42.671352 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:42.671429 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:42.671948 (+ 519us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:07:42.671957 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:07:42.672255 (+ 298us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:07:42.674110 (+ 1855us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:07:42.674111 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:07:42.674112 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:07:42.674308 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:07:42.674540 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:07:42.674540 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:07:42.674541 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:07:42.674611 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:07:42.674893 (+ 282us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:07:42.674894 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:07:42.674944 (+ 50us) client_negotiation.cc:769] Sending connection context
0811 05:07:42.675018 (+ 74us) client_negotiation.cc:240] Negotiation successful
0811 05:07:42.675142 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":96,"thread_start_us":70,"threads_started":1}
I20260811 05:07:42.677220 27391 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 05:07:42 dist-test-slave-x5fp krb5kdc[29161](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424862, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 05:07:42 dist-test-slave-x5fp krb5kdc[29161](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424862, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
I20260811 05:07:42.704576 29304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:42.696684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58348 (local address 127.26.191.254:44529)
0811 05:07:42.696789 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:42.696792 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:42.696807 (+ 15us) server_negotiation.cc:407] Connection header received
0811 05:07:42.696834 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:42.696835 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:42.696844 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:42.696906 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:42.697513 (+ 607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:42.698035 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:42.698970 (+ 935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:42.699218 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:42.699360 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:42.702056 (+ 2696us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:42.702057 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:42.702058 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:07:42.702066 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:42.703568 (+ 1502us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:42.703929 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:42.703930 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:42.703930 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:42.703983 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:42.704156 (+ 173us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:42.704156 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:42.704157 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:42.704266 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:42.704340 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:42.704444 (+ 104us) server_negotiation.cc:299] Negotiation successful
0811 05:07:42.704504 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260811 05:07:42.706550 29237 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58348:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 05:07:42.708199 29237 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 05:07:42.715565 30020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:42.710947 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.195:35287 (local address 127.0.0.1:36176)
0811 05:07:42.711514 (+ 567us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:42.711526 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:42.711584 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:42.711859 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:42.711860 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:42.711862 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:07:42.711917 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:42.711918 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:42.712978 (+ 1060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:42.712979 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:42.714361 (+ 1382us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:42.714364 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:42.715174 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:42.715175 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:42.715266 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:42.715284 (+ 18us) client_negotiation.cc:769] Sending connection context
0811 05:07:42.715386 (+ 102us) client_negotiation.cc:240] Negotiation successful
0811 05:07:42.715444 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":543,"mutex_wait_us":10,"thread_start_us":115,"threads_started":1}
I20260811 05:07:42.715714 30021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:42.710923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.193:46269 (local address 127.0.0.1:32992)
0811 05:07:42.711175 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:42.711184 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:42.711232 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:42.711727 (+ 495us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:42.711731 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:42.711733 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:07:42.711806 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:42.711807 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:42.713367 (+ 1560us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:42.713368 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:42.714435 (+ 1067us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:42.714436 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:42.715379 (+ 943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:42.715380 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:42.715443 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:42.715446 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 05:07:42.715514 (+ 68us) client_negotiation.cc:240] Negotiation successful
0811 05:07:42.715550 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":235,"thread_start_us":216,"threads_started":1}
I20260811 05:07:42.715834 30018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:42.710792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.194:40653 (local address 127.0.0.1:57174)
0811 05:07:42.710975 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:42.711017 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:42.711084 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:42.712187 (+ 1103us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:42.712188 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:42.712191 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:07:42.712228 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:42.712230 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:42.713625 (+ 1395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:42.713626 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:42.714496 (+ 870us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:42.714498 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:42.715462 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:42.715463 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:42.715534 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:42.715539 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 05:07:42.715589 (+ 50us) client_negotiation.cc:240] Negotiation successful
0811 05:07:42.715630 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":74,"threads_started":1}
I20260811 05:07:42.715903 30019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:42.710921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57174 (local address 127.26.191.194:40653)
0811 05:07:42.712015 (+ 1094us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:42.712020 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:42.712031 (+ 11us) server_negotiation.cc:407] Connection header received
0811 05:07:42.712072 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:42.712074 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:42.712090 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:42.712178 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:07:42.712319 (+ 141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:42.713528 (+ 1209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:42.714589 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:42.715287 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:42.715365 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:42.715425 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:42.715764 (+ 339us) server_negotiation.cc:299] Negotiation successful
0811 05:07:42.715815 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1050,"thread_start_us":98,"threads_started":1}
I20260811 05:07:42.716048 30022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:42.711255 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36176 (local address 127.26.191.195:35287)
0811 05:07:42.711556 (+ 301us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:42.711561 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:42.711572 (+ 11us) server_negotiation.cc:407] Connection header received
0811 05:07:42.711698 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:42.711701 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:42.711762 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:42.711852 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:07:42.711978 (+ 126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:42.712898 (+ 920us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:42.714466 (+ 1568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:42.715072 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:42.715176 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:42.715251 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:42.715884 (+ 633us) server_negotiation.cc:299] Negotiation successful
0811 05:07:42.715942 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":264,"thread_start_us":116,"threads_started":1}
I20260811 05:07:42.716521 30023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:42.711296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32992 (local address 127.26.191.193:46269)
0811 05:07:42.711497 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:42.711504 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:42.711518 (+ 14us) server_negotiation.cc:407] Connection header received
0811 05:07:42.711568 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:42.711570 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:42.711588 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:42.711712 (+ 124us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:07:42.711911 (+ 199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:42.713271 (+ 1360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:42.714523 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:42.715288 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:42.715365 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:42.715422 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:42.715531 (+ 109us) server_negotiation.cc:299] Negotiation successful
0811 05:07:42.715584 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":113,"threads_started":1}
I20260811 05:07:42.716897 29899 tablet_service.cc:1467] Processing CreateTablet for tablet 52f89a70bc05469799a86cae553965da (DEFAULT_TABLE table=test-table [id=023c8d12decd424c9f2eb70d2497b4aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:07:42.716897 29684 tablet_service.cc:1467] Processing CreateTablet for tablet 52f89a70bc05469799a86cae553965da (DEFAULT_TABLE table=test-table [id=023c8d12decd424c9f2eb70d2497b4aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:07:42.717331 29684 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52f89a70bc05469799a86cae553965da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:07:42.717331 29899 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52f89a70bc05469799a86cae553965da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:07:42.717371 29460 tablet_service.cc:1467] Processing CreateTablet for tablet 52f89a70bc05469799a86cae553965da (DEFAULT_TABLE table=test-table [id=023c8d12decd424c9f2eb70d2497b4aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:07:42.717772 29460 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52f89a70bc05469799a86cae553965da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:07:42.720885 30025 tablet_bootstrap.cc:492] T 52f89a70bc05469799a86cae553965da P 00456d58a3de4c319ed39dd6e42fbd6e: Bootstrap starting.
I20260811 05:07:42.721316 30026 tablet_bootstrap.cc:492] T 52f89a70bc05469799a86cae553965da P 01604ce87f6d43e882a846aff8569b08: Bootstrap starting.
I20260811 05:07:42.721561 30031 tablet_bootstrap.cc:492] T 52f89a70bc05469799a86cae553965da P febd06bf13f54e28946ea55aa125ee29: Bootstrap starting.
I20260811 05:07:42.721791 30025 tablet_bootstrap.cc:654] T 52f89a70bc05469799a86cae553965da P 00456d58a3de4c319ed39dd6e42fbd6e: Neither blocks nor log segments found. Creating new log.
I20260811 05:07:42.722167 30025 log.cc:824] T 52f89a70bc05469799a86cae553965da P 00456d58a3de4c319ed39dd6e42fbd6e: Log is configured to *not* fsync() on all Append() calls
I20260811 05:07:42.722245 30031 tablet_bootstrap.cc:654] T 52f89a70bc05469799a86cae553965da P febd06bf13f54e28946ea55aa125ee29: Neither blocks nor log segments found. Creating new log.
I20260811 05:07:42.722378 30026 tablet_bootstrap.cc:654] T 52f89a70bc05469799a86cae553965da P 01604ce87f6d43e882a846aff8569b08: Neither blocks nor log segments found. Creating new log.
I20260811 05:07:42.722579 30031 log.cc:824] T 52f89a70bc05469799a86cae553965da P febd06bf13f54e28946ea55aa125ee29: Log is configured to *not* fsync() on all Append() calls
I20260811 05:07:42.722808 30026 log.cc:824] T 52f89a70bc05469799a86cae553965da P 01604ce87f6d43e882a846aff8569b08: Log is configured to *not* fsync() on all Append() calls
I20260811 05:07:42.723351 30031 tablet_bootstrap.cc:492] T 52f89a70bc05469799a86cae553965da P febd06bf13f54e28946ea55aa125ee29: No bootstrap required, opened a new log
I20260811 05:07:42.723351 30025 tablet_bootstrap.cc:492] T 52f89a70bc05469799a86cae553965da P 00456d58a3de4c319ed39dd6e42fbd6e: No bootstrap required, opened a new log
I20260811 05:07:42.723434 30025 ts_tablet_manager.cc:1397] T 52f89a70bc05469799a86cae553965da P 00456d58a3de4c319ed39dd6e42fbd6e: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260811 05:07:42.723434 30031 ts_tablet_manager.cc:1397] T 52f89a70bc05469799a86cae553965da P febd06bf13f54e28946ea55aa125ee29: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 05:07:42.725380 30026 tablet_bootstrap.cc:492] T 52f89a70bc05469799a86cae553965da P 01604ce87f6d43e882a846aff8569b08: No bootstrap required, opened a new log
I20260811 05:07:42.725483 30026 ts_tablet_manager.cc:1397] T 52f89a70bc05469799a86cae553965da P 01604ce87f6d43e882a846aff8569b08: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260811 05:07:42.725500 30031 raft_consensus.cc:348] T 52f89a70bc05469799a86cae553965da P febd06bf13f54e28946ea55aa125ee29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "febd06bf13f54e28946ea55aa125ee29" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40653 } } peers { permanent_uuid: "01604ce87f6d43e882a846aff8569b08" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 35287 } } peers { permanent_uuid: "00456d58a3de4c319ed39dd6e42fbd6e" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 46269 } }
I20260811 05:07:42.725500 30025 raft_consensus.cc:348] T 52f89a70bc05469799a86cae553965da P 00456d58a3de4c319ed39dd6e42fbd6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "febd06bf13f54e28946ea55aa125ee29" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40653 } } peers { permanent_uuid: "01604ce87f6d43e882a846aff8569b08" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 35287 } } peers { permanent_uuid: "00456d58a3de4c319ed39dd6e42fbd6e" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 46269 } }
I20260811 05:07:42.725685 30031 raft_consensus.cc:374] T 52f89a70bc05469799a86cae553965da P febd06bf13f54e28946ea55aa125ee29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:07:42.725685 30025 raft_consensus.cc:374] T 52f89a70bc05469799a86cae553965da P 00456d58a3de4c319ed39dd6e42fbd6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:07:42.725730 30025 raft_consensus.cc:729] T 52f89a70bc05469799a86cae553965da P 00456d58a3de4c319ed39dd6e42fbd6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00456d58a3de4c319ed39dd6e42fbd6e, State: Initialized, Role: FOLLOWER
I20260811 05:07:42.725730 30031 raft_consensus.cc:729] T 52f89a70bc05469799a86cae553965da P febd06bf13f54e28946ea55aa125ee29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: febd06bf13f54e28946ea55aa125ee29, State: Initialized, Role: FOLLOWER
I20260811 05:07:42.725876 30031 consensus_queue.cc:260] T 52f89a70bc05469799a86cae553965da P febd06bf13f54e28946ea55aa125ee29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "febd06bf13f54e28946ea55aa125ee29" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40653 } } peers { permanent_uuid: "01604ce87f6d43e882a846aff8569b08" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 35287 } } peers { permanent_uuid: "00456d58a3de4c319ed39dd6e42fbd6e" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 46269 } }
I20260811 05:07:42.725876 30025 consensus_queue.cc:260] T 52f89a70bc05469799a86cae553965da P 00456d58a3de4c319ed39dd6e42fbd6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "febd06bf13f54e28946ea55aa125ee29" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40653 } } peers { permanent_uuid: "01604ce87f6d43e882a846aff8569b08" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 35287 } } peers { permanent_uuid: "00456d58a3de4c319ed39dd6e42fbd6e" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 46269 } }
I20260811 05:07:42.726164 30031 ts_tablet_manager.cc:1428] T 52f89a70bc05469799a86cae553965da P febd06bf13f54e28946ea55aa125ee29: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 05:07:42.726164 30025 ts_tablet_manager.cc:1428] T 52f89a70bc05469799a86cae553965da P 00456d58a3de4c319ed39dd6e42fbd6e: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 05:07:42.726294 29561 heartbeater.cc:503] Master 127.26.191.254:44529 was elected leader, sending a full tablet report...
I20260811 05:07:42.726307 29788 heartbeater.cc:503] Master 127.26.191.254:44529 was elected leader, sending a full tablet report...
I20260811 05:07:42.728062 30026 raft_consensus.cc:348] T 52f89a70bc05469799a86cae553965da P 01604ce87f6d43e882a846aff8569b08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "febd06bf13f54e28946ea55aa125ee29" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40653 } } peers { permanent_uuid: "01604ce87f6d43e882a846aff8569b08" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 35287 } } peers { permanent_uuid: "00456d58a3de4c319ed39dd6e42fbd6e" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 46269 } }
I20260811 05:07:42.728229 30026 raft_consensus.cc:374] T 52f89a70bc05469799a86cae553965da P 01604ce87f6d43e882a846aff8569b08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:07:42.728281 30026 raft_consensus.cc:729] T 52f89a70bc05469799a86cae553965da P 01604ce87f6d43e882a846aff8569b08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01604ce87f6d43e882a846aff8569b08, State: Initialized, Role: FOLLOWER
I20260811 05:07:42.728410 30026 consensus_queue.cc:260] T 52f89a70bc05469799a86cae553965da P 01604ce87f6d43e882a846aff8569b08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "febd06bf13f54e28946ea55aa125ee29" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40653 } } peers { permanent_uuid: "01604ce87f6d43e882a846aff8569b08" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 35287 } } peers { permanent_uuid: "00456d58a3de4c319ed39dd6e42fbd6e" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 46269 } }
I20260811 05:07:42.728718 30026 ts_tablet_manager.cc:1428] T 52f89a70bc05469799a86cae553965da P 01604ce87f6d43e882a846aff8569b08: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 05:07:42.728771 29994 heartbeater.cc:503] Master 127.26.191.254:44529 was elected leader, sending a full tablet report...
I20260811 05:07:42.732153 30037 raft_consensus.cc:482] T 52f89a70bc05469799a86cae553965da P febd06bf13f54e28946ea55aa125ee29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 05:07:42.732239 30037 raft_consensus.cc:504] T 52f89a70bc05469799a86cae553965da P febd06bf13f54e28946ea55aa125ee29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "febd06bf13f54e28946ea55aa125ee29" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40653 } } peers { permanent_uuid: "01604ce87f6d43e882a846aff8569b08" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 35287 } } peers { permanent_uuid: "00456d58a3de4c319ed39dd6e42fbd6e" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 46269 } }
I20260811 05:07:42.732532 30037 leader_election.cc:288] T 52f89a70bc05469799a86cae553965da P febd06bf13f54e28946ea55aa125ee29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01604ce87f6d43e882a846aff8569b08 (127.26.191.195:35287), 00456d58a3de4c319ed39dd6e42fbd6e (127.26.191.193:46269)
I20260811 05:07:42.735743 30022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:42.732697 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.194:51563 (local address 127.26.191.195:35287)
0811 05:07:42.732977 (+ 280us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:42.732979 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:42.732984 (+ 5us) server_negotiation.cc:407] Connection header received
0811 05:07:42.733003 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:42.733004 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:42.733011 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:42.733049 (+ 38us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:07:42.733262 (+ 213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:42.733796 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:42.734843 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:42.735361 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:42.735417 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:42.735424 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:42.735660 (+ 236us) server_negotiation.cc:299] Negotiation successful
0811 05:07:42.735691 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":261}
I20260811 05:07:42.735832 29619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:42.732659 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.195:35287 (local address 127.26.191.194:51563)
0811 05:07:42.732847 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:42.732860 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:42.732907 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:42.733061 (+ 154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:42.733062 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:42.733065 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:07:42.733127 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:42.733128 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:42.733887 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:42.733888 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:42.734680 (+ 792us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:42.734683 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:42.735451 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:42.735453 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:42.735574 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:42.735579 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 05:07:42.735656 (+ 77us) client_negotiation.cc:240] Negotiation successful
0811 05:07:42.735697 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":166}
I20260811 05:07:42.736125 30044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:42.732674 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.193:46269 (local address 127.26.191.194:57935)
0811 05:07:42.733219 (+ 545us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:42.733230 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:42.733291 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:42.733413 (+ 122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:42.733414 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:42.733415 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:07:42.733488 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:42.733489 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:42.734208 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:42.734208 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:42.735087 (+ 879us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:42.735090 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:42.735808 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:42.735809 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:42.735900 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:42.735904 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 05:07:42.736005 (+ 101us) client_negotiation.cc:240] Negotiation successful
0811 05:07:42.736043 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":524,"thread_start_us":464,"threads_started":1}
I20260811 05:07:42.736244 30023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:42.732853 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.194:57935 (local address 127.26.191.193:46269)
0811 05:07:42.732952 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:42.732954 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:42.733292 (+ 338us) server_negotiation.cc:407] Connection header received
0811 05:07:42.733344 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:42.733345 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:42.733354 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:42.733409 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:07:42.733575 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:42.734124 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:42.735160 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:42.735716 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:42.735795 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:42.735804 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:42.736116 (+ 312us) server_negotiation.cc:299] Negotiation successful
0811 05:07:42.736167 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260811 05:07:42.736197 29930 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52f89a70bc05469799a86cae553965da" candidate_uuid: "febd06bf13f54e28946ea55aa125ee29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01604ce87f6d43e882a846aff8569b08" is_pre_election: true
I20260811 05:07:42.736356 29930 raft_consensus.cc:2454] T 52f89a70bc05469799a86cae553965da P 01604ce87f6d43e882a846aff8569b08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate febd06bf13f54e28946ea55aa125ee29 in term 0.
I20260811 05:07:42.736539 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52f89a70bc05469799a86cae553965da" candidate_uuid: "febd06bf13f54e28946ea55aa125ee29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00456d58a3de4c319ed39dd6e42fbd6e" is_pre_election: true
I20260811 05:07:42.736620 29613 leader_election.cc:302] T 52f89a70bc05469799a86cae553965da P febd06bf13f54e28946ea55aa125ee29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01604ce87f6d43e882a846aff8569b08, febd06bf13f54e28946ea55aa125ee29; no voters:
I20260811 05:07:42.736697 29483 raft_consensus.cc:2454] T 52f89a70bc05469799a86cae553965da P 00456d58a3de4c319ed39dd6e42fbd6e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate febd06bf13f54e28946ea55aa125ee29 in term 0.
I20260811 05:07:42.736766 30037 raft_consensus.cc:2781] T 52f89a70bc05469799a86cae553965da P febd06bf13f54e28946ea55aa125ee29 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 05:07:42.736822 30037 raft_consensus.cc:482] T 52f89a70bc05469799a86cae553965da P febd06bf13f54e28946ea55aa125ee29 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 05:07:42.736846 30037 raft_consensus.cc:3037] T 52f89a70bc05469799a86cae553965da P febd06bf13f54e28946ea55aa125ee29 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:07:42.737564 30037 raft_consensus.cc:504] T 52f89a70bc05469799a86cae553965da P febd06bf13f54e28946ea55aa125ee29 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "febd06bf13f54e28946ea55aa125ee29" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40653 } } peers { permanent_uuid: "01604ce87f6d43e882a846aff8569b08" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 35287 } } peers { permanent_uuid: "00456d58a3de4c319ed39dd6e42fbd6e" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 46269 } }
I20260811 05:07:42.737702 30037 leader_election.cc:288] T 52f89a70bc05469799a86cae553965da P febd06bf13f54e28946ea55aa125ee29 [CANDIDATE]: Term 1 election: Requested vote from peers 01604ce87f6d43e882a846aff8569b08 (127.26.191.195:35287), 00456d58a3de4c319ed39dd6e42fbd6e (127.26.191.193:46269)
I20260811 05:07:42.737896 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52f89a70bc05469799a86cae553965da" candidate_uuid: "febd06bf13f54e28946ea55aa125ee29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00456d58a3de4c319ed39dd6e42fbd6e"
I20260811 05:07:42.737931 29930 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52f89a70bc05469799a86cae553965da" candidate_uuid: "febd06bf13f54e28946ea55aa125ee29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01604ce87f6d43e882a846aff8569b08"
I20260811 05:07:42.737998 29930 raft_consensus.cc:3037] T 52f89a70bc05469799a86cae553965da P 01604ce87f6d43e882a846aff8569b08 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:07:42.738003 29483 raft_consensus.cc:3037] T 52f89a70bc05469799a86cae553965da P 00456d58a3de4c319ed39dd6e42fbd6e [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:07:42.738725 29930 raft_consensus.cc:2454] T 52f89a70bc05469799a86cae553965da P 01604ce87f6d43e882a846aff8569b08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate febd06bf13f54e28946ea55aa125ee29 in term 1.
I20260811 05:07:42.738824 29483 raft_consensus.cc:2454] T 52f89a70bc05469799a86cae553965da P 00456d58a3de4c319ed39dd6e42fbd6e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate febd06bf13f54e28946ea55aa125ee29 in term 1.
I20260811 05:07:42.738911 29613 leader_election.cc:302] T 52f89a70bc05469799a86cae553965da P febd06bf13f54e28946ea55aa125ee29 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01604ce87f6d43e882a846aff8569b08, febd06bf13f54e28946ea55aa125ee29; no voters:
I20260811 05:07:42.739001 30037 raft_consensus.cc:2781] T 52f89a70bc05469799a86cae553965da P febd06bf13f54e28946ea55aa125ee29 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:07:42.739151 30037 raft_consensus.cc:686] T 52f89a70bc05469799a86cae553965da P febd06bf13f54e28946ea55aa125ee29 [term 1 LEADER]: Becoming Leader. State: Replica: febd06bf13f54e28946ea55aa125ee29, State: Running, Role: LEADER
I20260811 05:07:42.739248 30037 consensus_queue.cc:237] T 52f89a70bc05469799a86cae553965da P febd06bf13f54e28946ea55aa125ee29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "febd06bf13f54e28946ea55aa125ee29" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40653 } } peers { permanent_uuid: "01604ce87f6d43e882a846aff8569b08" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 35287 } } peers { permanent_uuid: "00456d58a3de4c319ed39dd6e42fbd6e" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 46269 } }
I20260811 05:07:42.740077 29238 catalog_manager.cc:5495] T 52f89a70bc05469799a86cae553965da P febd06bf13f54e28946ea55aa125ee29 reported cstate change: term changed from 0 to 1, leader changed from <none> to febd06bf13f54e28946ea55aa125ee29 (127.26.191.194). New cstate: current_term: 1 leader_uuid: "febd06bf13f54e28946ea55aa125ee29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "febd06bf13f54e28946ea55aa125ee29" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01604ce87f6d43e882a846aff8569b08" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 35287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00456d58a3de4c319ed39dd6e42fbd6e" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 46269 } health_report { overall_health: UNKNOWN } } }
I20260811 05:07:42.754091 30019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:42.751121 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57184 (local address 127.26.191.194:40653)
0811 05:07:42.751188 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:42.751211 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:42.751221 (+ 10us) server_negotiation.cc:407] Connection header received
0811 05:07:42.751300 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:42.751302 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:42.751328 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:42.751404 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:07:42.751578 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:42.752054 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:42.752969 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:42.753166 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:42.753250 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:42.753473 (+ 223us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:07:42.753584 (+ 111us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:07:42.753675 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:42.753731 (+ 56us) server_negotiation.cc:299] Negotiation successful
0811 05:07:42.753755 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 05:07:42.756462 29483 raft_consensus.cc:1261] T 52f89a70bc05469799a86cae553965da P 00456d58a3de4c319ed39dd6e42fbd6e [term 1 FOLLOWER]: Refusing update from remote peer febd06bf13f54e28946ea55aa125ee29: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:07:42.756943 30045 consensus_queue.cc:1035] T 52f89a70bc05469799a86cae553965da P febd06bf13f54e28946ea55aa125ee29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00456d58a3de4c319ed39dd6e42fbd6e" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 46269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:07:42.758179 29930 raft_consensus.cc:1261] T 52f89a70bc05469799a86cae553965da P 01604ce87f6d43e882a846aff8569b08 [term 1 FOLLOWER]: Refusing update from remote peer febd06bf13f54e28946ea55aa125ee29: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:07:42.758476 30037 consensus_queue.cc:1035] T 52f89a70bc05469799a86cae553965da P febd06bf13f54e28946ea55aa125ee29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01604ce87f6d43e882a846aff8569b08" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 35287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:07:42.761584 30062 mvcc.cc:205] Tried to move back new op lower bound from 7317196237846454272 to 7317196237780733952. Current Snapshot: MvccSnapshot[applied={T|T < 7317196237846454272}]
I20260811 05:07:42.765021 29237 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58348:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:07:42.765137 29237 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58348:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:07:42.766182 29237 catalog_manager.cc:5782] T 00000000000000000000000000000000 P def2ffedbb54427aaf84618c15e016d9: Sending DeleteTablet for 3 replicas of tablet 52f89a70bc05469799a86cae553965da
I20260811 05:07:42.766724 29460 tablet_service.cc:1514] Processing DeleteTablet for tablet 52f89a70bc05469799a86cae553965da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:07:42 UTC) from {username='kudu', principal='kudu/127.26.191.254@KRBTEST.COM'} at 127.0.0.1:32992
I20260811 05:07:42.766723 29684 tablet_service.cc:1514] Processing DeleteTablet for tablet 52f89a70bc05469799a86cae553965da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:07:42 UTC) from {username='kudu', principal='kudu/127.26.191.254@KRBTEST.COM'} at 127.0.0.1:57174
I20260811 05:07:42.766942 30075 tablet_replica.cc:330] T 52f89a70bc05469799a86cae553965da P 00456d58a3de4c319ed39dd6e42fbd6e: stopping tablet replica
I20260811 05:07:42.767014 30075 raft_consensus.cc:2229] T 52f89a70bc05469799a86cae553965da P 00456d58a3de4c319ed39dd6e42fbd6e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 05:07:42.767084 30075 raft_consensus.cc:2258] T 52f89a70bc05469799a86cae553965da P 00456d58a3de4c319ed39dd6e42fbd6e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:07:42.767336 30076 tablet_replica.cc:330] T 52f89a70bc05469799a86cae553965da P febd06bf13f54e28946ea55aa125ee29: stopping tablet replica
I20260811 05:07:42.767313 29237 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58348:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 05:07:42.767424 29237 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 05:07:42.767439 30076 raft_consensus.cc:2229] T 52f89a70bc05469799a86cae553965da P febd06bf13f54e28946ea55aa125ee29 [term 1 LEADER]: Raft consensus shutting down.
I20260811 05:07:42.767541 30076 raft_consensus.cc:2258] T 52f89a70bc05469799a86cae553965da P febd06bf13f54e28946ea55aa125ee29 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:07:42.767786 29899 tablet_service.cc:1514] Processing DeleteTablet for tablet 52f89a70bc05469799a86cae553965da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:07:42 UTC) from {username='kudu', principal='kudu/127.26.191.254@KRBTEST.COM'} at 127.0.0.1:36176
I20260811 05:07:42.768172 30075 ts_tablet_manager.cc:1905] T 52f89a70bc05469799a86cae553965da P 00456d58a3de4c319ed39dd6e42fbd6e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:07:42.768829 29460 tablet_service.cc:1467] Processing CreateTablet for tablet 50ec20e80bb742f090a0bd6883f97c92 (DEFAULT_TABLE table=test-table [id=bea8c413ae7241099b6f22a8570c638c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:07:42.768826 29684 tablet_service.cc:1467] Processing CreateTablet for tablet 50ec20e80bb742f090a0bd6883f97c92 (DEFAULT_TABLE table=test-table [id=bea8c413ae7241099b6f22a8570c638c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:07:42.768951 29460 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 50ec20e80bb742f090a0bd6883f97c92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:07:42.768959 29684 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 50ec20e80bb742f090a0bd6883f97c92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:07:42.770370 30025 tablet_bootstrap.cc:492] T 50ec20e80bb742f090a0bd6883f97c92 P 00456d58a3de4c319ed39dd6e42fbd6e: Bootstrap starting.
I20260811 05:07:42.770371 30031 tablet_bootstrap.cc:492] T 50ec20e80bb742f090a0bd6883f97c92 P febd06bf13f54e28946ea55aa125ee29: Bootstrap starting.
I20260811 05:07:42.770874 30025 tablet_bootstrap.cc:654] T 50ec20e80bb742f090a0bd6883f97c92 P 00456d58a3de4c319ed39dd6e42fbd6e: Neither blocks nor log segments found. Creating new log.
I20260811 05:07:42.770874 30031 tablet_bootstrap.cc:654] T 50ec20e80bb742f090a0bd6883f97c92 P febd06bf13f54e28946ea55aa125ee29: Neither blocks nor log segments found. Creating new log.
I20260811 05:07:42.770974 30075 ts_tablet_manager.cc:1918] T 52f89a70bc05469799a86cae553965da P 00456d58a3de4c319ed39dd6e42fbd6e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 05:07:42.771041 30075 log.cc:1196] T 52f89a70bc05469799a86cae553965da P 00456d58a3de4c319ed39dd6e42fbd6e: Deleting WAL directory at /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/minicluster-data/ts-0/wal/wals/52f89a70bc05469799a86cae553965da
I20260811 05:07:42.770872 30076 ts_tablet_manager.cc:1905] T 52f89a70bc05469799a86cae553965da P febd06bf13f54e28946ea55aa125ee29: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:07:42.771349 30075 ts_tablet_manager.cc:1939] T 52f89a70bc05469799a86cae553965da P 00456d58a3de4c319ed39dd6e42fbd6e: Deleting consensus metadata
I20260811 05:07:42.771919 29205 catalog_manager.cc:4841] TS 00456d58a3de4c319ed39dd6e42fbd6e (127.26.191.193:46269): tablet 52f89a70bc05469799a86cae553965da (table test-table [id=023c8d12decd424c9f2eb70d2497b4aa]) successfully deleted
I20260811 05:07:42.772002 29899 tablet_service.cc:1467] Processing CreateTablet for tablet 50ec20e80bb742f090a0bd6883f97c92 (DEFAULT_TABLE table=test-table [id=bea8c413ae7241099b6f22a8570c638c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:07:42.772145 29899 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 50ec20e80bb742f090a0bd6883f97c92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:07:42.773118 30076 ts_tablet_manager.cc:1918] T 52f89a70bc05469799a86cae553965da P febd06bf13f54e28946ea55aa125ee29: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 05:07:42.773197 30076 log.cc:1196] T 52f89a70bc05469799a86cae553965da P febd06bf13f54e28946ea55aa125ee29: Deleting WAL directory at /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/minicluster-data/ts-1/wal/wals/52f89a70bc05469799a86cae553965da
I20260811 05:07:42.773310 30025 tablet_bootstrap.cc:492] T 50ec20e80bb742f090a0bd6883f97c92 P 00456d58a3de4c319ed39dd6e42fbd6e: No bootstrap required, opened a new log
I20260811 05:07:42.773358 30025 ts_tablet_manager.cc:1397] T 50ec20e80bb742f090a0bd6883f97c92 P 00456d58a3de4c319ed39dd6e42fbd6e: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260811 05:07:42.773476 30076 ts_tablet_manager.cc:1939] T 52f89a70bc05469799a86cae553965da P febd06bf13f54e28946ea55aa125ee29: Deleting consensus metadata
I20260811 05:07:42.773531 30025 raft_consensus.cc:348] T 50ec20e80bb742f090a0bd6883f97c92 P 00456d58a3de4c319ed39dd6e42fbd6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00456d58a3de4c319ed39dd6e42fbd6e" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 46269 } } peers { permanent_uuid: "febd06bf13f54e28946ea55aa125ee29" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40653 } } peers { permanent_uuid: "01604ce87f6d43e882a846aff8569b08" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 35287 } }
I20260811 05:07:42.773604 30025 raft_consensus.cc:374] T 50ec20e80bb742f090a0bd6883f97c92 P 00456d58a3de4c319ed39dd6e42fbd6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:07:42.773624 30025 raft_consensus.cc:729] T 50ec20e80bb742f090a0bd6883f97c92 P 00456d58a3de4c319ed39dd6e42fbd6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00456d58a3de4c319ed39dd6e42fbd6e, State: Initialized, Role: FOLLOWER
I20260811 05:07:42.773675 30025 consensus_queue.cc:260] T 50ec20e80bb742f090a0bd6883f97c92 P 00456d58a3de4c319ed39dd6e42fbd6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00456d58a3de4c319ed39dd6e42fbd6e" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 46269 } } peers { permanent_uuid: "febd06bf13f54e28946ea55aa125ee29" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40653 } } peers { permanent_uuid: "01604ce87f6d43e882a846aff8569b08" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 35287 } }
I20260811 05:07:42.773762 30025 ts_tablet_manager.cc:1428] T 50ec20e80bb742f090a0bd6883f97c92 P 00456d58a3de4c319ed39dd6e42fbd6e: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:42.773959 30026 tablet_bootstrap.cc:492] T 50ec20e80bb742f090a0bd6883f97c92 P 01604ce87f6d43e882a846aff8569b08: Bootstrap starting.
I20260811 05:07:42.774344 29206 catalog_manager.cc:4841] TS febd06bf13f54e28946ea55aa125ee29 (127.26.191.194:40653): tablet 52f89a70bc05469799a86cae553965da (table test-table [id=023c8d12decd424c9f2eb70d2497b4aa]) successfully deleted
I20260811 05:07:42.774434 30026 tablet_bootstrap.cc:654] T 50ec20e80bb742f090a0bd6883f97c92 P 01604ce87f6d43e882a846aff8569b08: Neither blocks nor log segments found. Creating new log.
I20260811 05:07:42.775115 30026 tablet_bootstrap.cc:492] T 50ec20e80bb742f090a0bd6883f97c92 P 01604ce87f6d43e882a846aff8569b08: No bootstrap required, opened a new log
I20260811 05:07:42.775184 30026 ts_tablet_manager.cc:1397] T 50ec20e80bb742f090a0bd6883f97c92 P 01604ce87f6d43e882a846aff8569b08: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260811 05:07:42.775352 30026 raft_consensus.cc:348] T 50ec20e80bb742f090a0bd6883f97c92 P 01604ce87f6d43e882a846aff8569b08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00456d58a3de4c319ed39dd6e42fbd6e" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 46269 } } peers { permanent_uuid: "febd06bf13f54e28946ea55aa125ee29" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40653 } } peers { permanent_uuid: "01604ce87f6d43e882a846aff8569b08" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 35287 } }
I20260811 05:07:42.775436 30026 raft_consensus.cc:374] T 50ec20e80bb742f090a0bd6883f97c92 P 01604ce87f6d43e882a846aff8569b08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:07:42.775461 30026 raft_consensus.cc:729] T 50ec20e80bb742f090a0bd6883f97c92 P 01604ce87f6d43e882a846aff8569b08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01604ce87f6d43e882a846aff8569b08, State: Initialized, Role: FOLLOWER
I20260811 05:07:42.775516 30026 consensus_queue.cc:260] T 50ec20e80bb742f090a0bd6883f97c92 P 01604ce87f6d43e882a846aff8569b08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00456d58a3de4c319ed39dd6e42fbd6e" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 46269 } } peers { permanent_uuid: "febd06bf13f54e28946ea55aa125ee29" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40653 } } peers { permanent_uuid: "01604ce87f6d43e882a846aff8569b08" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 35287 } }
I20260811 05:07:42.775604 30026 ts_tablet_manager.cc:1428] T 50ec20e80bb742f090a0bd6883f97c92 P 01604ce87f6d43e882a846aff8569b08: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260811 05:07:42.776835 30078 tablet_replica.cc:330] T 52f89a70bc05469799a86cae553965da P 01604ce87f6d43e882a846aff8569b08: stopping tablet replica
I20260811 05:07:42.776985 30078 raft_consensus.cc:2229] T 52f89a70bc05469799a86cae553965da P 01604ce87f6d43e882a846aff8569b08 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 05:07:42.777125 30078 raft_consensus.cc:2258] T 52f89a70bc05469799a86cae553965da P 01604ce87f6d43e882a846aff8569b08 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:07:42.777231 30031 tablet_bootstrap.cc:492] T 50ec20e80bb742f090a0bd6883f97c92 P febd06bf13f54e28946ea55aa125ee29: No bootstrap required, opened a new log
I20260811 05:07:42.777292 30031 ts_tablet_manager.cc:1397] T 50ec20e80bb742f090a0bd6883f97c92 P febd06bf13f54e28946ea55aa125ee29: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.000s
I20260811 05:07:42.777487 30031 raft_consensus.cc:348] T 50ec20e80bb742f090a0bd6883f97c92 P febd06bf13f54e28946ea55aa125ee29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00456d58a3de4c319ed39dd6e42fbd6e" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 46269 } } peers { permanent_uuid: "febd06bf13f54e28946ea55aa125ee29" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40653 } } peers { permanent_uuid: "01604ce87f6d43e882a846aff8569b08" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 35287 } }
I20260811 05:07:42.777598 30031 raft_consensus.cc:374] T 50ec20e80bb742f090a0bd6883f97c92 P febd06bf13f54e28946ea55aa125ee29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:07:42.777624 30031 raft_consensus.cc:729] T 50ec20e80bb742f090a0bd6883f97c92 P febd06bf13f54e28946ea55aa125ee29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: febd06bf13f54e28946ea55aa125ee29, State: Initialized, Role: FOLLOWER
I20260811 05:07:42.777693 30031 consensus_queue.cc:260] T 50ec20e80bb742f090a0bd6883f97c92 P febd06bf13f54e28946ea55aa125ee29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00456d58a3de4c319ed39dd6e42fbd6e" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 46269 } } peers { permanent_uuid: "febd06bf13f54e28946ea55aa125ee29" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40653 } } peers { permanent_uuid: "01604ce87f6d43e882a846aff8569b08" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 35287 } }
I20260811 05:07:42.777779 30078 ts_tablet_manager.cc:1905] T 52f89a70bc05469799a86cae553965da P 01604ce87f6d43e882a846aff8569b08: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:07:42.777844 30031 ts_tablet_manager.cc:1428] T 50ec20e80bb742f090a0bd6883f97c92 P febd06bf13f54e28946ea55aa125ee29: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260811 05:07:42.779896 30078 ts_tablet_manager.cc:1918] T 52f89a70bc05469799a86cae553965da P 01604ce87f6d43e882a846aff8569b08: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 05:07:42.779989 30078 log.cc:1196] T 52f89a70bc05469799a86cae553965da P 01604ce87f6d43e882a846aff8569b08: Deleting WAL directory at /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/minicluster-data/ts-2/wal/wals/52f89a70bc05469799a86cae553965da
I20260811 05:07:42.780318 30078 ts_tablet_manager.cc:1939] T 52f89a70bc05469799a86cae553965da P 01604ce87f6d43e882a846aff8569b08: Deleting consensus metadata
I20260811 05:07:42.780792 29209 catalog_manager.cc:4841] TS 01604ce87f6d43e882a846aff8569b08 (127.26.191.195:35287): tablet 52f89a70bc05469799a86cae553965da (table test-table [id=023c8d12decd424c9f2eb70d2497b4aa]) successfully deleted
W20260811 05:07:42.799463 29562 tablet.cc:2369] T 50ec20e80bb742f090a0bd6883f97c92 P 00456d58a3de4c319ed39dd6e42fbd6e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 05:07:42.885090 30041 raft_consensus.cc:482] T 50ec20e80bb742f090a0bd6883f97c92 P 01604ce87f6d43e882a846aff8569b08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 05:07:42.885234 30041 raft_consensus.cc:504] T 50ec20e80bb742f090a0bd6883f97c92 P 01604ce87f6d43e882a846aff8569b08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00456d58a3de4c319ed39dd6e42fbd6e" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 46269 } } peers { permanent_uuid: "febd06bf13f54e28946ea55aa125ee29" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40653 } } peers { permanent_uuid: "01604ce87f6d43e882a846aff8569b08" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 35287 } }
I20260811 05:07:42.885689 30041 leader_election.cc:288] T 50ec20e80bb742f090a0bd6883f97c92 P 01604ce87f6d43e882a846aff8569b08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 00456d58a3de4c319ed39dd6e42fbd6e (127.26.191.193:46269), febd06bf13f54e28946ea55aa125ee29 (127.26.191.194:40653)
I20260811 05:07:42.889582 30023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:42.885989 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.195:59147 (local address 127.26.191.193:46269)
0811 05:07:42.886084 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:42.886086 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:42.886151 (+ 65us) server_negotiation.cc:407] Connection header received
0811 05:07:42.886236 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:42.886237 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:42.886247 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:42.886344 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:07:42.886562 (+ 218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:42.887062 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:42.888557 (+ 1495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:42.889153 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:42.889231 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:42.889241 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:42.889454 (+ 213us) server_negotiation.cc:299] Negotiation successful
0811 05:07:42.889505 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260811 05:07:42.889601 29835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:42.885890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.194:40653 (local address 127.26.191.195:47535)
0811 05:07:42.886010 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:42.886022 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:42.886066 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:42.886423 (+ 357us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:42.886424 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:42.886425 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:07:42.886491 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:42.886492 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:42.887398 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:42.887399 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:42.888467 (+ 1068us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:42.888470 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:42.889300 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:42.889301 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:42.889387 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:42.889390 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 05:07:42.889439 (+ 49us) client_negotiation.cc:240] Negotiation successful
0811 05:07:42.889486 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":100}
I20260811 05:07:42.889652 30019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:42.886139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.195:47535 (local address 127.26.191.194:40653)
0811 05:07:42.886189 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:42.886191 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:42.886200 (+ 9us) server_negotiation.cc:407] Connection header received
0811 05:07:42.886313 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:42.886313 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:42.886345 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:42.886405 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:07:42.886570 (+ 165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:42.887305 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:42.888597 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:42.889168 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:42.889260 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:42.889270 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:42.889540 (+ 270us) server_negotiation.cc:299] Negotiation successful
0811 05:07:42.889580 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 05:07:42.889848 30085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:42.885896 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.193:46269 (local address 127.26.191.195:59147)
0811 05:07:42.886077 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:42.886089 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:42.886158 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:42.886369 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:42.886370 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:42.886373 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:07:42.886477 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:42.886480 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:42.887155 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:42.887156 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:42.888478 (+ 1322us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:42.888480 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:42.889255 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:42.889256 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:42.889354 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:42.889364 (+ 10us) client_negotiation.cc:769] Sending connection context
0811 05:07:42.889440 (+ 76us) client_negotiation.cc:240] Negotiation successful
0811 05:07:42.889487 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":165,"mutex_wait_us":51,"thread_start_us":64,"threads_started":1}
I20260811 05:07:42.889899 29720 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50ec20e80bb742f090a0bd6883f97c92" candidate_uuid: "01604ce87f6d43e882a846aff8569b08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "febd06bf13f54e28946ea55aa125ee29" is_pre_election: true
I20260811 05:07:42.890048 29720 raft_consensus.cc:2454] T 50ec20e80bb742f090a0bd6883f97c92 P febd06bf13f54e28946ea55aa125ee29 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01604ce87f6d43e882a846aff8569b08 in term 0.
I20260811 05:07:42.890075 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50ec20e80bb742f090a0bd6883f97c92" candidate_uuid: "01604ce87f6d43e882a846aff8569b08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00456d58a3de4c319ed39dd6e42fbd6e" is_pre_election: true
I20260811 05:07:42.890170 29483 raft_consensus.cc:2454] T 50ec20e80bb742f090a0bd6883f97c92 P 00456d58a3de4c319ed39dd6e42fbd6e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01604ce87f6d43e882a846aff8569b08 in term 0.
I20260811 05:07:42.890250 29824 leader_election.cc:302] T 50ec20e80bb742f090a0bd6883f97c92 P 01604ce87f6d43e882a846aff8569b08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01604ce87f6d43e882a846aff8569b08, febd06bf13f54e28946ea55aa125ee29; no voters:
I20260811 05:07:42.890388 30041 raft_consensus.cc:2781] T 50ec20e80bb742f090a0bd6883f97c92 P 01604ce87f6d43e882a846aff8569b08 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 05:07:42.890437 30041 raft_consensus.cc:482] T 50ec20e80bb742f090a0bd6883f97c92 P 01604ce87f6d43e882a846aff8569b08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 05:07:42.890458 30041 raft_consensus.cc:3037] T 50ec20e80bb742f090a0bd6883f97c92 P 01604ce87f6d43e882a846aff8569b08 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:07:42.891613 30041 raft_consensus.cc:504] T 50ec20e80bb742f090a0bd6883f97c92 P 01604ce87f6d43e882a846aff8569b08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00456d58a3de4c319ed39dd6e42fbd6e" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 46269 } } peers { permanent_uuid: "febd06bf13f54e28946ea55aa125ee29" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40653 } } peers { permanent_uuid: "01604ce87f6d43e882a846aff8569b08" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 35287 } }
I20260811 05:07:42.891776 30041 leader_election.cc:288] T 50ec20e80bb742f090a0bd6883f97c92 P 01604ce87f6d43e882a846aff8569b08 [CANDIDATE]: Term 1 election: Requested vote from peers 00456d58a3de4c319ed39dd6e42fbd6e (127.26.191.193:46269), febd06bf13f54e28946ea55aa125ee29 (127.26.191.194:40653)
I20260811 05:07:42.892024 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50ec20e80bb742f090a0bd6883f97c92" candidate_uuid: "01604ce87f6d43e882a846aff8569b08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00456d58a3de4c319ed39dd6e42fbd6e"
I20260811 05:07:42.892006 29720 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50ec20e80bb742f090a0bd6883f97c92" candidate_uuid: "01604ce87f6d43e882a846aff8569b08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "febd06bf13f54e28946ea55aa125ee29"
I20260811 05:07:42.892107 29483 raft_consensus.cc:3037] T 50ec20e80bb742f090a0bd6883f97c92 P 00456d58a3de4c319ed39dd6e42fbd6e [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:07:42.892130 29720 raft_consensus.cc:3037] T 50ec20e80bb742f090a0bd6883f97c92 P febd06bf13f54e28946ea55aa125ee29 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:07:42.892925 29483 raft_consensus.cc:2454] T 50ec20e80bb742f090a0bd6883f97c92 P 00456d58a3de4c319ed39dd6e42fbd6e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01604ce87f6d43e882a846aff8569b08 in term 1.
I20260811 05:07:42.893030 29720 raft_consensus.cc:2454] T 50ec20e80bb742f090a0bd6883f97c92 P febd06bf13f54e28946ea55aa125ee29 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01604ce87f6d43e882a846aff8569b08 in term 1.
I20260811 05:07:42.893131 29823 leader_election.cc:302] T 50ec20e80bb742f090a0bd6883f97c92 P 01604ce87f6d43e882a846aff8569b08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00456d58a3de4c319ed39dd6e42fbd6e, 01604ce87f6d43e882a846aff8569b08; no voters:
I20260811 05:07:42.893218 30041 raft_consensus.cc:2781] T 50ec20e80bb742f090a0bd6883f97c92 P 01604ce87f6d43e882a846aff8569b08 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:07:42.893333 30041 raft_consensus.cc:686] T 50ec20e80bb742f090a0bd6883f97c92 P 01604ce87f6d43e882a846aff8569b08 [term 1 LEADER]: Becoming Leader. State: Replica: 01604ce87f6d43e882a846aff8569b08, State: Running, Role: LEADER
I20260811 05:07:42.893396 30041 consensus_queue.cc:237] T 50ec20e80bb742f090a0bd6883f97c92 P 01604ce87f6d43e882a846aff8569b08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00456d58a3de4c319ed39dd6e42fbd6e" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 46269 } } peers { permanent_uuid: "febd06bf13f54e28946ea55aa125ee29" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40653 } } peers { permanent_uuid: "01604ce87f6d43e882a846aff8569b08" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 35287 } }
I20260811 05:07:42.894178 29237 catalog_manager.cc:5495] T 50ec20e80bb742f090a0bd6883f97c92 P 01604ce87f6d43e882a846aff8569b08 reported cstate change: term changed from 0 to 1, leader changed from <none> to 01604ce87f6d43e882a846aff8569b08 (127.26.191.195). New cstate: current_term: 1 leader_uuid: "01604ce87f6d43e882a846aff8569b08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00456d58a3de4c319ed39dd6e42fbd6e" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 46269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "febd06bf13f54e28946ea55aa125ee29" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01604ce87f6d43e882a846aff8569b08" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 35287 } health_report { overall_health: HEALTHY } } }
W20260811 05:07:42.914135 29997 tablet.cc:2369] T 50ec20e80bb742f090a0bd6883f97c92 P 01604ce87f6d43e882a846aff8569b08: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 11 05:07:42 dist-test-slave-x5fp krb5kdc[29161](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424862, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.254@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
I20260811 05:07:42.946348 30095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:42.937596 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:44529 (local address 127.0.0.1:58358)
0811 05:07:42.937799 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:42.937815 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:42.937879 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:42.938098 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:42.938099 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:42.938430 (+ 331us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:07:42.938508 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:42.938511 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:42.939286 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:42.939287 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:42.940005 (+ 718us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:42.940008 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:42.940543 (+ 535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:42.940544 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:42.940654 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:42.941445 (+ 791us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:07:42.941451 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:07:42.943222 (+ 1771us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:07:42.944977 (+ 1755us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:07:42.944986 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:07:42.944988 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:07:42.945226 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:07:42.945487 (+ 261us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:07:42.945489 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:07:42.945489 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:07:42.945560 (+ 71us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:07:42.945977 (+ 417us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:07:42.945986 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:07:42.946036 (+ 50us) client_negotiation.cc:769] Sending connection context
0811 05:07:42.946106 (+ 70us) client_negotiation.cc:240] Negotiation successful
0811 05:07:42.946214 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":117,"threads_started":1}
I20260811 05:07:42.946357 29304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:42.937746 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58358 (local address 127.26.191.254:44529)
0811 05:07:42.937840 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:42.937845 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:42.937860 (+ 15us) server_negotiation.cc:407] Connection header received
0811 05:07:42.937978 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:42.937979 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:42.937990 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:42.938057 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:42.938613 (+ 556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:42.939149 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:42.940131 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:42.940423 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:42.940499 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:42.943316 (+ 2817us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:42.943318 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:42.943318 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:07:42.943325 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:42.944897 (+ 1572us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:42.945320 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:42.945321 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:42.945321 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:42.945393 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:42.945661 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:42.945662 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:42.945662 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:42.945812 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:42.945886 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:42.946174 (+ 288us) server_negotiation.cc:299] Negotiation successful
0811 05:07:42.946273 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":21,"server-negotiator.queue_time_us":58}
I20260811 05:07:42.949065 29237 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.26.191.254@KRBTEST.COM'} at 127.0.0.1:58358:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260811 05:07:42.949285 29237 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 05:07:42.950793 29684 tablet_service.cc:1467] Processing CreateTablet for tablet 273c8962f44b47a0908cd86e0ae29379 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=7bcd1f1704b14bb98f2f7dd248fd806d]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 05:07:42.951122 29684 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 273c8962f44b47a0908cd86e0ae29379. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:07:42.952682 30031 tablet_bootstrap.cc:492] T 273c8962f44b47a0908cd86e0ae29379 P febd06bf13f54e28946ea55aa125ee29: Bootstrap starting.
I20260811 05:07:42.952864 29460 tablet_service.cc:1467] Processing CreateTablet for tablet 273c8962f44b47a0908cd86e0ae29379 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=7bcd1f1704b14bb98f2f7dd248fd806d]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 05:07:42.953039 29460 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 273c8962f44b47a0908cd86e0ae29379. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:07:42.953235 30031 tablet_bootstrap.cc:654] T 273c8962f44b47a0908cd86e0ae29379 P febd06bf13f54e28946ea55aa125ee29: Neither blocks nor log segments found. Creating new log.
I20260811 05:07:42.953941 30031 tablet_bootstrap.cc:492] T 273c8962f44b47a0908cd86e0ae29379 P febd06bf13f54e28946ea55aa125ee29: No bootstrap required, opened a new log
I20260811 05:07:42.953992 30031 ts_tablet_manager.cc:1397] T 273c8962f44b47a0908cd86e0ae29379 P febd06bf13f54e28946ea55aa125ee29: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 05:07:42.954139 30031 raft_consensus.cc:348] T 273c8962f44b47a0908cd86e0ae29379 P febd06bf13f54e28946ea55aa125ee29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00456d58a3de4c319ed39dd6e42fbd6e" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 46269 } } peers { permanent_uuid: "febd06bf13f54e28946ea55aa125ee29" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40653 } } peers { permanent_uuid: "01604ce87f6d43e882a846aff8569b08" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 35287 } }
I20260811 05:07:42.954226 30031 raft_consensus.cc:374] T 273c8962f44b47a0908cd86e0ae29379 P febd06bf13f54e28946ea55aa125ee29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:07:42.954249 30031 raft_consensus.cc:729] T 273c8962f44b47a0908cd86e0ae29379 P febd06bf13f54e28946ea55aa125ee29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: febd06bf13f54e28946ea55aa125ee29, State: Initialized, Role: FOLLOWER
I20260811 05:07:42.954309 30031 consensus_queue.cc:260] T 273c8962f44b47a0908cd86e0ae29379 P febd06bf13f54e28946ea55aa125ee29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00456d58a3de4c319ed39dd6e42fbd6e" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 46269 } } peers { permanent_uuid: "febd06bf13f54e28946ea55aa125ee29" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40653 } } peers { permanent_uuid: "01604ce87f6d43e882a846aff8569b08" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 35287 } }
I20260811 05:07:42.954421 30031 ts_tablet_manager.cc:1428] T 273c8962f44b47a0908cd86e0ae29379 P febd06bf13f54e28946ea55aa125ee29: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 05:07:42.954532 30037 tablet_replica.cc:439] T 273c8962f44b47a0908cd86e0ae29379 P febd06bf13f54e28946ea55aa125ee29: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00456d58a3de4c319ed39dd6e42fbd6e" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 46269 } } peers { permanent_uuid: "febd06bf13f54e28946ea55aa125ee29" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40653 } } peers { permanent_uuid: "01604ce87f6d43e882a846aff8569b08" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 35287 } } }
I20260811 05:07:42.954622 30037 tablet_replica.cc:442] T 273c8962f44b47a0908cd86e0ae29379 P febd06bf13f54e28946ea55aa125ee29: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 05:07:42.954741 29899 tablet_service.cc:1467] Processing CreateTablet for tablet 273c8962f44b47a0908cd86e0ae29379 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=7bcd1f1704b14bb98f2f7dd248fd806d]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 05:07:42.954927 29899 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 273c8962f44b47a0908cd86e0ae29379. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:07:42.956324 30026 tablet_bootstrap.cc:492] T 273c8962f44b47a0908cd86e0ae29379 P 01604ce87f6d43e882a846aff8569b08: Bootstrap starting.
I20260811 05:07:42.956462 30025 tablet_bootstrap.cc:492] T 273c8962f44b47a0908cd86e0ae29379 P 00456d58a3de4c319ed39dd6e42fbd6e: Bootstrap starting.
I20260811 05:07:42.956997 30025 tablet_bootstrap.cc:654] T 273c8962f44b47a0908cd86e0ae29379 P 00456d58a3de4c319ed39dd6e42fbd6e: Neither blocks nor log segments found. Creating new log.
I20260811 05:07:42.957036 30026 tablet_bootstrap.cc:654] T 273c8962f44b47a0908cd86e0ae29379 P 01604ce87f6d43e882a846aff8569b08: Neither blocks nor log segments found. Creating new log.
I20260811 05:07:42.957742 30025 tablet_bootstrap.cc:492] T 273c8962f44b47a0908cd86e0ae29379 P 00456d58a3de4c319ed39dd6e42fbd6e: No bootstrap required, opened a new log
I20260811 05:07:42.957811 30025 ts_tablet_manager.cc:1397] T 273c8962f44b47a0908cd86e0ae29379 P 00456d58a3de4c319ed39dd6e42fbd6e: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260811 05:07:42.958025 30025 raft_consensus.cc:348] T 273c8962f44b47a0908cd86e0ae29379 P 00456d58a3de4c319ed39dd6e42fbd6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00456d58a3de4c319ed39dd6e42fbd6e" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 46269 } } peers { permanent_uuid: "febd06bf13f54e28946ea55aa125ee29" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40653 } } peers { permanent_uuid: "01604ce87f6d43e882a846aff8569b08" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 35287 } }
I20260811 05:07:42.958106 30025 raft_consensus.cc:374] T 273c8962f44b47a0908cd86e0ae29379 P 00456d58a3de4c319ed39dd6e42fbd6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:07:42.958122 30025 raft_consensus.cc:729] T 273c8962f44b47a0908cd86e0ae29379 P 00456d58a3de4c319ed39dd6e42fbd6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00456d58a3de4c319ed39dd6e42fbd6e, State: Initialized, Role: FOLLOWER
I20260811 05:07:42.958179 30025 consensus_queue.cc:260] T 273c8962f44b47a0908cd86e0ae29379 P 00456d58a3de4c319ed39dd6e42fbd6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00456d58a3de4c319ed39dd6e42fbd6e" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 46269 } } peers { permanent_uuid: "febd06bf13f54e28946ea55aa125ee29" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40653 } } peers { permanent_uuid: "01604ce87f6d43e882a846aff8569b08" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 35287 } }
I20260811 05:07:42.958241 30026 tablet_bootstrap.cc:492] T 273c8962f44b47a0908cd86e0ae29379 P 01604ce87f6d43e882a846aff8569b08: No bootstrap required, opened a new log
I20260811 05:07:42.958279 30025 ts_tablet_manager.cc:1428] T 273c8962f44b47a0908cd86e0ae29379 P 00456d58a3de4c319ed39dd6e42fbd6e: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:42.958308 30026 ts_tablet_manager.cc:1397] T 273c8962f44b47a0908cd86e0ae29379 P 01604ce87f6d43e882a846aff8569b08: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260811 05:07:42.958376 30038 tablet_replica.cc:439] T 273c8962f44b47a0908cd86e0ae29379 P 00456d58a3de4c319ed39dd6e42fbd6e: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00456d58a3de4c319ed39dd6e42fbd6e" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 46269 } } peers { permanent_uuid: "febd06bf13f54e28946ea55aa125ee29" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40653 } } peers { permanent_uuid: "01604ce87f6d43e882a846aff8569b08" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 35287 } } }
I20260811 05:07:42.958468 30038 tablet_replica.cc:442] T 273c8962f44b47a0908cd86e0ae29379 P 00456d58a3de4c319ed39dd6e42fbd6e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 05:07:42.958534 30026 raft_consensus.cc:348] T 273c8962f44b47a0908cd86e0ae29379 P 01604ce87f6d43e882a846aff8569b08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00456d58a3de4c319ed39dd6e42fbd6e" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 46269 } } peers { permanent_uuid: "febd06bf13f54e28946ea55aa125ee29" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40653 } } peers { permanent_uuid: "01604ce87f6d43e882a846aff8569b08" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 35287 } }
I20260811 05:07:42.958637 30026 raft_consensus.cc:374] T 273c8962f44b47a0908cd86e0ae29379 P 01604ce87f6d43e882a846aff8569b08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:07:42.958673 30026 raft_consensus.cc:729] T 273c8962f44b47a0908cd86e0ae29379 P 01604ce87f6d43e882a846aff8569b08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01604ce87f6d43e882a846aff8569b08, State: Initialized, Role: FOLLOWER
I20260811 05:07:42.958727 30026 consensus_queue.cc:260] T 273c8962f44b47a0908cd86e0ae29379 P 01604ce87f6d43e882a846aff8569b08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00456d58a3de4c319ed39dd6e42fbd6e" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 46269 } } peers { permanent_uuid: "febd06bf13f54e28946ea55aa125ee29" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40653 } } peers { permanent_uuid: "01604ce87f6d43e882a846aff8569b08" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 35287 } }
I20260811 05:07:42.958841 30026 ts_tablet_manager.cc:1428] T 273c8962f44b47a0908cd86e0ae29379 P 01604ce87f6d43e882a846aff8569b08: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:42.958911 30041 tablet_replica.cc:439] T 273c8962f44b47a0908cd86e0ae29379 P 01604ce87f6d43e882a846aff8569b08: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00456d58a3de4c319ed39dd6e42fbd6e" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 46269 } } peers { permanent_uuid: "febd06bf13f54e28946ea55aa125ee29" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40653 } } peers { permanent_uuid: "01604ce87f6d43e882a846aff8569b08" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 35287 } } }
I20260811 05:07:42.959017 30041 tablet_replica.cc:442] T 273c8962f44b47a0908cd86e0ae29379 P 01604ce87f6d43e882a846aff8569b08: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 05:07:42.969856 30038 raft_consensus.cc:482] T 273c8962f44b47a0908cd86e0ae29379 P 00456d58a3de4c319ed39dd6e42fbd6e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 05:07:42.969967 30038 raft_consensus.cc:504] T 273c8962f44b47a0908cd86e0ae29379 P 00456d58a3de4c319ed39dd6e42fbd6e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00456d58a3de4c319ed39dd6e42fbd6e" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 46269 } } peers { permanent_uuid: "febd06bf13f54e28946ea55aa125ee29" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40653 } } peers { permanent_uuid: "01604ce87f6d43e882a846aff8569b08" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 35287 } }
I20260811 05:07:42.970409 30038 leader_election.cc:288] T 273c8962f44b47a0908cd86e0ae29379 P 00456d58a3de4c319ed39dd6e42fbd6e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers febd06bf13f54e28946ea55aa125ee29 (127.26.191.194:40653), 01604ce87f6d43e882a846aff8569b08 (127.26.191.195:35287)
I20260811 05:07:42.973740 30019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:42.970828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.193:43983 (local address 127.26.191.194:40653)
0811 05:07:42.970896 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:42.970899 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:42.970908 (+ 9us) server_negotiation.cc:407] Connection header received
0811 05:07:42.970978 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:42.970980 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:42.970988 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:42.971047 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:07:42.971230 (+ 183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:42.971742 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:42.972912 (+ 1170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:42.973306 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:42.973395 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:42.973406 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:42.973600 (+ 194us) server_negotiation.cc:299] Negotiation successful
0811 05:07:42.973658 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 05:07:42.973819 30022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:42.970708 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.193:41777 (local address 127.26.191.195:35287)
0811 05:07:42.970775 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:42.970777 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:42.970888 (+ 111us) server_negotiation.cc:407] Connection header received
0811 05:07:42.970999 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:42.971000 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:42.971011 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:42.971080 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:07:42.971311 (+ 231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:42.971788 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:42.972914 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:42.973396 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:42.973470 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:42.973479 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:42.973690 (+ 211us) server_negotiation.cc:299] Negotiation successful
0811 05:07:42.973744 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 05:07:42.973841 30099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:42.970620 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.195:35287 (local address 127.26.191.193:41777)
0811 05:07:42.970798 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:42.970811 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:42.970917 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:42.971099 (+ 182us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:42.971100 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:42.971102 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:07:42.971199 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:42.971200 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:42.971881 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:42.971882 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:42.972824 (+ 942us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:42.972827 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:42.973512 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:42.973513 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:42.973596 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:42.973599 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 05:07:42.973676 (+ 77us) client_negotiation.cc:240] Negotiation successful
0811 05:07:42.973720 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":164,"mutex_wait_us":28,"thread_start_us":80,"threads_started":1}
I20260811 05:07:42.974138 30100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:42.970619 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.194:40653 (local address 127.26.191.193:43983)
0811 05:07:42.970779 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:42.970793 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:42.970907 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:42.971051 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:42.971052 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:42.971054 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:07:42.971149 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:42.971151 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:42.971836 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:42.971837 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:42.972815 (+ 978us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:42.972817 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:42.973429 (+ 612us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:42.973430 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:42.973503 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:42.973508 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 05:07:42.973986 (+ 478us) client_negotiation.cc:240] Negotiation successful
0811 05:07:42.974020 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"mutex_wait_us":30,"thread_start_us":98,"threads_started":1}
I20260811 05:07:42.974126 29930 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "273c8962f44b47a0908cd86e0ae29379" candidate_uuid: "00456d58a3de4c319ed39dd6e42fbd6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01604ce87f6d43e882a846aff8569b08" is_pre_election: true
I20260811 05:07:42.974241 29930 raft_consensus.cc:2454] T 273c8962f44b47a0908cd86e0ae29379 P 01604ce87f6d43e882a846aff8569b08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00456d58a3de4c319ed39dd6e42fbd6e in term 0.
I20260811 05:07:42.974475 29386 leader_election.cc:302] T 273c8962f44b47a0908cd86e0ae29379 P 00456d58a3de4c319ed39dd6e42fbd6e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00456d58a3de4c319ed39dd6e42fbd6e, 01604ce87f6d43e882a846aff8569b08; no voters:
I20260811 05:07:42.974655 30038 raft_consensus.cc:2781] T 273c8962f44b47a0908cd86e0ae29379 P 00456d58a3de4c319ed39dd6e42fbd6e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 05:07:42.974579 29720 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "273c8962f44b47a0908cd86e0ae29379" candidate_uuid: "00456d58a3de4c319ed39dd6e42fbd6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "febd06bf13f54e28946ea55aa125ee29" is_pre_election: true
I20260811 05:07:42.974717 30038 raft_consensus.cc:482] T 273c8962f44b47a0908cd86e0ae29379 P 00456d58a3de4c319ed39dd6e42fbd6e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 05:07:42.974727 29720 raft_consensus.cc:2454] T 273c8962f44b47a0908cd86e0ae29379 P febd06bf13f54e28946ea55aa125ee29 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00456d58a3de4c319ed39dd6e42fbd6e in term 0.
I20260811 05:07:42.974745 30038 raft_consensus.cc:3037] T 273c8962f44b47a0908cd86e0ae29379 P 00456d58a3de4c319ed39dd6e42fbd6e [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:07:42.975549 30038 raft_consensus.cc:504] T 273c8962f44b47a0908cd86e0ae29379 P 00456d58a3de4c319ed39dd6e42fbd6e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00456d58a3de4c319ed39dd6e42fbd6e" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 46269 } } peers { permanent_uuid: "febd06bf13f54e28946ea55aa125ee29" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40653 } } peers { permanent_uuid: "01604ce87f6d43e882a846aff8569b08" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 35287 } }
I20260811 05:07:42.975720 30038 leader_election.cc:288] T 273c8962f44b47a0908cd86e0ae29379 P 00456d58a3de4c319ed39dd6e42fbd6e [CANDIDATE]: Term 1 election: Requested vote from peers febd06bf13f54e28946ea55aa125ee29 (127.26.191.194:40653), 01604ce87f6d43e882a846aff8569b08 (127.26.191.195:35287)
I20260811 05:07:42.975920 29720 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "273c8962f44b47a0908cd86e0ae29379" candidate_uuid: "00456d58a3de4c319ed39dd6e42fbd6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "febd06bf13f54e28946ea55aa125ee29"
I20260811 05:07:42.975952 29930 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "273c8962f44b47a0908cd86e0ae29379" candidate_uuid: "00456d58a3de4c319ed39dd6e42fbd6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01604ce87f6d43e882a846aff8569b08"
I20260811 05:07:42.976011 29720 raft_consensus.cc:3037] T 273c8962f44b47a0908cd86e0ae29379 P febd06bf13f54e28946ea55aa125ee29 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:07:42.976022 29930 raft_consensus.cc:3037] T 273c8962f44b47a0908cd86e0ae29379 P 01604ce87f6d43e882a846aff8569b08 [term 0 FOLLOWER]: Advancing to term 1
W20260811 05:07:42.976034 29789 tablet.cc:2369] T 273c8962f44b47a0908cd86e0ae29379 P febd06bf13f54e28946ea55aa125ee29: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 05:07:42.976845 29930 raft_consensus.cc:2454] T 273c8962f44b47a0908cd86e0ae29379 P 01604ce87f6d43e882a846aff8569b08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00456d58a3de4c319ed39dd6e42fbd6e in term 1.
I20260811 05:07:42.976851 29720 raft_consensus.cc:2454] T 273c8962f44b47a0908cd86e0ae29379 P febd06bf13f54e28946ea55aa125ee29 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00456d58a3de4c319ed39dd6e42fbd6e in term 1.
I20260811 05:07:42.977097 29381 leader_election.cc:302] T 273c8962f44b47a0908cd86e0ae29379 P 00456d58a3de4c319ed39dd6e42fbd6e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00456d58a3de4c319ed39dd6e42fbd6e, febd06bf13f54e28946ea55aa125ee29; no voters:
I20260811 05:07:42.977192 30038 raft_consensus.cc:2781] T 273c8962f44b47a0908cd86e0ae29379 P 00456d58a3de4c319ed39dd6e42fbd6e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:07:42.977334 30038 raft_consensus.cc:686] T 273c8962f44b47a0908cd86e0ae29379 P 00456d58a3de4c319ed39dd6e42fbd6e [term 1 LEADER]: Becoming Leader. State: Replica: 00456d58a3de4c319ed39dd6e42fbd6e, State: Running, Role: LEADER
I20260811 05:07:42.977427 30038 consensus_queue.cc:237] T 273c8962f44b47a0908cd86e0ae29379 P 00456d58a3de4c319ed39dd6e42fbd6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00456d58a3de4c319ed39dd6e42fbd6e" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 46269 } } peers { permanent_uuid: "febd06bf13f54e28946ea55aa125ee29" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40653 } } peers { permanent_uuid: "01604ce87f6d43e882a846aff8569b08" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 35287 } }
I20260811 05:07:42.977869 30103 tablet_replica.cc:439] T 273c8962f44b47a0908cd86e0ae29379 P 00456d58a3de4c319ed39dd6e42fbd6e: TxnStatusTablet state changed. Reason: New leader 00456d58a3de4c319ed39dd6e42fbd6e. Latest consensus state: current_term: 1 leader_uuid: "00456d58a3de4c319ed39dd6e42fbd6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00456d58a3de4c319ed39dd6e42fbd6e" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 46269 } } peers { permanent_uuid: "febd06bf13f54e28946ea55aa125ee29" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40653 } } peers { permanent_uuid: "01604ce87f6d43e882a846aff8569b08" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 35287 } } }
I20260811 05:07:42.977977 30103 tablet_replica.cc:442] T 273c8962f44b47a0908cd86e0ae29379 P 00456d58a3de4c319ed39dd6e42fbd6e: This TxnStatusTablet replica's current role is: LEADER
I20260811 05:07:42.978242 30105 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260811 05:07:42.978286 29237 catalog_manager.cc:5495] T 273c8962f44b47a0908cd86e0ae29379 P 00456d58a3de4c319ed39dd6e42fbd6e reported cstate change: term changed from 0 to 1, leader changed from <none> to 00456d58a3de4c319ed39dd6e42fbd6e (127.26.191.193). New cstate: current_term: 1 leader_uuid: "00456d58a3de4c319ed39dd6e42fbd6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00456d58a3de4c319ed39dd6e42fbd6e" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 46269 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "febd06bf13f54e28946ea55aa125ee29" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01604ce87f6d43e882a846aff8569b08" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 35287 } health_report { overall_health: UNKNOWN } } }
I20260811 05:07:42.978382 30105 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260811 05:07:42.985615 30023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:42.982340 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33008 (local address 127.26.191.193:46269)
0811 05:07:42.982383 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:42.982386 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:42.982475 (+ 89us) server_negotiation.cc:407] Connection header received
0811 05:07:42.982573 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:42.982573 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:42.982591 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:42.982647 (+ 56us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:07:42.982854 (+ 207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:42.983375 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:42.984518 (+ 1143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:42.984710 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:42.984996 (+ 286us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:42.985265 (+ 269us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:07:42.985368 (+ 103us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:07:42.985438 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:42.985527 (+ 89us) server_negotiation.cc:299] Negotiation successful
0811 05:07:42.985548 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 05:07:42.985682 30095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:42.982302 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.193:46269 (local address 127.0.0.1:33008)
0811 05:07:42.982407 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:42.982424 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:42.982495 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:42.982684 (+ 189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:42.982685 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:42.982687 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 05:07:42.982747 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:42.982749 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:42.983479 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:42.983480 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:42.984412 (+ 932us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:42.984416 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:42.985027 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:42.985028 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:42.985111 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:42.985135 (+ 24us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 05:07:42.985450 (+ 315us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 05:07:42.985462 (+ 12us) client_negotiation.cc:769] Sending connection context
0811 05:07:42.985524 (+ 62us) client_negotiation.cc:240] Negotiation successful
0811 05:07:42.985586 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":51}
I20260811 05:07:42.986907 29930 raft_consensus.cc:1261] T 273c8962f44b47a0908cd86e0ae29379 P 01604ce87f6d43e882a846aff8569b08 [term 1 FOLLOWER]: Refusing update from remote peer 00456d58a3de4c319ed39dd6e42fbd6e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:07:42.987018 29720 raft_consensus.cc:1261] T 273c8962f44b47a0908cd86e0ae29379 P febd06bf13f54e28946ea55aa125ee29 [term 1 FOLLOWER]: Refusing update from remote peer 00456d58a3de4c319ed39dd6e42fbd6e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:07:42.987399 30038 consensus_queue.cc:1035] T 273c8962f44b47a0908cd86e0ae29379 P 00456d58a3de4c319ed39dd6e42fbd6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "febd06bf13f54e28946ea55aa125ee29" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:07:42.987545 30103 consensus_queue.cc:1035] T 273c8962f44b47a0908cd86e0ae29379 P 00456d58a3de4c319ed39dd6e42fbd6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "01604ce87f6d43e882a846aff8569b08" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 35287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:07:42.988238 30037 tablet_replica.cc:439] T 273c8962f44b47a0908cd86e0ae29379 P febd06bf13f54e28946ea55aa125ee29: TxnStatusTablet state changed. Reason: New leader 00456d58a3de4c319ed39dd6e42fbd6e. Latest consensus state: current_term: 1 leader_uuid: "00456d58a3de4c319ed39dd6e42fbd6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00456d58a3de4c319ed39dd6e42fbd6e" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 46269 } } peers { permanent_uuid: "febd06bf13f54e28946ea55aa125ee29" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40653 } } peers { permanent_uuid: "01604ce87f6d43e882a846aff8569b08" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 35287 } } }
I20260811 05:07:42.988229 30041 tablet_replica.cc:439] T 273c8962f44b47a0908cd86e0ae29379 P 01604ce87f6d43e882a846aff8569b08: TxnStatusTablet state changed. Reason: New leader 00456d58a3de4c319ed39dd6e42fbd6e. Latest consensus state: current_term: 1 leader_uuid: "00456d58a3de4c319ed39dd6e42fbd6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00456d58a3de4c319ed39dd6e42fbd6e" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 46269 } } peers { permanent_uuid: "febd06bf13f54e28946ea55aa125ee29" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40653 } } peers { permanent_uuid: "01604ce87f6d43e882a846aff8569b08" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 35287 } } }
I20260811 05:07:42.988333 30037 tablet_replica.cc:442] T 273c8962f44b47a0908cd86e0ae29379 P febd06bf13f54e28946ea55aa125ee29: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 05:07:42.988334 30041 tablet_replica.cc:442] T 273c8962f44b47a0908cd86e0ae29379 P 01604ce87f6d43e882a846aff8569b08: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 05:07:42.989156 30038 tablet_replica.cc:439] T 273c8962f44b47a0908cd86e0ae29379 P 00456d58a3de4c319ed39dd6e42fbd6e: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "00456d58a3de4c319ed39dd6e42fbd6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00456d58a3de4c319ed39dd6e42fbd6e" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 46269 } } peers { permanent_uuid: "febd06bf13f54e28946ea55aa125ee29" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40653 } } peers { permanent_uuid: "01604ce87f6d43e882a846aff8569b08" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 35287 } } }
I20260811 05:07:42.989259 30038 tablet_replica.cc:442] T 273c8962f44b47a0908cd86e0ae29379 P 00456d58a3de4c319ed39dd6e42fbd6e: This TxnStatusTablet replica's current role is: LEADER
I20260811 05:07:42.989362 30057 mvcc.cc:205] Tried to move back new op lower bound from 7317196238792187904 to 7317196238756089856. Current Snapshot: MvccSnapshot[applied={T|T < 7317196238792187904 or (T in {7317196238792187904})}]
I20260811 05:07:42.989763 30041 tablet_replica.cc:439] T 273c8962f44b47a0908cd86e0ae29379 P 01604ce87f6d43e882a846aff8569b08: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "00456d58a3de4c319ed39dd6e42fbd6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00456d58a3de4c319ed39dd6e42fbd6e" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 46269 } } peers { permanent_uuid: "febd06bf13f54e28946ea55aa125ee29" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40653 } } peers { permanent_uuid: "01604ce87f6d43e882a846aff8569b08" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 35287 } } }
I20260811 05:07:42.989850 30041 tablet_replica.cc:442] T 273c8962f44b47a0908cd86e0ae29379 P 01604ce87f6d43e882a846aff8569b08: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 05:07:42.991050 30038 tablet_replica.cc:439] T 273c8962f44b47a0908cd86e0ae29379 P 00456d58a3de4c319ed39dd6e42fbd6e: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "00456d58a3de4c319ed39dd6e42fbd6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00456d58a3de4c319ed39dd6e42fbd6e" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 46269 } } peers { permanent_uuid: "febd06bf13f54e28946ea55aa125ee29" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40653 } } peers { permanent_uuid: "01604ce87f6d43e882a846aff8569b08" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 35287 } } }
I20260811 05:07:42.991149 30038 tablet_replica.cc:442] T 273c8962f44b47a0908cd86e0ae29379 P 00456d58a3de4c319ed39dd6e42fbd6e: This TxnStatusTablet replica's current role is: LEADER
I20260811 05:07:42.991128 30056 mvcc.cc:205] Tried to move back new op lower bound from 7317196238792187904 to 7317196238756089856. Current Snapshot: MvccSnapshot[applied={T|T < 7317196238792187904}]
I20260811 05:07:42.991237 30037 tablet_replica.cc:439] T 273c8962f44b47a0908cd86e0ae29379 P febd06bf13f54e28946ea55aa125ee29: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "00456d58a3de4c319ed39dd6e42fbd6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00456d58a3de4c319ed39dd6e42fbd6e" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 46269 } } peers { permanent_uuid: "febd06bf13f54e28946ea55aa125ee29" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40653 } } peers { permanent_uuid: "01604ce87f6d43e882a846aff8569b08" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 35287 } } }
I20260811 05:07:42.991305 30037 tablet_replica.cc:442] T 273c8962f44b47a0908cd86e0ae29379 P febd06bf13f54e28946ea55aa125ee29: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 05:07:42.995059 30022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:42.991916 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36192 (local address 127.26.191.195:35287)
0811 05:07:42.992088 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:42.992090 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:42.992096 (+ 6us) server_negotiation.cc:407] Connection header received
0811 05:07:42.992127 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:42.992128 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:42.992144 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:42.992227 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:07:42.992385 (+ 158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:42.993183 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:42.993973 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:42.994309 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:42.994394 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:42.994569 (+ 175us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:07:42.994710 (+ 141us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:07:42.994790 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:42.994903 (+ 113us) server_negotiation.cc:299] Negotiation successful
0811 05:07:42.994925 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":156}
I20260811 05:07:43.000831 30023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:42.998198 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.195:50769 (local address 127.26.191.193:46269)
0811 05:07:42.998251 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:42.998253 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:42.998282 (+ 29us) server_negotiation.cc:407] Connection header received
0811 05:07:42.998375 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:42.998376 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:42.998388 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:42.998478 (+ 90us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:07:42.998642 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:42.999159 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:42.999991 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:43.000200 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:43.000292 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:43.000502 (+ 210us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:07:43.000542 (+ 40us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:07:43.000612 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:43.000673 (+ 61us) server_negotiation.cc:299] Negotiation successful
0811 05:07:43.000698 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 05:07:43.000831 30002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:42.998079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.193:46269 (local address 127.26.191.195:50769)
0811 05:07:42.998216 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:42.998232 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:42.998303 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:42.998483 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:42.998484 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:42.998485 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 05:07:42.998555 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:42.998556 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:42.999269 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:42.999271 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:42.999876 (+ 605us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:42.999878 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:43.000296 (+ 418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:43.000298 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:43.000378 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:43.000396 (+ 18us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 05:07:43.000613 (+ 217us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 05:07:43.000616 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 05:07:43.000671 (+ 55us) client_negotiation.cc:240] Negotiation successful
0811 05:07:43.000750 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53}
I20260811 05:07:43.004019 29720 raft_consensus.cc:1261] T 50ec20e80bb742f090a0bd6883f97c92 P febd06bf13f54e28946ea55aa125ee29 [term 1 FOLLOWER]: Refusing update from remote peer 01604ce87f6d43e882a846aff8569b08: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:07:43.004019 29483 raft_consensus.cc:1261] T 50ec20e80bb742f090a0bd6883f97c92 P 00456d58a3de4c319ed39dd6e42fbd6e [term 1 FOLLOWER]: Refusing update from remote peer 01604ce87f6d43e882a846aff8569b08: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:07:43.004362 30087 consensus_queue.cc:1035] T 50ec20e80bb742f090a0bd6883f97c92 P 01604ce87f6d43e882a846aff8569b08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "febd06bf13f54e28946ea55aa125ee29" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:07:43.004521 30041 consensus_queue.cc:1035] T 50ec20e80bb742f090a0bd6883f97c92 P 01604ce87f6d43e882a846aff8569b08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00456d58a3de4c319ed39dd6e42fbd6e" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 46269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:07:43.014810 30123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:43.011527 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.195:35287 (local address 127.26.191.193:40201)
0811 05:07:43.011768 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:43.011781 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:43.011843 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:43.011965 (+ 122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:43.011965 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:43.011967 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 05:07:43.012048 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:43.012050 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:43.013073 (+ 1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:43.013075 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:43.013826 (+ 751us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:43.013829 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:43.014340 (+ 511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:43.014341 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:43.014427 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:43.014448 (+ 21us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 05:07:43.014646 (+ 198us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 05:07:43.014647 (+ 1us) client_negotiation.cc:769] Sending connection context
0811 05:07:43.014672 (+ 25us) client_negotiation.cc:240] Negotiation successful
0811 05:07:43.014712 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":110,"threads_started":1}
I20260811 05:07:43.014804 30022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:43.011734 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.193:40201 (local address 127.26.191.195:35287)
0811 05:07:43.011791 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:43.011793 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:43.011826 (+ 33us) server_negotiation.cc:407] Connection header received
0811 05:07:43.011894 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:43.011895 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:43.011906 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:43.011961 (+ 55us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:07:43.012150 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:43.012973 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:43.013935 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:43.014242 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:43.014314 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:43.014548 (+ 234us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:07:43.014586 (+ 38us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:07:43.014647 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:43.014688 (+ 41us) server_negotiation.cc:299] Negotiation successful
0811 05:07:43.014710 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 05:07:43.025399 29237 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58348:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:07:43.025542 29237 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58348:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:07:43.026376 29237 catalog_manager.cc:5782] T 00000000000000000000000000000000 P def2ffedbb54427aaf84618c15e016d9: Sending DeleteTablet for 3 replicas of tablet 50ec20e80bb742f090a0bd6883f97c92
I20260811 05:07:43.026746 29684 tablet_service.cc:1514] Processing DeleteTablet for tablet 50ec20e80bb742f090a0bd6883f97c92 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:07:43 UTC) from {username='kudu', principal='kudu/127.26.191.254@KRBTEST.COM'} at 127.0.0.1:57174
I20260811 05:07:43.026878 30076 tablet_replica.cc:330] T 50ec20e80bb742f090a0bd6883f97c92 P febd06bf13f54e28946ea55aa125ee29: stopping tablet replica
I20260811 05:07:43.026934 30076 raft_consensus.cc:2229] T 50ec20e80bb742f090a0bd6883f97c92 P febd06bf13f54e28946ea55aa125ee29 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 05:07:43.026984 30076 raft_consensus.cc:2258] T 50ec20e80bb742f090a0bd6883f97c92 P febd06bf13f54e28946ea55aa125ee29 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:07:43.027271 29899 tablet_service.cc:1514] Processing DeleteTablet for tablet 50ec20e80bb742f090a0bd6883f97c92 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:07:43 UTC) from {username='kudu', principal='kudu/127.26.191.254@KRBTEST.COM'} at 127.0.0.1:36176
I20260811 05:07:43.027369 30078 tablet_replica.cc:330] T 50ec20e80bb742f090a0bd6883f97c92 P 01604ce87f6d43e882a846aff8569b08: stopping tablet replica
I20260811 05:07:43.027421 30078 raft_consensus.cc:2229] T 50ec20e80bb742f090a0bd6883f97c92 P 01604ce87f6d43e882a846aff8569b08 [term 1 LEADER]: Raft consensus shutting down.
I20260811 05:07:43.027521 30078 raft_consensus.cc:2258] T 50ec20e80bb742f090a0bd6883f97c92 P 01604ce87f6d43e882a846aff8569b08 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:07:43.027977 30078 ts_tablet_manager.cc:1905] T 50ec20e80bb742f090a0bd6883f97c92 P 01604ce87f6d43e882a846aff8569b08: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:07:43.029814 30078 ts_tablet_manager.cc:1918] T 50ec20e80bb742f090a0bd6883f97c92 P 01604ce87f6d43e882a846aff8569b08: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 05:07:43.029879 30078 log.cc:1196] T 50ec20e80bb742f090a0bd6883f97c92 P 01604ce87f6d43e882a846aff8569b08: Deleting WAL directory at /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/minicluster-data/ts-2/wal/wals/50ec20e80bb742f090a0bd6883f97c92
I20260811 05:07:43.030108 30078 ts_tablet_manager.cc:1939] T 50ec20e80bb742f090a0bd6883f97c92 P 01604ce87f6d43e882a846aff8569b08: Deleting consensus metadata
I20260811 05:07:43.030409 29460 tablet_service.cc:1514] Processing DeleteTablet for tablet 50ec20e80bb742f090a0bd6883f97c92 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:07:43 UTC) from {username='kudu', principal='kudu/127.26.191.254@KRBTEST.COM'} at 127.0.0.1:32992
I20260811 05:07:43.030632 30075 tablet_replica.cc:330] T 50ec20e80bb742f090a0bd6883f97c92 P 00456d58a3de4c319ed39dd6e42fbd6e: stopping tablet replica
I20260811 05:07:43.030704 30075 raft_consensus.cc:2229] T 50ec20e80bb742f090a0bd6883f97c92 P 00456d58a3de4c319ed39dd6e42fbd6e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 05:07:43.030748 30075 raft_consensus.cc:2258] T 50ec20e80bb742f090a0bd6883f97c92 P 00456d58a3de4c319ed39dd6e42fbd6e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:07:43.030995 29209 catalog_manager.cc:4841] TS 01604ce87f6d43e882a846aff8569b08 (127.26.191.195:35287): tablet 50ec20e80bb742f090a0bd6883f97c92 (table test-table [id=bea8c413ae7241099b6f22a8570c638c]) successfully deleted
I20260811 05:07:43.031365 30075 ts_tablet_manager.cc:1905] T 50ec20e80bb742f090a0bd6883f97c92 P 00456d58a3de4c319ed39dd6e42fbd6e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:07:43.031538 30076 ts_tablet_manager.cc:1905] T 50ec20e80bb742f090a0bd6883f97c92 P febd06bf13f54e28946ea55aa125ee29: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:07:43.033216 30076 ts_tablet_manager.cc:1918] T 50ec20e80bb742f090a0bd6883f97c92 P febd06bf13f54e28946ea55aa125ee29: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 05:07:43.033284 30076 log.cc:1196] T 50ec20e80bb742f090a0bd6883f97c92 P febd06bf13f54e28946ea55aa125ee29: Deleting WAL directory at /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/minicluster-data/ts-1/wal/wals/50ec20e80bb742f090a0bd6883f97c92
I20260811 05:07:43.033406 30075 ts_tablet_manager.cc:1918] T 50ec20e80bb742f090a0bd6883f97c92 P 00456d58a3de4c319ed39dd6e42fbd6e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 05:07:43.033463 30075 log.cc:1196] T 50ec20e80bb742f090a0bd6883f97c92 P 00456d58a3de4c319ed39dd6e42fbd6e: Deleting WAL directory at /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424853995437-27391-0/minicluster-data/ts-0/wal/wals/50ec20e80bb742f090a0bd6883f97c92
I20260811 05:07:43.033525 30076 ts_tablet_manager.cc:1939] T 50ec20e80bb742f090a0bd6883f97c92 P febd06bf13f54e28946ea55aa125ee29: Deleting consensus metadata
I20260811 05:07:43.033727 30075 ts_tablet_manager.cc:1939] T 50ec20e80bb742f090a0bd6883f97c92 P 00456d58a3de4c319ed39dd6e42fbd6e: Deleting consensus metadata
I20260811 05:07:43.033941 29206 catalog_manager.cc:4841] TS febd06bf13f54e28946ea55aa125ee29 (127.26.191.194:40653): tablet 50ec20e80bb742f090a0bd6883f97c92 (table test-table [id=bea8c413ae7241099b6f22a8570c638c]) successfully deleted
I20260811 05:07:43.034224 29205 catalog_manager.cc:4841] TS 00456d58a3de4c319ed39dd6e42fbd6e (127.26.191.193:46269): tablet 50ec20e80bb742f090a0bd6883f97c92 (table test-table [id=bea8c413ae7241099b6f22a8570c638c]) successfully deleted
Aug 11 05:07:43 dist-test-slave-x5fp krb5kdc[29161](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424862, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.26.191.193@KRBTEST.COM
I20260811 05:07:43.046008 30023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:43.034334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33020 (local address 127.26.191.193:46269)
0811 05:07:43.034385 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:43.034387 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:43.034693 (+ 306us) server_negotiation.cc:407] Connection header received
0811 05:07:43.034728 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:43.034728 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:43.034740 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:43.034798 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:43.035602 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:43.036352 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:43.037491 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:43.037805 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:43.037886 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:43.041758 (+ 3872us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:43.041770 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:43.041771 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:07:43.041780 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:43.043974 (+ 2194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:43.044407 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:43.044411 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:43.044412 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:43.044647 (+ 235us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:43.045009 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:43.045011 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:43.045011 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:43.045243 (+ 232us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:43.045433 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:43.045485 (+ 52us) server_negotiation.cc:299] Negotiation successful
0811 05:07:43.045584 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
W20260811 05:07:43.046324 29552 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:33020
I20260811 05:07:43.056352 29304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:43.047504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58364 (local address 127.26.191.254:44529)
0811 05:07:43.047565 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:43.047568 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:43.047628 (+ 60us) server_negotiation.cc:407] Connection header received
0811 05:07:43.047700 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:43.047701 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:43.047714 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:43.047785 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:43.048449 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:43.049432 (+ 983us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:43.050560 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:43.050908 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:43.050988 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:43.052877 (+ 1889us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:43.052879 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:43.052879 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:07:43.052888 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:43.054776 (+ 1888us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:43.055254 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:43.055256 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:43.055256 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:43.055324 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:43.055580 (+ 256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:43.055581 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:43.055581 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:43.055872 (+ 291us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:43.056004 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:43.056159 (+ 155us) server_negotiation.cc:299] Negotiation successful
0811 05:07:43.056254 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
W20260811 05:07:43.056856 29237 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58364
I20260811 05:07:43.057647 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 29353
I20260811 05:07:43.069263 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 29571
I20260811 05:07:43.090847 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 29803
I20260811 05:07:43.103189 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 29181
2026-08-11T05:07:43Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (2656 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 05:07:43 dist-test-slave-x5fp krb5kdc[30142](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 05:07:43 dist-test-slave-x5fp krb5kdc[30142](info): set up 2 sockets
Aug 11 05:07:43 dist-test-slave-x5fp krb5kdc[30142](info): commencing operation
krb5kdc: starting...
W20260811 05:07:44.466689 27391 mini_kdc.cc:121] Time spent starting KDC: real 1.328s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/krb5kdc/test-user.keytab.
Aug 11 05:07:44 dist-test-slave-x5fp krb5kdc[30142](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424864, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T05:07:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:07:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.191.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.191.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.191.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab.
Entry for principal kudu/127.26.191.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab.
I20260811 05:07:44.608075 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.254:41885
--webserver_interface=127.26.191.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab
--principal=kudu/127.26.191.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:37223
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.191.254:41885
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:07:44.696907 30160 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:07:44.697111 30160 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:07:44.697134 30160 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:07:44.698218 30160 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:07:44.698252 30160 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260811 05:07:44.698266 30160 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:07:44.698279 30160 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:07:44.698292 30160 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:07:44.698303 30160 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:07:44.699712 30160 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:37223
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.191.254:41885
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab
--principal=kudu/127.26.191.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.254:41885
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.191.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30160
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:07:44.699911 30160 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:07:44.700084 30160 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:07:44.705106 30168 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:44.705150 30165 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:44.705261 30166 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:07:44.705612 30160 server_base.cc:1034] running on GCE node
I20260811 05:07:44.705956 30160 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:07:44.706301 30160 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:07:44.707489 30160 hybrid_clock.cc:648] HybridClock initialized: now 1786424864707466 us; error 42 us; skew 500 ppm
Aug 11 05:07:44 dist-test-slave-x5fp krb5kdc[30142](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424864, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:07:44.714033 30160 init.cc:377] Logged in from keytab as kudu/127.26.191.254@KRBTEST.COM (short username kudu)
I20260811 05:07:44.714566 30160 webserver.cc:460] Webserver started at http://127.26.191.254:38501/ using document root <none> and password file <none>
I20260811 05:07:44.714859 30160 fs_manager.cc:359] Metadata directory not provided
I20260811 05:07:44.714939 30160 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:07:44.715111 30160 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:07:44.716320 30160 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/minicluster-data/master-0/data/instance:
uuid: "1f0bd85d319f49448cda2b835175d76a"
format_stamp: "Formatted at 2026-08-11 05:07:44 on dist-test-slave-x5fp"
server_key: "c27151909d285cfc8897e3372201188f"
server_key_iv: "121a47114918bacdc8345aa5ebb5d266"
server_key_version: "encryptionkey@0"
I20260811 05:07:44.716779 30160 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/minicluster-data/master-0/wal/instance:
uuid: "1f0bd85d319f49448cda2b835175d76a"
format_stamp: "Formatted at 2026-08-11 05:07:44 on dist-test-slave-x5fp"
server_key: "c27151909d285cfc8897e3372201188f"
server_key_iv: "121a47114918bacdc8345aa5ebb5d266"
server_key_version: "encryptionkey@0"
I20260811 05:07:44.718326 30160 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 05:07:44.719223 30177 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:44.719445 30160 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 05:07:44.719565 30160 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/minicluster-data/master-0/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/minicluster-data/master-0/wal
uuid: "1f0bd85d319f49448cda2b835175d76a"
format_stamp: "Formatted at 2026-08-11 05:07:44 on dist-test-slave-x5fp"
server_key: "c27151909d285cfc8897e3372201188f"
server_key_iv: "121a47114918bacdc8345aa5ebb5d266"
server_key_version: "encryptionkey@0"
I20260811 05:07:44.719658 30160 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:07:44.735396 30160 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:07:44.737776 30160 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:07:44.737988 30160 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:07:44.743693 30160 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.254:41885
I20260811 05:07:44.743764 30285 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.254:41885 every 8 connection(s)
I20260811 05:07:44.744148 30160 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
I20260811 05:07:44.744867 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 30160
I20260811 05:07:44.744973 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/minicluster-data/master-0/wal/instance
I20260811 05:07:44.745014 30286 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:07:44.745173 27391 external_mini_cluster.cc:1428] Setting key e85b7bbab70276d6a2bdc91d082b32a5
I20260811 05:07:44.748816 30286 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1f0bd85d319f49448cda2b835175d76a: Bootstrap starting.
I20260811 05:07:44.749603 30286 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1f0bd85d319f49448cda2b835175d76a: Neither blocks nor log segments found. Creating new log.
I20260811 05:07:44.749951 30286 log.cc:824] T 00000000000000000000000000000000 P 1f0bd85d319f49448cda2b835175d76a: Log is configured to *not* fsync() on all Append() calls
I20260811 05:07:44.750813 30286 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1f0bd85d319f49448cda2b835175d76a: No bootstrap required, opened a new log
Aug 11 05:07:44 dist-test-slave-x5fp krb5kdc[30142](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424864, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
I20260811 05:07:44.753024 30286 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1f0bd85d319f49448cda2b835175d76a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f0bd85d319f49448cda2b835175d76a" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 41885 } }
I20260811 05:07:44.753232 30286 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1f0bd85d319f49448cda2b835175d76a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:07:44.753269 30286 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1f0bd85d319f49448cda2b835175d76a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f0bd85d319f49448cda2b835175d76a, State: Initialized, Role: FOLLOWER
I20260811 05:07:44.753443 30286 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1f0bd85d319f49448cda2b835175d76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f0bd85d319f49448cda2b835175d76a" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 41885 } }
I20260811 05:07:44.753568 30286 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1f0bd85d319f49448cda2b835175d76a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:07:44.753611 30286 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1f0bd85d319f49448cda2b835175d76a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:07:44.753679 30286 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1f0bd85d319f49448cda2b835175d76a [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:07:44.754518 30286 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1f0bd85d319f49448cda2b835175d76a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f0bd85d319f49448cda2b835175d76a" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 41885 } }
I20260811 05:07:44.754670 30286 leader_election.cc:302] T 00000000000000000000000000000000 P 1f0bd85d319f49448cda2b835175d76a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1f0bd85d319f49448cda2b835175d76a; no voters:
I20260811 05:07:44.754933 30286 leader_election.cc:288] T 00000000000000000000000000000000 P 1f0bd85d319f49448cda2b835175d76a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 05:07:44.755057 30295 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1f0bd85d319f49448cda2b835175d76a [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:07:44.755251 30295 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1f0bd85d319f49448cda2b835175d76a [term 1 LEADER]: Becoming Leader. State: Replica: 1f0bd85d319f49448cda2b835175d76a, State: Running, Role: LEADER
I20260811 05:07:44.755259 30286 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1f0bd85d319f49448cda2b835175d76a [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:07:44.755378 30295 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1f0bd85d319f49448cda2b835175d76a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f0bd85d319f49448cda2b835175d76a" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 41885 } }
I20260811 05:07:44.755767 30295 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1f0bd85d319f49448cda2b835175d76a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1f0bd85d319f49448cda2b835175d76a. Latest consensus state: current_term: 1 leader_uuid: "1f0bd85d319f49448cda2b835175d76a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f0bd85d319f49448cda2b835175d76a" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 41885 } } }
I20260811 05:07:44.755839 30295 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1f0bd85d319f49448cda2b835175d76a [sys.catalog]: This master's current role is: LEADER
I20260811 05:07:44.756285 30296 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1f0bd85d319f49448cda2b835175d76a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1f0bd85d319f49448cda2b835175d76a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f0bd85d319f49448cda2b835175d76a" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 41885 } } }
I20260811 05:07:44.756373 30296 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1f0bd85d319f49448cda2b835175d76a [sys.catalog]: This master's current role is: LEADER
I20260811 05:07:44.756482 30303 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:07:44.757119 30303 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:07:44.758041 30291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:44.745801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42238 (local address 127.26.191.254:41885)
0811 05:07:44.746015 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:44.746027 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:44.746066 (+ 39us) server_negotiation.cc:407] Connection header received
0811 05:07:44.746692 (+ 626us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:44.746703 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:44.746787 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:44.746969 (+ 182us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:44.747632 (+ 663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:44.749263 (+ 1631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:44.750168 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:44.750805 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:44.750947 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:44.753558 (+ 2611us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:44.753562 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:44.753563 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:07:44.753577 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:44.755905 (+ 2328us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:44.756427 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:44.756430 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:44.756431 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:44.756552 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:44.756853 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:44.756853 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:44.756854 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:44.757203 (+ 349us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:44.757546 (+ 343us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:44.757635 (+ 89us) server_negotiation.cc:299] Negotiation successful
0811 05:07:44.757810 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":90,"threads_started":1}
I20260811 05:07:44.761344 30303 catalog_manager.cc:1347] Generated new cluster ID: 5de555fe0b7546ecaaf92f716a0ba8d6
I20260811 05:07:44.761413 30303 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:07:44.773805 30303 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:07:44.774550 30303 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:07:44.782326 30303 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1f0bd85d319f49448cda2b835175d76a: Generated new TSK 0
I20260811 05:07:44.782552 30303 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.191.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.191.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.191.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.193.keytab.
Entry for principal kudu/127.26.191.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.193.keytab.
I20260811 05:07:44.821175 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.191.193:0
--local_ip_for_outbound_sockets=127.26.191.193
--webserver_interface=127.26.191.193
--webserver_port=0
--tserver_master_addrs=127.26.191.254:41885
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.193.keytab
--principal=kudu/127.26.191.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:37223
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:07:44.911840 30322 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:07:44.912146 30322 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:07:44.912201 30322 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:07:44.913637 30322 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:07:44.913725 30322 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:07:44.913776 30322 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260811 05:07:44.913807 30322 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 05:07:44.913854 30322 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.191.193
I20260811 05:07:44.915629 30322 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:37223
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.193.keytab
--principal=kudu/127.26.191.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.191.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.191.193
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.26.191.254:41885
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30322
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.191.193
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:07:44.915974 30322 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:07:44.916266 30322 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:07:44.922335 30330 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:44.922335 30329 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:44.922405 30332 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:07:44.922590 30322 server_base.cc:1034] running on GCE node
I20260811 05:07:44.922883 30322 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:07:44.923161 30322 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:07:44.924332 30322 hybrid_clock.cc:648] HybridClock initialized: now 1786424864924312 us; error 48 us; skew 500 ppm
Aug 11 05:07:44 dist-test-slave-x5fp krb5kdc[30142](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424864, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:07:44.927594 30322 init.cc:377] Logged in from keytab as kudu/127.26.191.193@KRBTEST.COM (short username kudu)
I20260811 05:07:44.928119 30322 webserver.cc:460] Webserver started at http://127.26.191.193:36773/ using document root <none> and password file <none>
I20260811 05:07:44.928406 30322 fs_manager.cc:359] Metadata directory not provided
I20260811 05:07:44.928491 30322 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:07:44.928665 30322 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:07:44.929896 30322 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/minicluster-data/ts-0/data/instance:
uuid: "60ebd7d2397f475ea3e0101349417482"
format_stamp: "Formatted at 2026-08-11 05:07:44 on dist-test-slave-x5fp"
server_key: "430fc7d65e491e531535b397db4604e5"
server_key_iv: "562ee423955e7b73633004d9dc4c8334"
server_key_version: "encryptionkey@0"
I20260811 05:07:44.930330 30322 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/minicluster-data/ts-0/wal/instance:
uuid: "60ebd7d2397f475ea3e0101349417482"
format_stamp: "Formatted at 2026-08-11 05:07:44 on dist-test-slave-x5fp"
server_key: "430fc7d65e491e531535b397db4604e5"
server_key_iv: "562ee423955e7b73633004d9dc4c8334"
server_key_version: "encryptionkey@0"
I20260811 05:07:44.931918 30322 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 05:07:44.933074 30342 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:44.933348 30322 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:07:44.933481 30322 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/minicluster-data/ts-0/wal
uuid: "60ebd7d2397f475ea3e0101349417482"
format_stamp: "Formatted at 2026-08-11 05:07:44 on dist-test-slave-x5fp"
server_key: "430fc7d65e491e531535b397db4604e5"
server_key_iv: "562ee423955e7b73633004d9dc4c8334"
server_key_version: "encryptionkey@0"
I20260811 05:07:44.933573 30322 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:07:44.946024 30322 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:07:44.949170 30322 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:07:44.949370 30322 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:07:44.950106 30322 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:07:44.950167 30322 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:44.950220 30322 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:07:44.950254 30322 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:44.958545 30322 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.193:42455
I20260811 05:07:44.958637 30524 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.193:42455 every 8 connection(s)
I20260811 05:07:44.958943 30322 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/minicluster-data/ts-0/data/info.pb
Aug 11 05:07:44 dist-test-slave-x5fp krb5kdc[30142](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424864, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.193@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
I20260811 05:07:44.964934 30291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:44.951461 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.193:37025 (local address 127.26.191.254:41885)
0811 05:07:44.951540 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:44.951542 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:44.951812 (+ 270us) server_negotiation.cc:407] Connection header received
0811 05:07:44.954656 (+ 2844us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:44.954684 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:44.954699 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:44.954749 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:44.955942 (+ 1193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:44.956990 (+ 1048us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:44.958633 (+ 1643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:44.958949 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:44.959046 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:44.961558 (+ 2512us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:44.961559 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:44.961560 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:07:44.961568 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:44.963274 (+ 1706us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:44.963764 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:44.963765 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:44.963766 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:44.963828 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:44.964134 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:44.964135 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:44.964135 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:44.964282 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:44.964342 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:44.964653 (+ 311us) server_negotiation.cc:299] Negotiation successful
0811 05:07:44.964860 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 05:07:44.964998 30355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:44.951449 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:41885 (local address 127.26.191.193:37025)
0811 05:07:44.951651 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:44.951698 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:44.954499 (+ 2801us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:44.954991 (+ 492us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:44.954996 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:44.955448 (+ 452us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:07:44.955785 (+ 337us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:44.955794 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:44.957127 (+ 1333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:44.957128 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:44.958512 (+ 1384us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:44.958516 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:44.959073 (+ 557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:44.959075 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:44.959244 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:44.959776 (+ 532us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:07:44.959784 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:07:44.961442 (+ 1658us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:07:44.963376 (+ 1934us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:07:44.963385 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:07:44.963387 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:07:44.963672 (+ 285us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:07:44.963936 (+ 264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:07:44.963937 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:07:44.963938 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:07:44.964061 (+ 123us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:07:44.964353 (+ 292us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:07:44.964362 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:07:44.964492 (+ 130us) client_negotiation.cc:769] Sending connection context
0811 05:07:44.964587 (+ 95us) client_negotiation.cc:240] Negotiation successful
0811 05:07:44.964791 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":102,"threads_started":1}
I20260811 05:07:44.965595 30525 heartbeater.cc:347] Connected to a master server at 127.26.191.254:41885
I20260811 05:07:44.965695 30525 heartbeater.cc:464] Registering TS with master...
I20260811 05:07:44.965929 30525 heartbeater.cc:511] Master 127.26.191.254:41885 requested a full tablet report, sending...
I20260811 05:07:44.966557 30199 ts_manager.cc:194] Registered new tserver with Master: 60ebd7d2397f475ea3e0101349417482 (127.26.191.193:42455)
I20260811 05:07:44.967535 30199 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.191.193@KRBTEST.COM'} at 127.26.191.193:37025
I20260811 05:07:44.968147 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 30322
I20260811 05:07:44.968261 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/minicluster-data/ts-0/wal/instance
I20260811 05:07:44.968479 27391 external_mini_cluster.cc:1428] Setting key 6925edfc746334793f1f99bdf16c2ecf
I20260811 05:07:44.974050 30533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:44.966823 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:41885 (local address 127.26.191.193:39677)
0811 05:07:44.966976 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:44.966986 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:44.967043 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:44.967165 (+ 122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:44.967166 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:44.967322 (+ 156us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:07:44.967376 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:44.967377 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:44.968258 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:44.968260 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:44.969030 (+ 770us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:44.969033 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:44.969507 (+ 474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:44.969509 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:44.969603 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:44.970071 (+ 468us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:07:44.970077 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:07:44.970503 (+ 426us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:07:44.972880 (+ 2377us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:07:44.972881 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:07:44.972881 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:07:44.973090 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:07:44.973314 (+ 224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:07:44.973314 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:07:44.973314 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:07:44.973375 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:07:44.973714 (+ 339us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:07:44.973715 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:07:44.973777 (+ 62us) client_negotiation.cc:769] Sending connection context
0811 05:07:44.973870 (+ 93us) client_negotiation.cc:240] Negotiation successful
0811 05:07:44.973967 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":90,"threads_started":1}
I20260811 05:07:44.974169 30291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:44.966754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.193:39677 (local address 127.26.191.254:41885)
0811 05:07:44.966798 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:44.966799 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:44.967056 (+ 257us) server_negotiation.cc:407] Connection header received
0811 05:07:44.967082 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:44.967082 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:44.967094 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:44.967163 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:44.967444 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:44.968134 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:44.969111 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:44.969423 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:44.969485 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:44.970613 (+ 1128us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:44.970614 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:44.970615 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:07:44.970621 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:44.972786 (+ 2165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:44.973155 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:44.973156 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:44.973157 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:44.973235 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:44.973445 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:44.973446 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:44.973446 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:44.973613 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:44.973691 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:44.973918 (+ 227us) server_negotiation.cc:299] Negotiation successful
0811 05:07:44.974014 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
WARNING: no policy specified for kudu/127.26.191.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.191.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.191.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.194.keytab.
Entry for principal kudu/127.26.191.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.194.keytab.
I20260811 05:07:45.000524 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.191.194:0
--local_ip_for_outbound_sockets=127.26.191.194
--webserver_interface=127.26.191.194
--webserver_port=0
--tserver_master_addrs=127.26.191.254:41885
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.194.keytab
--principal=kudu/127.26.191.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:37223
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:07:45.090672 30538 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:07:45.090934 30538 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:07:45.090963 30538 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:07:45.092309 30538 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:07:45.092366 30538 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:07:45.092389 30538 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260811 05:07:45.092403 30538 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 05:07:45.092473 30538 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.191.194
I20260811 05:07:45.094261 30538 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:37223
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.194.keytab
--principal=kudu/127.26.191.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.191.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.191.194
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.26.191.254:41885
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30538
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.191.194
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:07:45.094553 30538 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:07:45.094839 30538 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:07:45.100615 30550 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:07:45.100809 30538 server_base.cc:1034] running on GCE node
W20260811 05:07:45.100615 30549 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:45.100570 30554 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:07:45.101118 30538 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:07:45.101413 30538 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:07:45.102620 30538 hybrid_clock.cc:648] HybridClock initialized: now 1786424865102608 us; error 43 us; skew 500 ppm
Aug 11 05:07:45 dist-test-slave-x5fp krb5kdc[30142](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424865, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:07:45.105780 30538 init.cc:377] Logged in from keytab as kudu/127.26.191.194@KRBTEST.COM (short username kudu)
I20260811 05:07:45.106309 30538 webserver.cc:460] Webserver started at http://127.26.191.194:36161/ using document root <none> and password file <none>
I20260811 05:07:45.106509 30538 fs_manager.cc:359] Metadata directory not provided
I20260811 05:07:45.106554 30538 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:07:45.106648 30538 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:07:45.107728 30538 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/minicluster-data/ts-1/data/instance:
uuid: "fb362415e802498aa60beb90898b5715"
format_stamp: "Formatted at 2026-08-11 05:07:45 on dist-test-slave-x5fp"
server_key: "2a41c2da8c66ca379145bd3464961eaa"
server_key_iv: "024acfd86e9a63ed410d3347d8464c45"
server_key_version: "encryptionkey@0"
I20260811 05:07:45.108058 30538 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/minicluster-data/ts-1/wal/instance:
uuid: "fb362415e802498aa60beb90898b5715"
format_stamp: "Formatted at 2026-08-11 05:07:45 on dist-test-slave-x5fp"
server_key: "2a41c2da8c66ca379145bd3464961eaa"
server_key_iv: "024acfd86e9a63ed410d3347d8464c45"
server_key_version: "encryptionkey@0"
I20260811 05:07:45.109489 30538 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 05:07:45.110322 30567 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:45.110564 30538 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 05:07:45.110670 30538 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/minicluster-data/ts-1/wal
uuid: "fb362415e802498aa60beb90898b5715"
format_stamp: "Formatted at 2026-08-11 05:07:45 on dist-test-slave-x5fp"
server_key: "2a41c2da8c66ca379145bd3464961eaa"
server_key_iv: "024acfd86e9a63ed410d3347d8464c45"
server_key_version: "encryptionkey@0"
I20260811 05:07:45.110752 30538 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:07:45.123037 30538 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:07:45.125731 30538 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:07:45.125865 30538 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:07:45.126398 30538 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:07:45.126446 30538 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:45.126475 30538 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:07:45.126516 30538 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 05:07:45 dist-test-slave-x5fp krb5kdc[30142](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424865, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.194@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
I20260811 05:07:45.134773 30538 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.194:40153
I20260811 05:07:45.134903 30743 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.194:40153 every 8 connection(s)
I20260811 05:07:45.135282 30538 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/minicluster-data/ts-1/data/info.pb
I20260811 05:07:45.137778 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 30538
I20260811 05:07:45.137905 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/minicluster-data/ts-1/wal/instance
I20260811 05:07:45.138096 27391 external_mini_cluster.cc:1428] Setting key 006be8f0a64ce01dbb6f971e4ebc3480
I20260811 05:07:45.138486 30291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:45.127018 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.194:41145 (local address 127.26.191.254:41885)
0811 05:07:45.127106 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:45.127108 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:45.127315 (+ 207us) server_negotiation.cc:407] Connection header received
0811 05:07:45.127882 (+ 567us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:45.127883 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:45.127897 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:45.127961 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:45.129147 (+ 1186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:45.129969 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:45.131684 (+ 1715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:45.132023 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:45.132104 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:45.135143 (+ 3039us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:45.135145 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:45.135146 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:07:45.135155 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:45.136945 (+ 1790us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:45.137391 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:45.137392 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:45.137393 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:45.137459 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:45.137760 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:45.137761 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:45.137761 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:45.137923 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:45.137995 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:45.138306 (+ 311us) server_negotiation.cc:299] Negotiation successful
0811 05:07:45.138392 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 05:07:45.138670 30577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:45.126959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:41885 (local address 127.26.191.194:41145)
0811 05:07:45.127175 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:45.127219 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:45.127751 (+ 532us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:45.128097 (+ 346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:45.128103 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:45.128559 (+ 456us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:07:45.129001 (+ 442us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:45.129009 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:45.130106 (+ 1097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:45.130107 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:45.131573 (+ 1466us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:45.131577 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:45.132146 (+ 569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:45.132148 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:45.132322 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:45.133019 (+ 697us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:07:45.133031 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:07:45.135039 (+ 2008us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:07:45.137044 (+ 2005us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:07:45.137052 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:07:45.137054 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:07:45.137309 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:07:45.137531 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:07:45.137532 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:07:45.137532 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:07:45.137686 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:07:45.137996 (+ 310us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:07:45.138004 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:07:45.138146 (+ 142us) client_negotiation.cc:769] Sending connection context
0811 05:07:45.138272 (+ 126us) client_negotiation.cc:240] Negotiation successful
0811 05:07:45.138441 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":109,"threads_started":1}
I20260811 05:07:45.139179 30746 heartbeater.cc:347] Connected to a master server at 127.26.191.254:41885
I20260811 05:07:45.139274 30746 heartbeater.cc:464] Registering TS with master...
I20260811 05:07:45.139477 30746 heartbeater.cc:511] Master 127.26.191.254:41885 requested a full tablet report, sending...
I20260811 05:07:45.141240 30199 ts_manager.cc:194] Registered new tserver with Master: fb362415e802498aa60beb90898b5715 (127.26.191.194:40153)
I20260811 05:07:45.141798 30199 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.191.194@KRBTEST.COM'} at 127.26.191.194:41145
I20260811 05:07:45.146413 30291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:45.140380 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.194:48061 (local address 127.26.191.254:41885)
0811 05:07:45.140425 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:45.140427 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:45.140546 (+ 119us) server_negotiation.cc:407] Connection header received
0811 05:07:45.140575 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:45.140576 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:45.140587 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:45.140661 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:45.141069 (+ 408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:45.141664 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:45.142537 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:45.142751 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:45.142834 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:45.143786 (+ 952us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:45.143787 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:45.143788 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:07:45.143795 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:45.145219 (+ 1424us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:45.145574 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:45.145575 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:45.145575 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:45.145635 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:45.145848 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:45.145849 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:45.145849 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:45.145997 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:45.146071 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:45.146242 (+ 171us) server_negotiation.cc:299] Negotiation successful
0811 05:07:45.146316 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":23}
I20260811 05:07:45.146430 30753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:45.140306 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:41885 (local address 127.26.191.194:48061)
0811 05:07:45.140480 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:45.140489 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:45.140538 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:45.140662 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:45.140663 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:45.140900 (+ 237us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:07:45.140975 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:45.140978 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:45.141773 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:45.141775 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:45.142447 (+ 672us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:45.142450 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:45.142839 (+ 389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:45.142840 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:45.142921 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:45.143376 (+ 455us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:07:45.143381 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:07:45.143666 (+ 285us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:07:45.145315 (+ 1649us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:07:45.145316 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:07:45.145317 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:07:45.145492 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:07:45.145714 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:07:45.145715 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:07:45.145715 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:07:45.145779 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:07:45.146074 (+ 295us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:07:45.146075 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:07:45.146122 (+ 47us) client_negotiation.cc:769] Sending connection context
0811 05:07:45.146212 (+ 90us) client_negotiation.cc:240] Negotiation successful
0811 05:07:45.146317 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":76,"threads_started":1}
WARNING: no policy specified for kudu/127.26.191.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.191.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.191.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.195.keytab.
Entry for principal kudu/127.26.191.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.195.keytab.
I20260811 05:07:45.169937 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.191.195:0
--local_ip_for_outbound_sockets=127.26.191.195
--webserver_interface=127.26.191.195
--webserver_port=0
--tserver_master_addrs=127.26.191.254:41885
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.195.keytab
--principal=kudu/127.26.191.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:37223
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:07:45.258396 30760 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:07:45.258662 30760 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:07:45.258706 30760 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:07:45.260027 30760 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:07:45.260103 30760 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:07:45.260140 30760 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260811 05:07:45.260172 30760 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 05:07:45.260217 30760 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.191.195
I20260811 05:07:45.262038 30760 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:37223
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.195.keytab
--principal=kudu/127.26.191.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.191.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.191.195
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.26.191.254:41885
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30760
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.191.195
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:07:45.262367 30760 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:07:45.262645 30760 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:07:45.268348 30772 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:45.268405 30778 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:45.268533 30775 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:07:45.268592 30760 server_base.cc:1034] running on GCE node
I20260811 05:07:45.268889 30760 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:07:45.269176 30760 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:07:45.270344 30760 hybrid_clock.cc:648] HybridClock initialized: now 1786424865270332 us; error 54 us; skew 500 ppm
Aug 11 05:07:45 dist-test-slave-x5fp krb5kdc[30142](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424865, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:07:45.273092 30760 init.cc:377] Logged in from keytab as kudu/127.26.191.195@KRBTEST.COM (short username kudu)
I20260811 05:07:45.273600 30760 webserver.cc:460] Webserver started at http://127.26.191.195:46383/ using document root <none> and password file <none>
I20260811 05:07:45.273867 30760 fs_manager.cc:359] Metadata directory not provided
I20260811 05:07:45.273916 30760 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:07:45.274051 30760 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:07:45.275184 30760 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/minicluster-data/ts-2/data/instance:
uuid: "6190c451021542509c1ea69a4199d874"
format_stamp: "Formatted at 2026-08-11 05:07:45 on dist-test-slave-x5fp"
server_key: "734277b88ad1d0c04322b0db65c357e3"
server_key_iv: "539b44bde67bb425b5646298e31b5a18"
server_key_version: "encryptionkey@0"
I20260811 05:07:45.275568 30760 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/minicluster-data/ts-2/wal/instance:
uuid: "6190c451021542509c1ea69a4199d874"
format_stamp: "Formatted at 2026-08-11 05:07:45 on dist-test-slave-x5fp"
server_key: "734277b88ad1d0c04322b0db65c357e3"
server_key_iv: "539b44bde67bb425b5646298e31b5a18"
server_key_version: "encryptionkey@0"
I20260811 05:07:45.277040 30760 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 05:07:45.278079 30787 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:45.278461 30760 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:07:45.278605 30760 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/minicluster-data/ts-2/wal
uuid: "6190c451021542509c1ea69a4199d874"
format_stamp: "Formatted at 2026-08-11 05:07:45 on dist-test-slave-x5fp"
server_key: "734277b88ad1d0c04322b0db65c357e3"
server_key_iv: "539b44bde67bb425b5646298e31b5a18"
server_key_version: "encryptionkey@0"
I20260811 05:07:45.278702 30760 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:07:45.296360 30760 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:07:45.298910 30760 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:07:45.299089 30760 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:07:45.299863 30760 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:07:45.299923 30760 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:45.299964 30760 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:07:45.299983 30760 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 05:07:45 dist-test-slave-x5fp krb5kdc[30142](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424865, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.195@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
I20260811 05:07:45.307819 30760 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.195:43857
I20260811 05:07:45.307914 30992 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.195:43857 every 8 connection(s)
I20260811 05:07:45.308300 30760 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/minicluster-data/ts-2/data/info.pb
I20260811 05:07:45.310974 30291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:45.300346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.195:45651 (local address 127.26.191.254:41885)
0811 05:07:45.300416 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:45.300419 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:45.300674 (+ 255us) server_negotiation.cc:407] Connection header received
0811 05:07:45.301311 (+ 637us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:45.301312 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:45.301327 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:45.301406 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:45.302186 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:45.302714 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:45.303800 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:45.304007 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:45.304093 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:45.307696 (+ 3603us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:45.307698 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:45.307698 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:07:45.307707 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:45.309585 (+ 1878us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:45.310007 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:45.310008 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:45.310008 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:45.310063 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:45.310355 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:45.310356 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:45.310356 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:45.310470 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:45.310522 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:45.310821 (+ 299us) server_negotiation.cc:299] Negotiation successful
0811 05:07:45.310907 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 05:07:45.311215 30807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:45.300326 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:41885 (local address 127.26.191.195:45651)
0811 05:07:45.300528 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:45.300573 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:45.301168 (+ 595us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:45.301487 (+ 319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:45.301490 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:45.301845 (+ 355us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:07:45.302075 (+ 230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:45.302081 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:45.302841 (+ 760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:45.302842 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:45.303669 (+ 827us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:45.303671 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:45.304107 (+ 436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:45.304108 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:45.304279 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:45.304894 (+ 615us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:07:45.304905 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:07:45.307573 (+ 2668us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:07:45.309678 (+ 2105us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:07:45.309685 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:07:45.309687 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:07:45.309933 (+ 246us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:07:45.310146 (+ 213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:07:45.310147 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:07:45.310148 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:07:45.310286 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:07:45.310533 (+ 247us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:07:45.310539 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:07:45.310681 (+ 142us) client_negotiation.cc:769] Sending connection context
0811 05:07:45.310798 (+ 117us) client_negotiation.cc:240] Negotiation successful
0811 05:07:45.310945 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":109,"threads_started":1}
I20260811 05:07:45.311743 30994 heartbeater.cc:347] Connected to a master server at 127.26.191.254:41885
I20260811 05:07:45.311980 30994 heartbeater.cc:464] Registering TS with master...
I20260811 05:07:45.312259 30994 heartbeater.cc:511] Master 127.26.191.254:41885 requested a full tablet report, sending...
I20260811 05:07:45.312805 30200 ts_manager.cc:194] Registered new tserver with Master: 6190c451021542509c1ea69a4199d874 (127.26.191.195:43857)
I20260811 05:07:45.313409 30200 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.191.195@KRBTEST.COM'} at 127.26.191.195:45651
I20260811 05:07:45.316743 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 30760
I20260811 05:07:45.316849 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/minicluster-data/ts-2/wal/instance
I20260811 05:07:45.317054 27391 external_mini_cluster.cc:1428] Setting key 59685d92a0fbfaea69089af14fe97dc9
I20260811 05:07:45.318454 27391 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 05:07:45.320605 30291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:45.313164 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.195:50593 (local address 127.26.191.254:41885)
0811 05:07:45.313241 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:45.313243 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:45.313297 (+ 54us) server_negotiation.cc:407] Connection header received
0811 05:07:45.313373 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:45.313374 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:45.313382 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:45.313435 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:45.313891 (+ 456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:45.314428 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:45.315438 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:45.315663 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:45.315745 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:45.317054 (+ 1309us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:45.317055 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:45.317056 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:07:45.317064 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:45.319053 (+ 1989us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:45.319551 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:45.319552 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:45.319553 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:45.319626 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:45.320010 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:45.320011 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:45.320011 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:45.320143 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:45.320205 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:45.320441 (+ 236us) server_negotiation.cc:299] Negotiation successful
0811 05:07:45.320534 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 05:07:45.320683 31006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:45.313068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:41885 (local address 127.26.191.195:50593)
0811 05:07:45.313238 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:45.313250 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:45.313314 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:45.313452 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:45.313453 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:45.313714 (+ 261us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:07:45.313793 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:45.313795 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:45.314636 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:45.314637 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:45.315322 (+ 685us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:45.315326 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:45.315742 (+ 416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:45.315743 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:45.315834 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:45.316391 (+ 557us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:07:45.316396 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:07:45.316911 (+ 515us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:07:45.319146 (+ 2235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:07:45.319147 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:07:45.319148 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:07:45.319402 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:07:45.319736 (+ 334us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:07:45.319737 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:07:45.319738 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:07:45.319837 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:07:45.320217 (+ 380us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:07:45.320219 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:07:45.320279 (+ 60us) client_negotiation.cc:769] Sending connection context
0811 05:07:45.320362 (+ 83us) client_negotiation.cc:240] Negotiation successful
0811 05:07:45.320506 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":90,"threads_started":1}
Aug 11 05:07:45 dist-test-slave-x5fp krb5kdc[30142](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424865, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 05:07:45 dist-test-slave-x5fp krb5kdc[30142](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424865, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
I20260811 05:07:45.349189 30291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:45.340067 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42248 (local address 127.26.191.254:41885)
0811 05:07:45.340231 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:45.340233 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:45.340278 (+ 45us) server_negotiation.cc:407] Connection header received
0811 05:07:45.340354 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:45.340355 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:45.340366 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:45.340428 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:45.341308 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:45.341834 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:45.342633 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:45.342834 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:45.342897 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:45.345769 (+ 2872us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:45.345770 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:45.345771 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:07:45.345780 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:45.347634 (+ 1854us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:45.348226 (+ 592us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:45.348228 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:45.348228 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:45.348306 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:45.348564 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:45.348565 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:45.348566 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:45.348704 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:45.348886 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:45.349031 (+ 145us) server_negotiation.cc:299] Negotiation successful
0811 05:07:45.349110 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 05:07:45.351512 30200 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42248:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 05:07:45.353893 30200 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 05:07:45.361272 31028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:45.356850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.193:42455 (local address 127.0.0.1:35746)
0811 05:07:45.357032 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:45.357078 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:45.357149 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:45.357652 (+ 503us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:45.357655 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:45.357658 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:07:45.357754 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:45.357756 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:45.359117 (+ 1361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:45.359118 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:45.360092 (+ 974us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:45.360095 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:45.360927 (+ 832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:45.360928 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:45.361016 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:45.361030 (+ 14us) client_negotiation.cc:769] Sending connection context
0811 05:07:45.361102 (+ 72us) client_negotiation.cc:240] Negotiation successful
0811 05:07:45.361166 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"mutex_wait_us":3,"thread_start_us":69,"threads_started":1}
I20260811 05:07:45.361505 31027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:45.357078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.195:43857 (local address 127.0.0.1:51926)
0811 05:07:45.357235 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:45.357244 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:45.357317 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:45.357763 (+ 446us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:45.357764 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:45.357767 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:07:45.357830 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:45.357831 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:45.359100 (+ 1269us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:45.359101 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:45.360216 (+ 1115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:45.360217 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:45.361201 (+ 984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:45.361202 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:45.361295 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:45.361301 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 05:07:45.361356 (+ 55us) client_negotiation.cc:240] Negotiation successful
0811 05:07:45.361409 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"mutex_wait_us":29,"thread_start_us":93,"threads_started":1}
I20260811 05:07:45.361577 31033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:45.357056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35746 (local address 127.26.191.193:42455)
0811 05:07:45.357409 (+ 353us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:45.357415 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:45.357429 (+ 14us) server_negotiation.cc:407] Connection header received
0811 05:07:45.357474 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:45.357476 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:45.357493 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:45.357573 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:07:45.357831 (+ 258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:45.359024 (+ 1193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:45.360192 (+ 1168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:45.360839 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:45.360930 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:45.360998 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:45.361416 (+ 418us) server_negotiation.cc:299] Negotiation successful
0811 05:07:45.361477 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":286,"thread_start_us":97,"threads_started":1}
I20260811 05:07:45.361930 31034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:45.356867 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.194:40153 (local address 127.0.0.1:52386)
0811 05:07:45.357219 (+ 352us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:45.357238 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:45.357300 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:45.357877 (+ 577us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:45.357877 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:45.357879 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:07:45.357920 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:45.357921 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:45.358764 (+ 843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:45.358766 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:45.360058 (+ 1292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:45.360061 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:45.361073 (+ 1012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:45.361074 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:45.361140 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:45.361143 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 05:07:45.361783 (+ 640us) client_negotiation.cc:240] Negotiation successful
0811 05:07:45.361841 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":326,"thread_start_us":104,"threads_started":1}
I20260811 05:07:45.362200 31030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:45.356996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52386 (local address 127.26.191.194:40153)
0811 05:07:45.357718 (+ 722us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:45.357724 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:45.357735 (+ 11us) server_negotiation.cc:407] Connection header received
0811 05:07:45.357785 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:45.357788 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:45.357805 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:45.357881 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:07:45.357976 (+ 95us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:45.358667 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:45.360163 (+ 1496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:45.360955 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:45.361071 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:45.361135 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:45.362040 (+ 905us) server_negotiation.cc:299] Negotiation successful
0811 05:07:45.362090 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":682,"thread_start_us":95,"threads_started":1}
I20260811 05:07:45.362442 30425 tablet_service.cc:1467] Processing CreateTablet for tablet 95f1a22917b940939b29557744ebe4e3 (DEFAULT_TABLE table=test-table [id=1dbff93be558442fbc120d03cd9a694e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:07:45.362859 30644 tablet_service.cc:1467] Processing CreateTablet for tablet 95f1a22917b940939b29557744ebe4e3 (DEFAULT_TABLE table=test-table [id=1dbff93be558442fbc120d03cd9a694e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:07:45.363013 30425 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 95f1a22917b940939b29557744ebe4e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:07:45.363224 30644 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 95f1a22917b940939b29557744ebe4e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:07:45.364974 31036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:45.357347 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51926 (local address 127.26.191.195:43857)
0811 05:07:45.357529 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:45.357534 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:45.357544 (+ 10us) server_negotiation.cc:407] Connection header received
0811 05:07:45.357584 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:45.357586 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:45.357601 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:45.357682 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:07:45.357920 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:45.359003 (+ 1083us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:45.360288 (+ 1285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:45.361053 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:45.361118 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:45.361162 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:45.364811 (+ 3649us) server_negotiation.cc:299] Negotiation successful
0811 05:07:45.364868 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":99,"threads_started":1}
I20260811 05:07:45.365832 30884 tablet_service.cc:1467] Processing CreateTablet for tablet 95f1a22917b940939b29557744ebe4e3 (DEFAULT_TABLE table=test-table [id=1dbff93be558442fbc120d03cd9a694e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:07:45.366250 30884 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 95f1a22917b940939b29557744ebe4e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:07:45.366513 31039 tablet_bootstrap.cc:492] T 95f1a22917b940939b29557744ebe4e3 P fb362415e802498aa60beb90898b5715: Bootstrap starting.
I20260811 05:07:45.367091 31039 tablet_bootstrap.cc:654] T 95f1a22917b940939b29557744ebe4e3 P fb362415e802498aa60beb90898b5715: Neither blocks nor log segments found. Creating new log.
I20260811 05:07:45.367408 31039 log.cc:824] T 95f1a22917b940939b29557744ebe4e3 P fb362415e802498aa60beb90898b5715: Log is configured to *not* fsync() on all Append() calls
I20260811 05:07:45.367835 31037 tablet_bootstrap.cc:492] T 95f1a22917b940939b29557744ebe4e3 P 60ebd7d2397f475ea3e0101349417482: Bootstrap starting.
I20260811 05:07:45.368294 31039 tablet_bootstrap.cc:492] T 95f1a22917b940939b29557744ebe4e3 P fb362415e802498aa60beb90898b5715: No bootstrap required, opened a new log
I20260811 05:07:45.368364 31039 ts_tablet_manager.cc:1397] T 95f1a22917b940939b29557744ebe4e3 P fb362415e802498aa60beb90898b5715: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 05:07:45.368517 31037 tablet_bootstrap.cc:654] T 95f1a22917b940939b29557744ebe4e3 P 60ebd7d2397f475ea3e0101349417482: Neither blocks nor log segments found. Creating new log.
I20260811 05:07:45.368886 31037 log.cc:824] T 95f1a22917b940939b29557744ebe4e3 P 60ebd7d2397f475ea3e0101349417482: Log is configured to *not* fsync() on all Append() calls
I20260811 05:07:45.369637 31044 tablet_bootstrap.cc:492] T 95f1a22917b940939b29557744ebe4e3 P 6190c451021542509c1ea69a4199d874: Bootstrap starting.
I20260811 05:07:45.369796 31037 tablet_bootstrap.cc:492] T 95f1a22917b940939b29557744ebe4e3 P 60ebd7d2397f475ea3e0101349417482: No bootstrap required, opened a new log
I20260811 05:07:45.369879 31037 ts_tablet_manager.cc:1397] T 95f1a22917b940939b29557744ebe4e3 P 60ebd7d2397f475ea3e0101349417482: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 05:07:45.370621 31044 tablet_bootstrap.cc:654] T 95f1a22917b940939b29557744ebe4e3 P 6190c451021542509c1ea69a4199d874: Neither blocks nor log segments found. Creating new log.
I20260811 05:07:45.370580 31039 raft_consensus.cc:348] T 95f1a22917b940939b29557744ebe4e3 P fb362415e802498aa60beb90898b5715 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60ebd7d2397f475ea3e0101349417482" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 42455 } } peers { permanent_uuid: "fb362415e802498aa60beb90898b5715" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40153 } } peers { permanent_uuid: "6190c451021542509c1ea69a4199d874" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 43857 } }
I20260811 05:07:45.370782 31039 raft_consensus.cc:374] T 95f1a22917b940939b29557744ebe4e3 P fb362415e802498aa60beb90898b5715 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:07:45.370833 31039 raft_consensus.cc:729] T 95f1a22917b940939b29557744ebe4e3 P fb362415e802498aa60beb90898b5715 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb362415e802498aa60beb90898b5715, State: Initialized, Role: FOLLOWER
I20260811 05:07:45.370985 31044 log.cc:824] T 95f1a22917b940939b29557744ebe4e3 P 6190c451021542509c1ea69a4199d874: Log is configured to *not* fsync() on all Append() calls
I20260811 05:07:45.370981 31039 consensus_queue.cc:260] T 95f1a22917b940939b29557744ebe4e3 P fb362415e802498aa60beb90898b5715 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60ebd7d2397f475ea3e0101349417482" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 42455 } } peers { permanent_uuid: "fb362415e802498aa60beb90898b5715" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40153 } } peers { permanent_uuid: "6190c451021542509c1ea69a4199d874" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 43857 } }
I20260811 05:07:45.371258 31039 ts_tablet_manager.cc:1428] T 95f1a22917b940939b29557744ebe4e3 P fb362415e802498aa60beb90898b5715: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 05:07:45.371306 30746 heartbeater.cc:503] Master 127.26.191.254:41885 was elected leader, sending a full tablet report...
I20260811 05:07:45.371905 31044 tablet_bootstrap.cc:492] T 95f1a22917b940939b29557744ebe4e3 P 6190c451021542509c1ea69a4199d874: No bootstrap required, opened a new log
I20260811 05:07:45.371980 31044 ts_tablet_manager.cc:1397] T 95f1a22917b940939b29557744ebe4e3 P 6190c451021542509c1ea69a4199d874: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 05:07:45.372013 31037 raft_consensus.cc:348] T 95f1a22917b940939b29557744ebe4e3 P 60ebd7d2397f475ea3e0101349417482 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60ebd7d2397f475ea3e0101349417482" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 42455 } } peers { permanent_uuid: "fb362415e802498aa60beb90898b5715" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40153 } } peers { permanent_uuid: "6190c451021542509c1ea69a4199d874" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 43857 } }
I20260811 05:07:45.372213 31037 raft_consensus.cc:374] T 95f1a22917b940939b29557744ebe4e3 P 60ebd7d2397f475ea3e0101349417482 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:07:45.372264 31037 raft_consensus.cc:729] T 95f1a22917b940939b29557744ebe4e3 P 60ebd7d2397f475ea3e0101349417482 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60ebd7d2397f475ea3e0101349417482, State: Initialized, Role: FOLLOWER
I20260811 05:07:45.372404 31037 consensus_queue.cc:260] T 95f1a22917b940939b29557744ebe4e3 P 60ebd7d2397f475ea3e0101349417482 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60ebd7d2397f475ea3e0101349417482" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 42455 } } peers { permanent_uuid: "fb362415e802498aa60beb90898b5715" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40153 } } peers { permanent_uuid: "6190c451021542509c1ea69a4199d874" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 43857 } }
I20260811 05:07:45.372767 31037 ts_tablet_manager.cc:1428] T 95f1a22917b940939b29557744ebe4e3 P 60ebd7d2397f475ea3e0101349417482: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 05:07:45.372920 30525 heartbeater.cc:503] Master 127.26.191.254:41885 was elected leader, sending a full tablet report...
I20260811 05:07:45.374323 31044 raft_consensus.cc:348] T 95f1a22917b940939b29557744ebe4e3 P 6190c451021542509c1ea69a4199d874 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60ebd7d2397f475ea3e0101349417482" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 42455 } } peers { permanent_uuid: "fb362415e802498aa60beb90898b5715" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40153 } } peers { permanent_uuid: "6190c451021542509c1ea69a4199d874" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 43857 } }
I20260811 05:07:45.374454 31044 raft_consensus.cc:374] T 95f1a22917b940939b29557744ebe4e3 P 6190c451021542509c1ea69a4199d874 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:07:45.374475 31044 raft_consensus.cc:729] T 95f1a22917b940939b29557744ebe4e3 P 6190c451021542509c1ea69a4199d874 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6190c451021542509c1ea69a4199d874, State: Initialized, Role: FOLLOWER
I20260811 05:07:45.374586 31044 consensus_queue.cc:260] T 95f1a22917b940939b29557744ebe4e3 P 6190c451021542509c1ea69a4199d874 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60ebd7d2397f475ea3e0101349417482" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 42455 } } peers { permanent_uuid: "fb362415e802498aa60beb90898b5715" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40153 } } peers { permanent_uuid: "6190c451021542509c1ea69a4199d874" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 43857 } }
I20260811 05:07:45.374873 31044 ts_tablet_manager.cc:1428] T 95f1a22917b940939b29557744ebe4e3 P 6190c451021542509c1ea69a4199d874: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 05:07:45.374954 30994 heartbeater.cc:503] Master 127.26.191.254:41885 was elected leader, sending a full tablet report...
W20260811 05:07:45.386003 30748 tablet.cc:2369] T 95f1a22917b940939b29557744ebe4e3 P fb362415e802498aa60beb90898b5715: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 05:07:45.429665 31050 raft_consensus.cc:482] T 95f1a22917b940939b29557744ebe4e3 P 6190c451021542509c1ea69a4199d874 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 05:07:45.429854 31050 raft_consensus.cc:504] T 95f1a22917b940939b29557744ebe4e3 P 6190c451021542509c1ea69a4199d874 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60ebd7d2397f475ea3e0101349417482" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 42455 } } peers { permanent_uuid: "fb362415e802498aa60beb90898b5715" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40153 } } peers { permanent_uuid: "6190c451021542509c1ea69a4199d874" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 43857 } }
I20260811 05:07:45.430197 31050 leader_election.cc:288] T 95f1a22917b940939b29557744ebe4e3 P 6190c451021542509c1ea69a4199d874 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60ebd7d2397f475ea3e0101349417482 (127.26.191.193:42455), fb362415e802498aa60beb90898b5715 (127.26.191.194:40153)
I20260811 05:07:45.434607 31030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:45.430604 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.195:40263 (local address 127.26.191.194:40153)
0811 05:07:45.430654 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:45.430656 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:45.430670 (+ 14us) server_negotiation.cc:407] Connection header received
0811 05:07:45.430753 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:45.430754 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:45.430765 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:45.430844 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:07:45.431038 (+ 194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:45.431875 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:45.433563 (+ 1688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:45.434145 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:45.434238 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:45.434248 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:45.434477 (+ 229us) server_negotiation.cc:299] Negotiation successful
0811 05:07:45.434520 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 05:07:45.434607 31033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:45.430655 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.195:40135 (local address 127.26.191.193:42455)
0811 05:07:45.430743 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:45.430745 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:45.430932 (+ 187us) server_negotiation.cc:407] Connection header received
0811 05:07:45.431015 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:45.431016 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:45.431029 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:45.431119 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:07:45.431340 (+ 221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:45.432088 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:45.433562 (+ 1474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:45.434151 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:45.434238 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:45.434248 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:45.434477 (+ 229us) server_negotiation.cc:299] Negotiation successful
0811 05:07:45.434520 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 05:07:45.434652 30807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:45.430488 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.194:40153 (local address 127.26.191.195:40263)
0811 05:07:45.430572 (+ 84us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:45.430588 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:45.430664 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:45.430867 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:45.430867 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:45.430869 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:07:45.430950 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:45.430952 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:45.431987 (+ 1035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:45.431988 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:45.433443 (+ 1455us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:45.433446 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:45.434281 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:45.434282 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:45.434385 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:45.434387 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 05:07:45.434460 (+ 73us) client_negotiation.cc:240] Negotiation successful
0811 05:07:45.434527 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":52,"mutex_wait_us":35}
I20260811 05:07:45.434659 31051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:45.430489 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.193:42455 (local address 127.26.191.195:40135)
0811 05:07:45.430835 (+ 346us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:45.430854 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:45.430944 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:45.431123 (+ 179us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:45.431124 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:45.431126 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:07:45.431239 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:45.431241 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:45.432190 (+ 949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:45.432191 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:45.433461 (+ 1270us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:45.433463 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:45.434276 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:45.434277 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:45.434375 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:45.434380 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 05:07:45.434460 (+ 80us) client_negotiation.cc:240] Negotiation successful
0811 05:07:45.434527 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":318,"mutex_wait_us":157,"thread_start_us":136,"threads_started":1}
I20260811 05:07:45.435130 30670 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95f1a22917b940939b29557744ebe4e3" candidate_uuid: "6190c451021542509c1ea69a4199d874" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb362415e802498aa60beb90898b5715" is_pre_election: true
I20260811 05:07:45.435148 30456 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95f1a22917b940939b29557744ebe4e3" candidate_uuid: "6190c451021542509c1ea69a4199d874" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60ebd7d2397f475ea3e0101349417482" is_pre_election: true
I20260811 05:07:45.435329 30670 raft_consensus.cc:2454] T 95f1a22917b940939b29557744ebe4e3 P fb362415e802498aa60beb90898b5715 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6190c451021542509c1ea69a4199d874 in term 0.
I20260811 05:07:45.435326 30456 raft_consensus.cc:2454] T 95f1a22917b940939b29557744ebe4e3 P 60ebd7d2397f475ea3e0101349417482 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6190c451021542509c1ea69a4199d874 in term 0.
I20260811 05:07:45.435606 30792 leader_election.cc:302] T 95f1a22917b940939b29557744ebe4e3 P 6190c451021542509c1ea69a4199d874 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60ebd7d2397f475ea3e0101349417482, 6190c451021542509c1ea69a4199d874; no voters:
I20260811 05:07:45.435771 31050 raft_consensus.cc:2781] T 95f1a22917b940939b29557744ebe4e3 P 6190c451021542509c1ea69a4199d874 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 05:07:45.435837 31050 raft_consensus.cc:482] T 95f1a22917b940939b29557744ebe4e3 P 6190c451021542509c1ea69a4199d874 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 05:07:45.435854 31050 raft_consensus.cc:3037] T 95f1a22917b940939b29557744ebe4e3 P 6190c451021542509c1ea69a4199d874 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:07:45.436645 31050 raft_consensus.cc:504] T 95f1a22917b940939b29557744ebe4e3 P 6190c451021542509c1ea69a4199d874 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60ebd7d2397f475ea3e0101349417482" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 42455 } } peers { permanent_uuid: "fb362415e802498aa60beb90898b5715" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40153 } } peers { permanent_uuid: "6190c451021542509c1ea69a4199d874" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 43857 } }
I20260811 05:07:45.436846 31050 leader_election.cc:288] T 95f1a22917b940939b29557744ebe4e3 P 6190c451021542509c1ea69a4199d874 [CANDIDATE]: Term 1 election: Requested vote from peers 60ebd7d2397f475ea3e0101349417482 (127.26.191.193:42455), fb362415e802498aa60beb90898b5715 (127.26.191.194:40153)
I20260811 05:07:45.437062 30670 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95f1a22917b940939b29557744ebe4e3" candidate_uuid: "6190c451021542509c1ea69a4199d874" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb362415e802498aa60beb90898b5715"
I20260811 05:07:45.437089 30456 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95f1a22917b940939b29557744ebe4e3" candidate_uuid: "6190c451021542509c1ea69a4199d874" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60ebd7d2397f475ea3e0101349417482"
I20260811 05:07:45.437158 30456 raft_consensus.cc:3037] T 95f1a22917b940939b29557744ebe4e3 P 60ebd7d2397f475ea3e0101349417482 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:07:45.437161 30670 raft_consensus.cc:3037] T 95f1a22917b940939b29557744ebe4e3 P fb362415e802498aa60beb90898b5715 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:07:45.437969 30456 raft_consensus.cc:2454] T 95f1a22917b940939b29557744ebe4e3 P 60ebd7d2397f475ea3e0101349417482 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6190c451021542509c1ea69a4199d874 in term 1.
I20260811 05:07:45.438130 30792 leader_election.cc:302] T 95f1a22917b940939b29557744ebe4e3 P 6190c451021542509c1ea69a4199d874 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60ebd7d2397f475ea3e0101349417482, 6190c451021542509c1ea69a4199d874; no voters:
I20260811 05:07:45.438143 30670 raft_consensus.cc:2454] T 95f1a22917b940939b29557744ebe4e3 P fb362415e802498aa60beb90898b5715 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6190c451021542509c1ea69a4199d874 in term 1.
I20260811 05:07:45.438237 31050 raft_consensus.cc:2781] T 95f1a22917b940939b29557744ebe4e3 P 6190c451021542509c1ea69a4199d874 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:07:45.438443 31050 raft_consensus.cc:686] T 95f1a22917b940939b29557744ebe4e3 P 6190c451021542509c1ea69a4199d874 [term 1 LEADER]: Becoming Leader. State: Replica: 6190c451021542509c1ea69a4199d874, State: Running, Role: LEADER
I20260811 05:07:45.438545 31050 consensus_queue.cc:237] T 95f1a22917b940939b29557744ebe4e3 P 6190c451021542509c1ea69a4199d874 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60ebd7d2397f475ea3e0101349417482" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 42455 } } peers { permanent_uuid: "fb362415e802498aa60beb90898b5715" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40153 } } peers { permanent_uuid: "6190c451021542509c1ea69a4199d874" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 43857 } }
I20260811 05:07:45.439551 30200 catalog_manager.cc:5495] T 95f1a22917b940939b29557744ebe4e3 P 6190c451021542509c1ea69a4199d874 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6190c451021542509c1ea69a4199d874 (127.26.191.195). New cstate: current_term: 1 leader_uuid: "6190c451021542509c1ea69a4199d874" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60ebd7d2397f475ea3e0101349417482" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 42455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fb362415e802498aa60beb90898b5715" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6190c451021542509c1ea69a4199d874" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 43857 } health_report { overall_health: HEALTHY } } }
W20260811 05:07:45.459831 30526 tablet.cc:2369] T 95f1a22917b940939b29557744ebe4e3 P 60ebd7d2397f475ea3e0101349417482: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 11 05:07:45 dist-test-slave-x5fp krb5kdc[30142](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424864, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.254@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
I20260811 05:07:45.478271 31065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:45.469596 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:41885 (local address 127.0.0.1:42256)
0811 05:07:45.469834 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:45.469844 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:45.469939 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:45.470124 (+ 185us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:45.470125 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:45.470497 (+ 372us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:07:45.470552 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:45.470555 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:45.471252 (+ 697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:45.471253 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:45.471791 (+ 538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:45.471792 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:45.472172 (+ 380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:45.472173 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:45.472225 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:45.472901 (+ 676us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:07:45.472907 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:07:45.474919 (+ 2012us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:07:45.476848 (+ 1929us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:07:45.476859 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:07:45.476862 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:07:45.477100 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:07:45.477387 (+ 287us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:07:45.477388 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:07:45.477389 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:07:45.477459 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:07:45.477930 (+ 471us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:07:45.477940 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:07:45.477988 (+ 48us) client_negotiation.cc:769] Sending connection context
0811 05:07:45.478062 (+ 74us) client_negotiation.cc:240] Negotiation successful
0811 05:07:45.478177 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":136,"threads_started":1}
I20260811 05:07:45.478386 30291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:45.469660 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42256 (local address 127.26.191.254:41885)
0811 05:07:45.469773 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:45.469775 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:45.469918 (+ 143us) server_negotiation.cc:407] Connection header received
0811 05:07:45.470026 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:45.470027 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:45.470039 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:45.470116 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:45.470651 (+ 535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:45.471154 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:45.471883 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:45.472082 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:45.472169 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:45.475062 (+ 2893us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:45.475063 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:45.475063 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:07:45.475071 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:45.476649 (+ 1578us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:45.477212 (+ 563us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:45.477214 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:45.477214 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:45.477289 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:45.477552 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:45.477554 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:45.477554 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:45.477786 (+ 232us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:45.477861 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:45.478127 (+ 266us) server_negotiation.cc:299] Negotiation successful
0811 05:07:45.478236 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":25,"server-negotiator.queue_time_us":81}
I20260811 05:07:45.480975 30200 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.26.191.254@KRBTEST.COM'} at 127.0.0.1:42256:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260811 05:07:45.481222 30200 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 05:07:45.483035 30425 tablet_service.cc:1467] Processing CreateTablet for tablet bdb063294bc0458e83612052120216a3 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=c973da023f1940368fa9e68fd6fc5008]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 05:07:45.483098 30644 tablet_service.cc:1467] Processing CreateTablet for tablet bdb063294bc0458e83612052120216a3 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=c973da023f1940368fa9e68fd6fc5008]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 05:07:45.483264 30425 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bdb063294bc0458e83612052120216a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:07:45.483263 30644 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bdb063294bc0458e83612052120216a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:07:45.483336 30884 tablet_service.cc:1467] Processing CreateTablet for tablet bdb063294bc0458e83612052120216a3 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=c973da023f1940368fa9e68fd6fc5008]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 05:07:45.483527 30884 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bdb063294bc0458e83612052120216a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:07:45.484750 31044 tablet_bootstrap.cc:492] T bdb063294bc0458e83612052120216a3 P 6190c451021542509c1ea69a4199d874: Bootstrap starting.
I20260811 05:07:45.484892 31039 tablet_bootstrap.cc:492] T bdb063294bc0458e83612052120216a3 P fb362415e802498aa60beb90898b5715: Bootstrap starting.
I20260811 05:07:45.484979 31037 tablet_bootstrap.cc:492] T bdb063294bc0458e83612052120216a3 P 60ebd7d2397f475ea3e0101349417482: Bootstrap starting.
I20260811 05:07:45.485211 31044 tablet_bootstrap.cc:654] T bdb063294bc0458e83612052120216a3 P 6190c451021542509c1ea69a4199d874: Neither blocks nor log segments found. Creating new log.
I20260811 05:07:45.485421 31037 tablet_bootstrap.cc:654] T bdb063294bc0458e83612052120216a3 P 60ebd7d2397f475ea3e0101349417482: Neither blocks nor log segments found. Creating new log.
I20260811 05:07:45.485670 31039 tablet_bootstrap.cc:654] T bdb063294bc0458e83612052120216a3 P fb362415e802498aa60beb90898b5715: Neither blocks nor log segments found. Creating new log.
I20260811 05:07:45.485978 31044 tablet_bootstrap.cc:492] T bdb063294bc0458e83612052120216a3 P 6190c451021542509c1ea69a4199d874: No bootstrap required, opened a new log
I20260811 05:07:45.486048 31044 ts_tablet_manager.cc:1397] T bdb063294bc0458e83612052120216a3 P 6190c451021542509c1ea69a4199d874: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 05:07:45.486218 31037 tablet_bootstrap.cc:492] T bdb063294bc0458e83612052120216a3 P 60ebd7d2397f475ea3e0101349417482: No bootstrap required, opened a new log
I20260811 05:07:45.486294 31037 ts_tablet_manager.cc:1397] T bdb063294bc0458e83612052120216a3 P 60ebd7d2397f475ea3e0101349417482: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 05:07:45.486227 31044 raft_consensus.cc:348] T bdb063294bc0458e83612052120216a3 P 6190c451021542509c1ea69a4199d874 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60ebd7d2397f475ea3e0101349417482" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 42455 } } peers { permanent_uuid: "fb362415e802498aa60beb90898b5715" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40153 } } peers { permanent_uuid: "6190c451021542509c1ea69a4199d874" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 43857 } }
I20260811 05:07:45.486332 31044 raft_consensus.cc:374] T bdb063294bc0458e83612052120216a3 P 6190c451021542509c1ea69a4199d874 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:07:45.486369 31044 raft_consensus.cc:729] T bdb063294bc0458e83612052120216a3 P 6190c451021542509c1ea69a4199d874 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6190c451021542509c1ea69a4199d874, State: Initialized, Role: FOLLOWER
I20260811 05:07:45.486424 31044 consensus_queue.cc:260] T bdb063294bc0458e83612052120216a3 P 6190c451021542509c1ea69a4199d874 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60ebd7d2397f475ea3e0101349417482" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 42455 } } peers { permanent_uuid: "fb362415e802498aa60beb90898b5715" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40153 } } peers { permanent_uuid: "6190c451021542509c1ea69a4199d874" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 43857 } }
I20260811 05:07:45.486531 31044 ts_tablet_manager.cc:1428] T bdb063294bc0458e83612052120216a3 P 6190c451021542509c1ea69a4199d874: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:45.486465 31037 raft_consensus.cc:348] T bdb063294bc0458e83612052120216a3 P 60ebd7d2397f475ea3e0101349417482 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60ebd7d2397f475ea3e0101349417482" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 42455 } } peers { permanent_uuid: "fb362415e802498aa60beb90898b5715" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40153 } } peers { permanent_uuid: "6190c451021542509c1ea69a4199d874" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 43857 } }
I20260811 05:07:45.486562 31037 raft_consensus.cc:374] T bdb063294bc0458e83612052120216a3 P 60ebd7d2397f475ea3e0101349417482 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:07:45.486582 31037 raft_consensus.cc:729] T bdb063294bc0458e83612052120216a3 P 60ebd7d2397f475ea3e0101349417482 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60ebd7d2397f475ea3e0101349417482, State: Initialized, Role: FOLLOWER
I20260811 05:07:45.486574 31050 tablet_replica.cc:439] T bdb063294bc0458e83612052120216a3 P 6190c451021542509c1ea69a4199d874: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60ebd7d2397f475ea3e0101349417482" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 42455 } } peers { permanent_uuid: "fb362415e802498aa60beb90898b5715" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40153 } } peers { permanent_uuid: "6190c451021542509c1ea69a4199d874" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 43857 } } }
I20260811 05:07:45.486640 31050 tablet_replica.cc:442] T bdb063294bc0458e83612052120216a3 P 6190c451021542509c1ea69a4199d874: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 05:07:45.486627 31037 consensus_queue.cc:260] T bdb063294bc0458e83612052120216a3 P 60ebd7d2397f475ea3e0101349417482 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60ebd7d2397f475ea3e0101349417482" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 42455 } } peers { permanent_uuid: "fb362415e802498aa60beb90898b5715" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40153 } } peers { permanent_uuid: "6190c451021542509c1ea69a4199d874" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 43857 } }
I20260811 05:07:45.486733 31037 ts_tablet_manager.cc:1428] T bdb063294bc0458e83612052120216a3 P 60ebd7d2397f475ea3e0101349417482: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:45.486799 31048 tablet_replica.cc:439] T bdb063294bc0458e83612052120216a3 P 60ebd7d2397f475ea3e0101349417482: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60ebd7d2397f475ea3e0101349417482" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 42455 } } peers { permanent_uuid: "fb362415e802498aa60beb90898b5715" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40153 } } peers { permanent_uuid: "6190c451021542509c1ea69a4199d874" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 43857 } } }
I20260811 05:07:45.486920 31048 tablet_replica.cc:442] T bdb063294bc0458e83612052120216a3 P 60ebd7d2397f475ea3e0101349417482: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 05:07:45.486953 31039 tablet_bootstrap.cc:492] T bdb063294bc0458e83612052120216a3 P fb362415e802498aa60beb90898b5715: No bootstrap required, opened a new log
I20260811 05:07:45.487003 31039 ts_tablet_manager.cc:1397] T bdb063294bc0458e83612052120216a3 P fb362415e802498aa60beb90898b5715: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260811 05:07:45.487156 31039 raft_consensus.cc:348] T bdb063294bc0458e83612052120216a3 P fb362415e802498aa60beb90898b5715 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60ebd7d2397f475ea3e0101349417482" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 42455 } } peers { permanent_uuid: "fb362415e802498aa60beb90898b5715" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40153 } } peers { permanent_uuid: "6190c451021542509c1ea69a4199d874" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 43857 } }
I20260811 05:07:45.487272 31039 raft_consensus.cc:374] T bdb063294bc0458e83612052120216a3 P fb362415e802498aa60beb90898b5715 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:07:45.487295 31039 raft_consensus.cc:729] T bdb063294bc0458e83612052120216a3 P fb362415e802498aa60beb90898b5715 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb362415e802498aa60beb90898b5715, State: Initialized, Role: FOLLOWER
I20260811 05:07:45.487342 31039 consensus_queue.cc:260] T bdb063294bc0458e83612052120216a3 P fb362415e802498aa60beb90898b5715 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60ebd7d2397f475ea3e0101349417482" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 42455 } } peers { permanent_uuid: "fb362415e802498aa60beb90898b5715" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40153 } } peers { permanent_uuid: "6190c451021542509c1ea69a4199d874" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 43857 } }
I20260811 05:07:45.487450 31039 ts_tablet_manager.cc:1428] T bdb063294bc0458e83612052120216a3 P fb362415e802498aa60beb90898b5715: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260811 05:07:45.487512 31046 tablet_replica.cc:439] T bdb063294bc0458e83612052120216a3 P fb362415e802498aa60beb90898b5715: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60ebd7d2397f475ea3e0101349417482" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 42455 } } peers { permanent_uuid: "fb362415e802498aa60beb90898b5715" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40153 } } peers { permanent_uuid: "6190c451021542509c1ea69a4199d874" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 43857 } } }
I20260811 05:07:45.487591 31046 tablet_replica.cc:442] T bdb063294bc0458e83612052120216a3 P fb362415e802498aa60beb90898b5715: This TxnStatusTablet replica's current role is: FOLLOWER
W20260811 05:07:45.559026 30995 tablet.cc:2369] T 95f1a22917b940939b29557744ebe4e3 P 6190c451021542509c1ea69a4199d874: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 05:07:45.661089 31050 raft_consensus.cc:482] T bdb063294bc0458e83612052120216a3 P 6190c451021542509c1ea69a4199d874 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 05:07:45.661211 31050 raft_consensus.cc:504] T bdb063294bc0458e83612052120216a3 P 6190c451021542509c1ea69a4199d874 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60ebd7d2397f475ea3e0101349417482" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 42455 } } peers { permanent_uuid: "fb362415e802498aa60beb90898b5715" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40153 } } peers { permanent_uuid: "6190c451021542509c1ea69a4199d874" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 43857 } }
I20260811 05:07:45.661412 31050 leader_election.cc:288] T bdb063294bc0458e83612052120216a3 P 6190c451021542509c1ea69a4199d874 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60ebd7d2397f475ea3e0101349417482 (127.26.191.193:42455), fb362415e802498aa60beb90898b5715 (127.26.191.194:40153)
I20260811 05:07:45.661679 30456 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bdb063294bc0458e83612052120216a3" candidate_uuid: "6190c451021542509c1ea69a4199d874" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60ebd7d2397f475ea3e0101349417482" is_pre_election: true
I20260811 05:07:45.661773 30456 raft_consensus.cc:2454] T bdb063294bc0458e83612052120216a3 P 60ebd7d2397f475ea3e0101349417482 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6190c451021542509c1ea69a4199d874 in term 0.
I20260811 05:07:45.661746 30670 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bdb063294bc0458e83612052120216a3" candidate_uuid: "6190c451021542509c1ea69a4199d874" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb362415e802498aa60beb90898b5715" is_pre_election: true
I20260811 05:07:45.661914 30670 raft_consensus.cc:2454] T bdb063294bc0458e83612052120216a3 P fb362415e802498aa60beb90898b5715 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6190c451021542509c1ea69a4199d874 in term 0.
I20260811 05:07:45.661988 30792 leader_election.cc:302] T bdb063294bc0458e83612052120216a3 P 6190c451021542509c1ea69a4199d874 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60ebd7d2397f475ea3e0101349417482, 6190c451021542509c1ea69a4199d874; no voters:
I20260811 05:07:45.662107 31050 raft_consensus.cc:2781] T bdb063294bc0458e83612052120216a3 P 6190c451021542509c1ea69a4199d874 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 05:07:45.662158 31050 raft_consensus.cc:482] T bdb063294bc0458e83612052120216a3 P 6190c451021542509c1ea69a4199d874 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 05:07:45.662173 31050 raft_consensus.cc:3037] T bdb063294bc0458e83612052120216a3 P 6190c451021542509c1ea69a4199d874 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:07:45.662878 31050 raft_consensus.cc:504] T bdb063294bc0458e83612052120216a3 P 6190c451021542509c1ea69a4199d874 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60ebd7d2397f475ea3e0101349417482" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 42455 } } peers { permanent_uuid: "fb362415e802498aa60beb90898b5715" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40153 } } peers { permanent_uuid: "6190c451021542509c1ea69a4199d874" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 43857 } }
I20260811 05:07:45.663064 31050 leader_election.cc:288] T bdb063294bc0458e83612052120216a3 P 6190c451021542509c1ea69a4199d874 [CANDIDATE]: Term 1 election: Requested vote from peers 60ebd7d2397f475ea3e0101349417482 (127.26.191.193:42455), fb362415e802498aa60beb90898b5715 (127.26.191.194:40153)
I20260811 05:07:45.663219 30456 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bdb063294bc0458e83612052120216a3" candidate_uuid: "6190c451021542509c1ea69a4199d874" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60ebd7d2397f475ea3e0101349417482"
I20260811 05:07:45.663254 30670 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bdb063294bc0458e83612052120216a3" candidate_uuid: "6190c451021542509c1ea69a4199d874" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb362415e802498aa60beb90898b5715"
I20260811 05:07:45.663343 30670 raft_consensus.cc:3037] T bdb063294bc0458e83612052120216a3 P fb362415e802498aa60beb90898b5715 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:07:45.663348 30456 raft_consensus.cc:3037] T bdb063294bc0458e83612052120216a3 P 60ebd7d2397f475ea3e0101349417482 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:07:45.663978 30670 raft_consensus.cc:2454] T bdb063294bc0458e83612052120216a3 P fb362415e802498aa60beb90898b5715 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6190c451021542509c1ea69a4199d874 in term 1.
I20260811 05:07:45.664103 30456 raft_consensus.cc:2454] T bdb063294bc0458e83612052120216a3 P 60ebd7d2397f475ea3e0101349417482 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6190c451021542509c1ea69a4199d874 in term 1.
I20260811 05:07:45.664170 30794 leader_election.cc:302] T bdb063294bc0458e83612052120216a3 P 6190c451021542509c1ea69a4199d874 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6190c451021542509c1ea69a4199d874, fb362415e802498aa60beb90898b5715; no voters:
I20260811 05:07:45.664288 31050 raft_consensus.cc:2781] T bdb063294bc0458e83612052120216a3 P 6190c451021542509c1ea69a4199d874 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:07:45.664342 31050 raft_consensus.cc:686] T bdb063294bc0458e83612052120216a3 P 6190c451021542509c1ea69a4199d874 [term 1 LEADER]: Becoming Leader. State: Replica: 6190c451021542509c1ea69a4199d874, State: Running, Role: LEADER
I20260811 05:07:45.664395 31050 consensus_queue.cc:237] T bdb063294bc0458e83612052120216a3 P 6190c451021542509c1ea69a4199d874 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60ebd7d2397f475ea3e0101349417482" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 42455 } } peers { permanent_uuid: "fb362415e802498aa60beb90898b5715" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40153 } } peers { permanent_uuid: "6190c451021542509c1ea69a4199d874" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 43857 } }
I20260811 05:07:45.664763 31055 tablet_replica.cc:439] T bdb063294bc0458e83612052120216a3 P 6190c451021542509c1ea69a4199d874: TxnStatusTablet state changed. Reason: New leader 6190c451021542509c1ea69a4199d874. Latest consensus state: current_term: 1 leader_uuid: "6190c451021542509c1ea69a4199d874" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60ebd7d2397f475ea3e0101349417482" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 42455 } } peers { permanent_uuid: "fb362415e802498aa60beb90898b5715" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40153 } } peers { permanent_uuid: "6190c451021542509c1ea69a4199d874" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 43857 } } }
I20260811 05:07:45.664861 31055 tablet_replica.cc:442] T bdb063294bc0458e83612052120216a3 P 6190c451021542509c1ea69a4199d874: This TxnStatusTablet replica's current role is: LEADER
I20260811 05:07:45.665105 31070 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260811 05:07:45.665107 30199 catalog_manager.cc:5495] T bdb063294bc0458e83612052120216a3 P 6190c451021542509c1ea69a4199d874 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6190c451021542509c1ea69a4199d874 (127.26.191.195). New cstate: current_term: 1 leader_uuid: "6190c451021542509c1ea69a4199d874" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60ebd7d2397f475ea3e0101349417482" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 42455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fb362415e802498aa60beb90898b5715" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6190c451021542509c1ea69a4199d874" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 43857 } health_report { overall_health: HEALTHY } } }
I20260811 05:07:45.665257 31070 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260811 05:07:45.674641 31065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:45.671876 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.195:43857 (local address 127.0.0.1:51934)
0811 05:07:45.671955 (+ 79us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:45.671967 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:45.672019 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:45.672193 (+ 174us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:45.672194 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:45.672195 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 05:07:45.672267 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:45.672270 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:45.673053 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:45.673055 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:45.673647 (+ 592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:45.673649 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:45.674042 (+ 393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:45.674043 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:45.674118 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:45.674144 (+ 26us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 05:07:45.674449 (+ 305us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 05:07:45.674460 (+ 11us) client_negotiation.cc:769] Sending connection context
0811 05:07:45.674513 (+ 53us) client_negotiation.cc:240] Negotiation successful
0811 05:07:45.674569 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260811 05:07:45.674639 31036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:45.671979 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51934 (local address 127.26.191.195:43857)
0811 05:07:45.672035 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:45.672042 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:45.672054 (+ 12us) server_negotiation.cc:407] Connection header received
0811 05:07:45.672096 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:45.672097 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:45.672118 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:45.672182 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:07:45.672363 (+ 181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:45.672964 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:45.673758 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:45.673963 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:45.674041 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:45.674260 (+ 219us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:07:45.674371 (+ 111us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:07:45.674461 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:45.674520 (+ 59us) server_negotiation.cc:299] Negotiation successful
0811 05:07:45.674547 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 05:07:45.677299 30670 raft_consensus.cc:1261] T bdb063294bc0458e83612052120216a3 P fb362415e802498aa60beb90898b5715 [term 1 FOLLOWER]: Refusing update from remote peer 6190c451021542509c1ea69a4199d874: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:07:45.677367 30456 raft_consensus.cc:1261] T bdb063294bc0458e83612052120216a3 P 60ebd7d2397f475ea3e0101349417482 [term 1 FOLLOWER]: Refusing update from remote peer 6190c451021542509c1ea69a4199d874: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:07:45.677676 31050 consensus_queue.cc:1035] T bdb063294bc0458e83612052120216a3 P 6190c451021542509c1ea69a4199d874 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb362415e802498aa60beb90898b5715" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:07:45.677805 31055 consensus_queue.cc:1035] T bdb063294bc0458e83612052120216a3 P 6190c451021542509c1ea69a4199d874 [LEADER]: Connected to new peer: Peer: permanent_uuid: "60ebd7d2397f475ea3e0101349417482" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 42455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:07:45.679044 31046 tablet_replica.cc:439] T bdb063294bc0458e83612052120216a3 P fb362415e802498aa60beb90898b5715: TxnStatusTablet state changed. Reason: New leader 6190c451021542509c1ea69a4199d874. Latest consensus state: current_term: 1 leader_uuid: "6190c451021542509c1ea69a4199d874" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60ebd7d2397f475ea3e0101349417482" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 42455 } } peers { permanent_uuid: "fb362415e802498aa60beb90898b5715" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40153 } } peers { permanent_uuid: "6190c451021542509c1ea69a4199d874" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 43857 } } }
I20260811 05:07:45.679060 31048 tablet_replica.cc:439] T bdb063294bc0458e83612052120216a3 P 60ebd7d2397f475ea3e0101349417482: TxnStatusTablet state changed. Reason: New leader 6190c451021542509c1ea69a4199d874. Latest consensus state: current_term: 1 leader_uuid: "6190c451021542509c1ea69a4199d874" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60ebd7d2397f475ea3e0101349417482" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 42455 } } peers { permanent_uuid: "fb362415e802498aa60beb90898b5715" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40153 } } peers { permanent_uuid: "6190c451021542509c1ea69a4199d874" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 43857 } } }
I20260811 05:07:45.679144 31046 tablet_replica.cc:442] T bdb063294bc0458e83612052120216a3 P fb362415e802498aa60beb90898b5715: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 05:07:45.679157 31048 tablet_replica.cc:442] T bdb063294bc0458e83612052120216a3 P 60ebd7d2397f475ea3e0101349417482: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 05:07:45.680400 31055 tablet_replica.cc:439] T bdb063294bc0458e83612052120216a3 P 6190c451021542509c1ea69a4199d874: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6190c451021542509c1ea69a4199d874" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60ebd7d2397f475ea3e0101349417482" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 42455 } } peers { permanent_uuid: "fb362415e802498aa60beb90898b5715" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40153 } } peers { permanent_uuid: "6190c451021542509c1ea69a4199d874" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 43857 } } }
I20260811 05:07:45.680503 31055 tablet_replica.cc:442] T bdb063294bc0458e83612052120216a3 P 6190c451021542509c1ea69a4199d874: This TxnStatusTablet replica's current role is: LEADER
I20260811 05:07:45.680632 31046 tablet_replica.cc:439] T bdb063294bc0458e83612052120216a3 P fb362415e802498aa60beb90898b5715: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6190c451021542509c1ea69a4199d874" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60ebd7d2397f475ea3e0101349417482" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 42455 } } peers { permanent_uuid: "fb362415e802498aa60beb90898b5715" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40153 } } peers { permanent_uuid: "6190c451021542509c1ea69a4199d874" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 43857 } } }
I20260811 05:07:45.680763 31046 tablet_replica.cc:442] T bdb063294bc0458e83612052120216a3 P fb362415e802498aa60beb90898b5715: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 05:07:45.686198 31055 tablet_replica.cc:439] T bdb063294bc0458e83612052120216a3 P 6190c451021542509c1ea69a4199d874: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6190c451021542509c1ea69a4199d874" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60ebd7d2397f475ea3e0101349417482" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 42455 } } peers { permanent_uuid: "fb362415e802498aa60beb90898b5715" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40153 } } peers { permanent_uuid: "6190c451021542509c1ea69a4199d874" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 43857 } } }
I20260811 05:07:45.686364 31055 tablet_replica.cc:442] T bdb063294bc0458e83612052120216a3 P 6190c451021542509c1ea69a4199d874: This TxnStatusTablet replica's current role is: LEADER
I20260811 05:07:45.686946 31076 mvcc.cc:205] Tried to move back new op lower bound from 7317196249809428480 to 7317196249761812480. Current Snapshot: MvccSnapshot[applied={T|T < 7317196249809428480}]
I20260811 05:07:45.687057 31048 tablet_replica.cc:439] T bdb063294bc0458e83612052120216a3 P 60ebd7d2397f475ea3e0101349417482: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6190c451021542509c1ea69a4199d874" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60ebd7d2397f475ea3e0101349417482" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 42455 } } peers { permanent_uuid: "fb362415e802498aa60beb90898b5715" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40153 } } peers { permanent_uuid: "6190c451021542509c1ea69a4199d874" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 43857 } } }
I20260811 05:07:45.687130 31048 tablet_replica.cc:442] T bdb063294bc0458e83612052120216a3 P 60ebd7d2397f475ea3e0101349417482: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 05:07:45.689077 31036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:45.685393 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51944 (local address 127.26.191.195:43857)
0811 05:07:45.685468 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:45.685471 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:45.685483 (+ 12us) server_negotiation.cc:407] Connection header received
0811 05:07:45.685515 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:45.685516 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:45.685529 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:45.685602 (+ 73us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:07:45.685796 (+ 194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:45.686703 (+ 907us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:45.688292 (+ 1589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:45.688541 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:45.688626 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:45.688823 (+ 197us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:07:45.688859 (+ 36us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:07:45.688903 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:45.688960 (+ 57us) server_negotiation.cc:299] Negotiation successful
0811 05:07:45.688983 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 05:07:45.695164 31006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:45.691931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.195:43857 (local address 127.26.191.195:39493)
0811 05:07:45.692043 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:45.692056 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:45.692146 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:45.692506 (+ 360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:45.692508 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:45.692509 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 05:07:45.692585 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:45.692587 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:45.693283 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:45.693284 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:45.694167 (+ 883us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:45.694170 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:45.694626 (+ 456us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:45.694628 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:45.694713 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:45.694737 (+ 24us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 05:07:45.694985 (+ 248us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 05:07:45.694987 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 05:07:45.695041 (+ 54us) client_negotiation.cc:240] Negotiation successful
0811 05:07:45.695090 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":62,"mutex_wait_us":1}
I20260811 05:07:45.695164 31036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:45.692073 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.195:39493 (local address 127.26.191.195:43857)
0811 05:07:45.692133 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:45.692135 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:45.692146 (+ 11us) server_negotiation.cc:407] Connection header received
0811 05:07:45.692390 (+ 244us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:45.692392 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:45.692418 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:45.692502 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:07:45.692667 (+ 165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:45.693186 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:45.694310 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:45.694530 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:45.694614 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:45.694869 (+ 255us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:07:45.694915 (+ 46us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:07:45.694983 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:45.695041 (+ 58us) server_negotiation.cc:299] Negotiation successful
0811 05:07:45.695066 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":39}
I20260811 05:07:45.698017 30456 raft_consensus.cc:1261] T 95f1a22917b940939b29557744ebe4e3 P 60ebd7d2397f475ea3e0101349417482 [term 1 FOLLOWER]: Refusing update from remote peer 6190c451021542509c1ea69a4199d874: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:07:45.698021 30670 raft_consensus.cc:1261] T 95f1a22917b940939b29557744ebe4e3 P fb362415e802498aa60beb90898b5715 [term 1 FOLLOWER]: Refusing update from remote peer 6190c451021542509c1ea69a4199d874: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:07:45.698275 31082 consensus_queue.cc:1035] T 95f1a22917b940939b29557744ebe4e3 P 6190c451021542509c1ea69a4199d874 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb362415e802498aa60beb90898b5715" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:07:45.698446 31082 consensus_queue.cc:1035] T 95f1a22917b940939b29557744ebe4e3 P 6190c451021542509c1ea69a4199d874 [LEADER]: Connected to new peer: Peer: permanent_uuid: "60ebd7d2397f475ea3e0101349417482" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 42455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:07:45.699961 31073 mvcc.cc:205] Tried to move back new op lower bound from 7317196249897406464 to 7317196248837054464. Current Snapshot: MvccSnapshot[applied={T|T < 7317196249897406464}]
I20260811 05:07:45.714783 30199 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42248:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:07:45.714910 30199 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42248:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:07:45.716054 30199 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1f0bd85d319f49448cda2b835175d76a: Sending DeleteTablet for 3 replicas of tablet 95f1a22917b940939b29557744ebe4e3
I20260811 05:07:45.716399 30425 tablet_service.cc:1514] Processing DeleteTablet for tablet 95f1a22917b940939b29557744ebe4e3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:07:45 UTC) from {username='kudu', principal='kudu/127.26.191.254@KRBTEST.COM'} at 127.0.0.1:35746
I20260811 05:07:45.716595 30884 tablet_service.cc:1514] Processing DeleteTablet for tablet 95f1a22917b940939b29557744ebe4e3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:07:45 UTC) from {username='kudu', principal='kudu/127.26.191.254@KRBTEST.COM'} at 127.0.0.1:51926
I20260811 05:07:45.716672 30644 tablet_service.cc:1514] Processing DeleteTablet for tablet 95f1a22917b940939b29557744ebe4e3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:07:45 UTC) from {username='kudu', principal='kudu/127.26.191.254@KRBTEST.COM'} at 127.0.0.1:52386
I20260811 05:07:45.716650 30199 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42248:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 05:07:45.716850 30199 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 05:07:45.716897 31094 tablet_replica.cc:330] T 95f1a22917b940939b29557744ebe4e3 P 6190c451021542509c1ea69a4199d874: stopping tablet replica
I20260811 05:07:45.716965 31095 tablet_replica.cc:330] T 95f1a22917b940939b29557744ebe4e3 P fb362415e802498aa60beb90898b5715: stopping tablet replica
I20260811 05:07:45.717011 31094 raft_consensus.cc:2229] T 95f1a22917b940939b29557744ebe4e3 P 6190c451021542509c1ea69a4199d874 [term 1 LEADER]: Raft consensus shutting down.
I20260811 05:07:45.717146 31094 raft_consensus.cc:2258] T 95f1a22917b940939b29557744ebe4e3 P 6190c451021542509c1ea69a4199d874 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:07:45.717326 31095 raft_consensus.cc:2229] T 95f1a22917b940939b29557744ebe4e3 P fb362415e802498aa60beb90898b5715 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 05:07:45.717417 31095 raft_consensus.cc:2258] T 95f1a22917b940939b29557744ebe4e3 P fb362415e802498aa60beb90898b5715 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:07:45.717861 31095 ts_tablet_manager.cc:1905] T 95f1a22917b940939b29557744ebe4e3 P fb362415e802498aa60beb90898b5715: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:07:45.718226 30425 tablet_service.cc:1467] Processing CreateTablet for tablet b4e026dbf9b24e1a917ebd41dc2be071 (DEFAULT_TABLE table=test-table [id=7eb515c779c74732a97b76df7f164cf7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:07:45.718279 30644 tablet_service.cc:1467] Processing CreateTablet for tablet b4e026dbf9b24e1a917ebd41dc2be071 (DEFAULT_TABLE table=test-table [id=7eb515c779c74732a97b76df7f164cf7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:07:45.718384 30425 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b4e026dbf9b24e1a917ebd41dc2be071. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:07:45.718392 30644 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b4e026dbf9b24e1a917ebd41dc2be071. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:07:45.719786 30884 tablet_service.cc:1467] Processing CreateTablet for tablet b4e026dbf9b24e1a917ebd41dc2be071 (DEFAULT_TABLE table=test-table [id=7eb515c779c74732a97b76df7f164cf7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:07:45.719920 30884 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b4e026dbf9b24e1a917ebd41dc2be071. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:07:45.720041 31037 tablet_bootstrap.cc:492] T b4e026dbf9b24e1a917ebd41dc2be071 P 60ebd7d2397f475ea3e0101349417482: Bootstrap starting.
I20260811 05:07:45.720122 31095 ts_tablet_manager.cc:1918] T 95f1a22917b940939b29557744ebe4e3 P fb362415e802498aa60beb90898b5715: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 05:07:45.720271 31095 log.cc:1196] T 95f1a22917b940939b29557744ebe4e3 P fb362415e802498aa60beb90898b5715: Deleting WAL directory at /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/minicluster-data/ts-1/wal/wals/95f1a22917b940939b29557744ebe4e3
I20260811 05:07:45.720472 31037 tablet_bootstrap.cc:654] T b4e026dbf9b24e1a917ebd41dc2be071 P 60ebd7d2397f475ea3e0101349417482: Neither blocks nor log segments found. Creating new log.
I20260811 05:07:45.720700 31095 ts_tablet_manager.cc:1939] T 95f1a22917b940939b29557744ebe4e3 P fb362415e802498aa60beb90898b5715: Deleting consensus metadata
I20260811 05:07:45.721532 31044 tablet_bootstrap.cc:492] T b4e026dbf9b24e1a917ebd41dc2be071 P 6190c451021542509c1ea69a4199d874: Bootstrap starting.
I20260811 05:07:45.721565 31039 tablet_bootstrap.cc:492] T b4e026dbf9b24e1a917ebd41dc2be071 P fb362415e802498aa60beb90898b5715: Bootstrap starting.
I20260811 05:07:45.722211 31044 tablet_bootstrap.cc:654] T b4e026dbf9b24e1a917ebd41dc2be071 P 6190c451021542509c1ea69a4199d874: Neither blocks nor log segments found. Creating new log.
I20260811 05:07:45.722230 31039 tablet_bootstrap.cc:654] T b4e026dbf9b24e1a917ebd41dc2be071 P fb362415e802498aa60beb90898b5715: Neither blocks nor log segments found. Creating new log.
I20260811 05:07:45.722934 30183 catalog_manager.cc:4841] TS fb362415e802498aa60beb90898b5715 (127.26.191.194:40153): tablet 95f1a22917b940939b29557744ebe4e3 (table test-table [id=1dbff93be558442fbc120d03cd9a694e]) successfully deleted
I20260811 05:07:45.723126 31044 tablet_bootstrap.cc:492] T b4e026dbf9b24e1a917ebd41dc2be071 P 6190c451021542509c1ea69a4199d874: No bootstrap required, opened a new log
I20260811 05:07:45.723127 31039 tablet_bootstrap.cc:492] T b4e026dbf9b24e1a917ebd41dc2be071 P fb362415e802498aa60beb90898b5715: No bootstrap required, opened a new log
I20260811 05:07:45.723173 31044 ts_tablet_manager.cc:1397] T b4e026dbf9b24e1a917ebd41dc2be071 P 6190c451021542509c1ea69a4199d874: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 05:07:45.723176 31039 ts_tablet_manager.cc:1397] T b4e026dbf9b24e1a917ebd41dc2be071 P fb362415e802498aa60beb90898b5715: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260811 05:07:45.723361 31039 raft_consensus.cc:348] T b4e026dbf9b24e1a917ebd41dc2be071 P fb362415e802498aa60beb90898b5715 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60ebd7d2397f475ea3e0101349417482" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 42455 } } peers { permanent_uuid: "fb362415e802498aa60beb90898b5715" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40153 } } peers { permanent_uuid: "6190c451021542509c1ea69a4199d874" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 43857 } }
I20260811 05:07:45.723435 31039 raft_consensus.cc:374] T b4e026dbf9b24e1a917ebd41dc2be071 P fb362415e802498aa60beb90898b5715 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:07:45.723476 31039 raft_consensus.cc:729] T b4e026dbf9b24e1a917ebd41dc2be071 P fb362415e802498aa60beb90898b5715 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb362415e802498aa60beb90898b5715, State: Initialized, Role: FOLLOWER
I20260811 05:07:45.723505 31094 ts_tablet_manager.cc:1905] T 95f1a22917b940939b29557744ebe4e3 P 6190c451021542509c1ea69a4199d874: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:07:45.723522 31039 consensus_queue.cc:260] T b4e026dbf9b24e1a917ebd41dc2be071 P fb362415e802498aa60beb90898b5715 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60ebd7d2397f475ea3e0101349417482" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 42455 } } peers { permanent_uuid: "fb362415e802498aa60beb90898b5715" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40153 } } peers { permanent_uuid: "6190c451021542509c1ea69a4199d874" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 43857 } }
I20260811 05:07:45.723559 31044 raft_consensus.cc:348] T b4e026dbf9b24e1a917ebd41dc2be071 P 6190c451021542509c1ea69a4199d874 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60ebd7d2397f475ea3e0101349417482" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 42455 } } peers { permanent_uuid: "fb362415e802498aa60beb90898b5715" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40153 } } peers { permanent_uuid: "6190c451021542509c1ea69a4199d874" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 43857 } }
I20260811 05:07:45.723634 31044 raft_consensus.cc:374] T b4e026dbf9b24e1a917ebd41dc2be071 P 6190c451021542509c1ea69a4199d874 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:07:45.723650 31039 ts_tablet_manager.cc:1428] T b4e026dbf9b24e1a917ebd41dc2be071 P fb362415e802498aa60beb90898b5715: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260811 05:07:45.723654 31044 raft_consensus.cc:729] T b4e026dbf9b24e1a917ebd41dc2be071 P 6190c451021542509c1ea69a4199d874 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6190c451021542509c1ea69a4199d874, State: Initialized, Role: FOLLOWER
I20260811 05:07:45.723737 31044 consensus_queue.cc:260] T b4e026dbf9b24e1a917ebd41dc2be071 P 6190c451021542509c1ea69a4199d874 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60ebd7d2397f475ea3e0101349417482" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 42455 } } peers { permanent_uuid: "fb362415e802498aa60beb90898b5715" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40153 } } peers { permanent_uuid: "6190c451021542509c1ea69a4199d874" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 43857 } }
I20260811 05:07:45.723873 31044 ts_tablet_manager.cc:1428] T b4e026dbf9b24e1a917ebd41dc2be071 P 6190c451021542509c1ea69a4199d874: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 05:07:45.724005 31046 raft_consensus.cc:482] T b4e026dbf9b24e1a917ebd41dc2be071 P fb362415e802498aa60beb90898b5715 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 05:07:45.724063 31046 raft_consensus.cc:504] T b4e026dbf9b24e1a917ebd41dc2be071 P fb362415e802498aa60beb90898b5715 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60ebd7d2397f475ea3e0101349417482" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 42455 } } peers { permanent_uuid: "fb362415e802498aa60beb90898b5715" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40153 } } peers { permanent_uuid: "6190c451021542509c1ea69a4199d874" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 43857 } }
I20260811 05:07:45.724392 31046 leader_election.cc:288] T b4e026dbf9b24e1a917ebd41dc2be071 P fb362415e802498aa60beb90898b5715 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60ebd7d2397f475ea3e0101349417482 (127.26.191.193:42455), 6190c451021542509c1ea69a4199d874 (127.26.191.195:43857)
I20260811 05:07:45.726534 31094 ts_tablet_manager.cc:1918] T 95f1a22917b940939b29557744ebe4e3 P 6190c451021542509c1ea69a4199d874: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 05:07:45.726694 31094 log.cc:1196] T 95f1a22917b940939b29557744ebe4e3 P 6190c451021542509c1ea69a4199d874: Deleting WAL directory at /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/minicluster-data/ts-2/wal/wals/95f1a22917b940939b29557744ebe4e3
I20260811 05:07:45.726816 31037 tablet_bootstrap.cc:492] T b4e026dbf9b24e1a917ebd41dc2be071 P 60ebd7d2397f475ea3e0101349417482: No bootstrap required, opened a new log
I20260811 05:07:45.726889 31037 ts_tablet_manager.cc:1397] T b4e026dbf9b24e1a917ebd41dc2be071 P 60ebd7d2397f475ea3e0101349417482: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.000s
I20260811 05:07:45.727058 31037 raft_consensus.cc:348] T b4e026dbf9b24e1a917ebd41dc2be071 P 60ebd7d2397f475ea3e0101349417482 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60ebd7d2397f475ea3e0101349417482" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 42455 } } peers { permanent_uuid: "fb362415e802498aa60beb90898b5715" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40153 } } peers { permanent_uuid: "6190c451021542509c1ea69a4199d874" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 43857 } }
I20260811 05:07:45.727140 31037 raft_consensus.cc:374] T b4e026dbf9b24e1a917ebd41dc2be071 P 60ebd7d2397f475ea3e0101349417482 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:07:45.727160 31037 raft_consensus.cc:729] T b4e026dbf9b24e1a917ebd41dc2be071 P 60ebd7d2397f475ea3e0101349417482 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60ebd7d2397f475ea3e0101349417482, State: Initialized, Role: FOLLOWER
I20260811 05:07:45.727206 31037 consensus_queue.cc:260] T b4e026dbf9b24e1a917ebd41dc2be071 P 60ebd7d2397f475ea3e0101349417482 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60ebd7d2397f475ea3e0101349417482" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 42455 } } peers { permanent_uuid: "fb362415e802498aa60beb90898b5715" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40153 } } peers { permanent_uuid: "6190c451021542509c1ea69a4199d874" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 43857 } }
I20260811 05:07:45.727306 31037 ts_tablet_manager.cc:1428] T b4e026dbf9b24e1a917ebd41dc2be071 P 60ebd7d2397f475ea3e0101349417482: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 05:07:45.727662 31094 ts_tablet_manager.cc:1939] T 95f1a22917b940939b29557744ebe4e3 P 6190c451021542509c1ea69a4199d874: Deleting consensus metadata
I20260811 05:07:45.728178 30183 catalog_manager.cc:4841] TS 6190c451021542509c1ea69a4199d874 (127.26.191.195:43857): tablet 95f1a22917b940939b29557744ebe4e3 (table test-table [id=1dbff93be558442fbc120d03cd9a694e]) successfully deleted
I20260811 05:07:45.728868 31092 tablet_replica.cc:330] T 95f1a22917b940939b29557744ebe4e3 P 60ebd7d2397f475ea3e0101349417482: stopping tablet replica
I20260811 05:07:45.728899 31036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:45.725313 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.194:44869 (local address 127.26.191.195:43857)
0811 05:07:45.725392 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:45.725394 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:45.725401 (+ 7us) server_negotiation.cc:407] Connection header received
0811 05:07:45.725423 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:45.725423 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:45.725432 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:45.725484 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:07:45.725680 (+ 196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:45.726396 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:45.727914 (+ 1518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:45.728481 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:45.728530 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:45.728540 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:45.728780 (+ 240us) server_negotiation.cc:299] Negotiation successful
0811 05:07:45.728828 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260811 05:07:45.728888 31100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:45.724542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.195:43857 (local address 127.26.191.194:44869)
0811 05:07:45.725232 (+ 690us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:45.725244 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:45.725302 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:45.725518 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:45.725519 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:45.725521 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:07:45.725589 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:45.725591 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:45.726510 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:45.726511 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:45.727765 (+ 1254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:45.727768 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:45.728601 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:45.728601 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:45.728669 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:45.728673 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 05:07:45.728744 (+ 71us) client_negotiation.cc:240] Negotiation successful
0811 05:07:45.728794 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":670,"thread_start_us":102,"threads_started":1}
I20260811 05:07:45.729025 31092 raft_consensus.cc:2229] T 95f1a22917b940939b29557744ebe4e3 P 60ebd7d2397f475ea3e0101349417482 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 05:07:45.729103 31092 raft_consensus.cc:2258] T 95f1a22917b940939b29557744ebe4e3 P 60ebd7d2397f475ea3e0101349417482 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:07:45.729157 30910 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4e026dbf9b24e1a917ebd41dc2be071" candidate_uuid: "fb362415e802498aa60beb90898b5715" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6190c451021542509c1ea69a4199d874" is_pre_election: true
I20260811 05:07:45.729274 30910 raft_consensus.cc:2454] T b4e026dbf9b24e1a917ebd41dc2be071 P 6190c451021542509c1ea69a4199d874 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fb362415e802498aa60beb90898b5715 in term 0.
I20260811 05:07:45.729570 30572 leader_election.cc:302] T b4e026dbf9b24e1a917ebd41dc2be071 P fb362415e802498aa60beb90898b5715 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6190c451021542509c1ea69a4199d874, fb362415e802498aa60beb90898b5715; no voters:
I20260811 05:07:45.729710 31099 raft_consensus.cc:2781] T b4e026dbf9b24e1a917ebd41dc2be071 P fb362415e802498aa60beb90898b5715 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 05:07:45.729756 31099 raft_consensus.cc:482] T b4e026dbf9b24e1a917ebd41dc2be071 P fb362415e802498aa60beb90898b5715 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 05:07:45.729782 31099 raft_consensus.cc:3037] T b4e026dbf9b24e1a917ebd41dc2be071 P fb362415e802498aa60beb90898b5715 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:07:45.729751 31092 ts_tablet_manager.cc:1905] T 95f1a22917b940939b29557744ebe4e3 P 60ebd7d2397f475ea3e0101349417482: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:07:45.730643 31099 raft_consensus.cc:504] T b4e026dbf9b24e1a917ebd41dc2be071 P fb362415e802498aa60beb90898b5715 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60ebd7d2397f475ea3e0101349417482" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 42455 } } peers { permanent_uuid: "fb362415e802498aa60beb90898b5715" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40153 } } peers { permanent_uuid: "6190c451021542509c1ea69a4199d874" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 43857 } }
I20260811 05:07:45.730959 31099 leader_election.cc:288] T b4e026dbf9b24e1a917ebd41dc2be071 P fb362415e802498aa60beb90898b5715 [CANDIDATE]: Term 1 election: Requested vote from peers 60ebd7d2397f475ea3e0101349417482 (127.26.191.193:42455), 6190c451021542509c1ea69a4199d874 (127.26.191.195:43857)
I20260811 05:07:45.731019 30910 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4e026dbf9b24e1a917ebd41dc2be071" candidate_uuid: "fb362415e802498aa60beb90898b5715" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6190c451021542509c1ea69a4199d874"
I20260811 05:07:45.731093 30910 raft_consensus.cc:3037] T b4e026dbf9b24e1a917ebd41dc2be071 P 6190c451021542509c1ea69a4199d874 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:07:45.731257 31033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:45.725113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.194:44273 (local address 127.26.191.193:42455)
0811 05:07:45.725160 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:45.725162 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:45.725440 (+ 278us) server_negotiation.cc:407] Connection header received
0811 05:07:45.727909 (+ 2469us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:45.727910 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:45.727922 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:45.727970 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:07:45.728162 (+ 192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:45.728856 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:45.730111 (+ 1255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:45.730680 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:45.730733 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:45.730744 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:45.731160 (+ 416us) server_negotiation.cc:299] Negotiation successful
0811 05:07:45.731201 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 05:07:45.731272 31101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:45.724682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.193:42455 (local address 127.26.191.194:44273)
0811 05:07:45.725389 (+ 707us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:45.725397 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:45.725463 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:45.728015 (+ 2552us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:45.728016 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:45.728019 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:07:45.728083 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:45.728085 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:45.728951 (+ 866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:45.728952 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:45.730005 (+ 1053us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:45.730007 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:45.731000 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:45.731000 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:45.731078 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:45.731083 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 05:07:45.731136 (+ 53us) client_negotiation.cc:240] Negotiation successful
0811 05:07:45.731179 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":693,"thread_start_us":309,"threads_started":1}
I20260811 05:07:45.731429 31092 ts_tablet_manager.cc:1918] T 95f1a22917b940939b29557744ebe4e3 P 60ebd7d2397f475ea3e0101349417482: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 05:07:45.731495 30456 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4e026dbf9b24e1a917ebd41dc2be071" candidate_uuid: "fb362415e802498aa60beb90898b5715" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60ebd7d2397f475ea3e0101349417482" is_pre_election: true
I20260811 05:07:45.731503 31092 log.cc:1196] T 95f1a22917b940939b29557744ebe4e3 P 60ebd7d2397f475ea3e0101349417482: Deleting WAL directory at /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/minicluster-data/ts-0/wal/wals/95f1a22917b940939b29557744ebe4e3
I20260811 05:07:45.731514 30453 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4e026dbf9b24e1a917ebd41dc2be071" candidate_uuid: "fb362415e802498aa60beb90898b5715" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60ebd7d2397f475ea3e0101349417482"
I20260811 05:07:45.731585 30456 raft_consensus.cc:2454] T b4e026dbf9b24e1a917ebd41dc2be071 P 60ebd7d2397f475ea3e0101349417482 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fb362415e802498aa60beb90898b5715 in term 0.
I20260811 05:07:45.731863 31092 ts_tablet_manager.cc:1939] T 95f1a22917b940939b29557744ebe4e3 P 60ebd7d2397f475ea3e0101349417482: Deleting consensus metadata
I20260811 05:07:45.732013 30910 raft_consensus.cc:2454] T b4e026dbf9b24e1a917ebd41dc2be071 P 6190c451021542509c1ea69a4199d874 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb362415e802498aa60beb90898b5715 in term 1.
I20260811 05:07:45.732254 30572 leader_election.cc:302] T b4e026dbf9b24e1a917ebd41dc2be071 P fb362415e802498aa60beb90898b5715 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6190c451021542509c1ea69a4199d874, fb362415e802498aa60beb90898b5715; no voters: 60ebd7d2397f475ea3e0101349417482
I20260811 05:07:45.732379 31099 raft_consensus.cc:2781] T b4e026dbf9b24e1a917ebd41dc2be071 P fb362415e802498aa60beb90898b5715 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:07:45.732357 30179 catalog_manager.cc:4841] TS 60ebd7d2397f475ea3e0101349417482 (127.26.191.193:42455): tablet 95f1a22917b940939b29557744ebe4e3 (table test-table [id=1dbff93be558442fbc120d03cd9a694e]) successfully deleted
I20260811 05:07:45.732473 31099 raft_consensus.cc:686] T b4e026dbf9b24e1a917ebd41dc2be071 P fb362415e802498aa60beb90898b5715 [term 1 LEADER]: Becoming Leader. State: Replica: fb362415e802498aa60beb90898b5715, State: Running, Role: LEADER
I20260811 05:07:45.732542 31099 consensus_queue.cc:237] T b4e026dbf9b24e1a917ebd41dc2be071 P fb362415e802498aa60beb90898b5715 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60ebd7d2397f475ea3e0101349417482" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 42455 } } peers { permanent_uuid: "fb362415e802498aa60beb90898b5715" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40153 } } peers { permanent_uuid: "6190c451021542509c1ea69a4199d874" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 43857 } }
I20260811 05:07:45.733330 30199 catalog_manager.cc:5495] T b4e026dbf9b24e1a917ebd41dc2be071 P fb362415e802498aa60beb90898b5715 reported cstate change: term changed from 0 to 1, leader changed from <none> to fb362415e802498aa60beb90898b5715 (127.26.191.194). New cstate: current_term: 1 leader_uuid: "fb362415e802498aa60beb90898b5715" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60ebd7d2397f475ea3e0101349417482" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 42455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fb362415e802498aa60beb90898b5715" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40153 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6190c451021542509c1ea69a4199d874" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 43857 } health_report { overall_health: UNKNOWN } } }
I20260811 05:07:45.740320 31030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:45.737681 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52400 (local address 127.26.191.194:40153)
0811 05:07:45.737718 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:45.737721 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:45.737730 (+ 9us) server_negotiation.cc:407] Connection header received
0811 05:07:45.737831 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:45.737832 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:45.737853 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:45.737949 (+ 96us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:07:45.738041 (+ 92us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:45.738547 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:45.739445 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:45.739654 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:45.739746 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:45.739923 (+ 177us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:07:45.740055 (+ 132us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:07:45.740146 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:45.740184 (+ 38us) server_negotiation.cc:299] Negotiation successful
0811 05:07:45.740205 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 05:07:45.746536 31036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:45.743310 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.194:51141 (local address 127.26.191.195:43857)
0811 05:07:45.743363 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:45.743366 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:45.743426 (+ 60us) server_negotiation.cc:407] Connection header received
0811 05:07:45.743495 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:45.743497 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:45.743507 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:45.743557 (+ 50us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:07:45.743755 (+ 198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:45.744488 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:45.745717 (+ 1229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:45.746013 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:45.746053 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:45.746308 (+ 255us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:07:45.746341 (+ 33us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:07:45.746393 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:45.746464 (+ 71us) server_negotiation.cc:299] Negotiation successful
0811 05:07:45.746481 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 05:07:45.746625 31109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:45.743167 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.195:43857 (local address 127.26.191.194:51141)
0811 05:07:45.743368 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:45.743382 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:45.743438 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:45.743605 (+ 167us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:45.743606 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:45.743608 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 05:07:45.743678 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:45.743680 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:45.744589 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:45.744590 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:45.745607 (+ 1017us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:45.745611 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:45.746120 (+ 509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:45.746121 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:45.746198 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:45.746216 (+ 18us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 05:07:45.746409 (+ 193us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 05:07:45.746411 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 05:07:45.746461 (+ 50us) client_negotiation.cc:240] Negotiation successful
0811 05:07:45.746506 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":113,"threads_started":1}
I20260811 05:07:45.749035 30453 raft_consensus.cc:3037] T b4e026dbf9b24e1a917ebd41dc2be071 P 60ebd7d2397f475ea3e0101349417482 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:07:45.749166 30910 raft_consensus.cc:1261] T b4e026dbf9b24e1a917ebd41dc2be071 P 6190c451021542509c1ea69a4199d874 [term 1 FOLLOWER]: Refusing update from remote peer fb362415e802498aa60beb90898b5715: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:07:45.749920 30453 raft_consensus.cc:1261] T b4e026dbf9b24e1a917ebd41dc2be071 P 60ebd7d2397f475ea3e0101349417482 [term 1 FOLLOWER]: Refusing update from remote peer fb362415e802498aa60beb90898b5715: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:07:45.750114 31046 consensus_queue.cc:1035] T b4e026dbf9b24e1a917ebd41dc2be071 P fb362415e802498aa60beb90898b5715 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6190c451021542509c1ea69a4199d874" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 43857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:07:45.750329 31099 consensus_queue.cc:1035] T b4e026dbf9b24e1a917ebd41dc2be071 P fb362415e802498aa60beb90898b5715 [LEADER]: Connected to new peer: Peer: permanent_uuid: "60ebd7d2397f475ea3e0101349417482" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 42455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:07:45.759558 31006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:45.756240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.194:40153 (local address 127.26.191.195:35111)
0811 05:07:45.756335 (+ 95us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:45.756348 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:45.756391 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:45.756700 (+ 309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:45.756701 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:45.756703 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 05:07:45.756777 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:45.756779 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:45.757733 (+ 954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:45.757734 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:45.758511 (+ 777us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:45.758513 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:45.759054 (+ 541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:45.759056 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:45.759121 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:45.759127 (+ 6us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 05:07:45.759388 (+ 261us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 05:07:45.759391 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 05:07:45.759445 (+ 54us) client_negotiation.cc:240] Negotiation successful
0811 05:07:45.759489 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":71}
I20260811 05:07:45.759575 31030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:45.756471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.195:35111 (local address 127.26.191.194:40153)
0811 05:07:45.756541 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:45.756544 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:45.756553 (+ 9us) server_negotiation.cc:407] Connection header received
0811 05:07:45.756577 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:45.756577 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:45.756590 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:45.756649 (+ 59us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:07:45.756857 (+ 208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:45.757610 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:45.758649 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:45.758990 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:45.759060 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:45.759215 (+ 155us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:07:45.759259 (+ 44us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:07:45.759326 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:45.759467 (+ 141us) server_negotiation.cc:299] Negotiation successful
0811 05:07:45.759496 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
W20260811 05:07:45.760076 31075 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260811 05:07:47.288187 30200 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42248:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:07:47.288312 30200 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42248:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:07:47.289613 30200 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1f0bd85d319f49448cda2b835175d76a: Sending DeleteTablet for 3 replicas of tablet b4e026dbf9b24e1a917ebd41dc2be071
I20260811 05:07:47.290081 30644 tablet_service.cc:1514] Processing DeleteTablet for tablet b4e026dbf9b24e1a917ebd41dc2be071 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:07:47 UTC) from {username='kudu', principal='kudu/127.26.191.254@KRBTEST.COM'} at 127.0.0.1:52386
I20260811 05:07:47.290100 30884 tablet_service.cc:1514] Processing DeleteTablet for tablet b4e026dbf9b24e1a917ebd41dc2be071 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:07:47 UTC) from {username='kudu', principal='kudu/127.26.191.254@KRBTEST.COM'} at 127.0.0.1:51926
I20260811 05:07:47.290127 30425 tablet_service.cc:1514] Processing DeleteTablet for tablet b4e026dbf9b24e1a917ebd41dc2be071 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:07:47 UTC) from {username='kudu', principal='kudu/127.26.191.254@KRBTEST.COM'} at 127.0.0.1:35746
I20260811 05:07:47.292490 31146 tablet_replica.cc:330] T b4e026dbf9b24e1a917ebd41dc2be071 P fb362415e802498aa60beb90898b5715: stopping tablet replica
I20260811 05:07:47.292647 31146 raft_consensus.cc:2229] T b4e026dbf9b24e1a917ebd41dc2be071 P fb362415e802498aa60beb90898b5715 [term 1 LEADER]: Raft consensus shutting down.
I20260811 05:07:47.292883 31146 raft_consensus.cc:2258] T b4e026dbf9b24e1a917ebd41dc2be071 P fb362415e802498aa60beb90898b5715 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:07:47.293290 31146 ts_tablet_manager.cc:1905] T b4e026dbf9b24e1a917ebd41dc2be071 P fb362415e802498aa60beb90898b5715: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:07:47.293484 31148 tablet_replica.cc:330] T b4e026dbf9b24e1a917ebd41dc2be071 P 60ebd7d2397f475ea3e0101349417482: stopping tablet replica
I20260811 05:07:47.293591 31148 raft_consensus.cc:2229] T b4e026dbf9b24e1a917ebd41dc2be071 P 60ebd7d2397f475ea3e0101349417482 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 05:07:47.293655 31148 raft_consensus.cc:2258] T b4e026dbf9b24e1a917ebd41dc2be071 P 60ebd7d2397f475ea3e0101349417482 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:07:47.293771 31147 tablet_replica.cc:330] T b4e026dbf9b24e1a917ebd41dc2be071 P 6190c451021542509c1ea69a4199d874: stopping tablet replica
I20260811 05:07:47.293859 31147 raft_consensus.cc:2229] T b4e026dbf9b24e1a917ebd41dc2be071 P 6190c451021542509c1ea69a4199d874 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 05:07:47.293921 31147 raft_consensus.cc:2258] T b4e026dbf9b24e1a917ebd41dc2be071 P 6190c451021542509c1ea69a4199d874 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:07:47.294034 31148 ts_tablet_manager.cc:1905] T b4e026dbf9b24e1a917ebd41dc2be071 P 60ebd7d2397f475ea3e0101349417482: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:07:47.294212 31147 ts_tablet_manager.cc:1905] T b4e026dbf9b24e1a917ebd41dc2be071 P 6190c451021542509c1ea69a4199d874: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:07:47.295575 31146 ts_tablet_manager.cc:1918] T b4e026dbf9b24e1a917ebd41dc2be071 P fb362415e802498aa60beb90898b5715: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 05:07:47.295694 31146 log.cc:1196] T b4e026dbf9b24e1a917ebd41dc2be071 P fb362415e802498aa60beb90898b5715: Deleting WAL directory at /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/minicluster-data/ts-1/wal/wals/b4e026dbf9b24e1a917ebd41dc2be071
I20260811 05:07:47.296108 31146 ts_tablet_manager.cc:1939] T b4e026dbf9b24e1a917ebd41dc2be071 P fb362415e802498aa60beb90898b5715: Deleting consensus metadata
I20260811 05:07:47.296241 31147 ts_tablet_manager.cc:1918] T b4e026dbf9b24e1a917ebd41dc2be071 P 6190c451021542509c1ea69a4199d874: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 05:07:47.296360 31147 log.cc:1196] T b4e026dbf9b24e1a917ebd41dc2be071 P 6190c451021542509c1ea69a4199d874: Deleting WAL directory at /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/minicluster-data/ts-2/wal/wals/b4e026dbf9b24e1a917ebd41dc2be071
I20260811 05:07:47.296455 31148 ts_tablet_manager.cc:1918] T b4e026dbf9b24e1a917ebd41dc2be071 P 60ebd7d2397f475ea3e0101349417482: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 05:07:47.296571 31148 log.cc:1196] T b4e026dbf9b24e1a917ebd41dc2be071 P 60ebd7d2397f475ea3e0101349417482: Deleting WAL directory at /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/minicluster-data/ts-0/wal/wals/b4e026dbf9b24e1a917ebd41dc2be071
I20260811 05:07:47.296644 31147 ts_tablet_manager.cc:1939] T b4e026dbf9b24e1a917ebd41dc2be071 P 6190c451021542509c1ea69a4199d874: Deleting consensus metadata
I20260811 05:07:47.296653 30183 catalog_manager.cc:4841] TS fb362415e802498aa60beb90898b5715 (127.26.191.194:40153): tablet b4e026dbf9b24e1a917ebd41dc2be071 (table test-table [id=7eb515c779c74732a97b76df7f164cf7]) successfully deleted
I20260811 05:07:47.297049 30183 catalog_manager.cc:4841] TS 6190c451021542509c1ea69a4199d874 (127.26.191.195:43857): tablet b4e026dbf9b24e1a917ebd41dc2be071 (table test-table [id=7eb515c779c74732a97b76df7f164cf7]) successfully deleted
I20260811 05:07:47.297154 31148 ts_tablet_manager.cc:1939] T b4e026dbf9b24e1a917ebd41dc2be071 P 60ebd7d2397f475ea3e0101349417482: Deleting consensus metadata
I20260811 05:07:47.297605 30179 catalog_manager.cc:4841] TS 60ebd7d2397f475ea3e0101349417482 (127.26.191.193:42455): tablet b4e026dbf9b24e1a917ebd41dc2be071 (table test-table [id=7eb515c779c74732a97b76df7f164cf7]) successfully deleted
Aug 11 05:07:47 dist-test-slave-x5fp krb5kdc[30142](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424867, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 05:07:47 dist-test-slave-x5fp krb5kdc[30142](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424867, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
I20260811 05:07:47.320971 31159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:47.311772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42264 (local address 127.26.191.254:41885)
0811 05:07:47.312093 (+ 321us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:47.312095 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:47.312101 (+ 6us) server_negotiation.cc:407] Connection header received
0811 05:07:47.312127 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:47.312127 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:47.312137 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:47.312191 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:47.313117 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:47.313764 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:47.314705 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:47.314918 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:47.314987 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:47.317924 (+ 2937us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:47.317925 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:47.317926 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:07:47.317934 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:47.319569 (+ 1635us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:47.319998 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:47.320000 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:47.320000 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:47.320101 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:47.320359 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:47.320360 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:47.320360 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:47.320493 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:47.320584 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:47.320783 (+ 199us) server_negotiation.cc:299] Negotiation successful
0811 05:07:47.320887 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":295,"thread_start_us":96,"threads_started":1}
I20260811 05:07:47.322947 30200 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:42264:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 05:07:47.323120 30200 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 05:07:47.325059 30425 tablet_service.cc:1467] Processing CreateTablet for tablet 11104d48256740e191546050cf14a225 (DEFAULT_TABLE table=test-table [id=7a4e7d0ad63240e4b4d103e99ca0ab6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:07:47.325078 30884 tablet_service.cc:1467] Processing CreateTablet for tablet 11104d48256740e191546050cf14a225 (DEFAULT_TABLE table=test-table [id=7a4e7d0ad63240e4b4d103e99ca0ab6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:07:47.325085 30644 tablet_service.cc:1467] Processing CreateTablet for tablet 11104d48256740e191546050cf14a225 (DEFAULT_TABLE table=test-table [id=7a4e7d0ad63240e4b4d103e99ca0ab6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:07:47.325215 30884 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 11104d48256740e191546050cf14a225. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:07:47.325224 30425 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 11104d48256740e191546050cf14a225. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:07:47.325228 30644 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 11104d48256740e191546050cf14a225. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:07:47.326294 31161 tablet_bootstrap.cc:492] T 11104d48256740e191546050cf14a225 P 6190c451021542509c1ea69a4199d874: Bootstrap starting.
I20260811 05:07:47.326725 31161 tablet_bootstrap.cc:654] T 11104d48256740e191546050cf14a225 P 6190c451021542509c1ea69a4199d874: Neither blocks nor log segments found. Creating new log.
I20260811 05:07:47.326881 31162 tablet_bootstrap.cc:492] T 11104d48256740e191546050cf14a225 P fb362415e802498aa60beb90898b5715: Bootstrap starting.
I20260811 05:07:47.327118 31163 tablet_bootstrap.cc:492] T 11104d48256740e191546050cf14a225 P 60ebd7d2397f475ea3e0101349417482: Bootstrap starting.
I20260811 05:07:47.327333 31162 tablet_bootstrap.cc:654] T 11104d48256740e191546050cf14a225 P fb362415e802498aa60beb90898b5715: Neither blocks nor log segments found. Creating new log.
I20260811 05:07:47.327574 31163 tablet_bootstrap.cc:654] T 11104d48256740e191546050cf14a225 P 60ebd7d2397f475ea3e0101349417482: Neither blocks nor log segments found. Creating new log.
I20260811 05:07:47.327910 31162 tablet_bootstrap.cc:492] T 11104d48256740e191546050cf14a225 P fb362415e802498aa60beb90898b5715: No bootstrap required, opened a new log
I20260811 05:07:47.327981 31162 ts_tablet_manager.cc:1397] T 11104d48256740e191546050cf14a225 P fb362415e802498aa60beb90898b5715: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 05:07:47.328163 31162 raft_consensus.cc:348] T 11104d48256740e191546050cf14a225 P fb362415e802498aa60beb90898b5715 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60ebd7d2397f475ea3e0101349417482" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 42455 } } peers { permanent_uuid: "fb362415e802498aa60beb90898b5715" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40153 } } peers { permanent_uuid: "6190c451021542509c1ea69a4199d874" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 43857 } }
I20260811 05:07:47.328243 31161 tablet_bootstrap.cc:492] T 11104d48256740e191546050cf14a225 P 6190c451021542509c1ea69a4199d874: No bootstrap required, opened a new log
I20260811 05:07:47.328260 31162 raft_consensus.cc:374] T 11104d48256740e191546050cf14a225 P fb362415e802498aa60beb90898b5715 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:07:47.328295 31162 raft_consensus.cc:729] T 11104d48256740e191546050cf14a225 P fb362415e802498aa60beb90898b5715 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb362415e802498aa60beb90898b5715, State: Initialized, Role: FOLLOWER
I20260811 05:07:47.328287 31161 ts_tablet_manager.cc:1397] T 11104d48256740e191546050cf14a225 P 6190c451021542509c1ea69a4199d874: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 05:07:47.328383 31162 consensus_queue.cc:260] T 11104d48256740e191546050cf14a225 P fb362415e802498aa60beb90898b5715 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60ebd7d2397f475ea3e0101349417482" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 42455 } } peers { permanent_uuid: "fb362415e802498aa60beb90898b5715" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40153 } } peers { permanent_uuid: "6190c451021542509c1ea69a4199d874" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 43857 } }
I20260811 05:07:47.328404 31161 raft_consensus.cc:348] T 11104d48256740e191546050cf14a225 P 6190c451021542509c1ea69a4199d874 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60ebd7d2397f475ea3e0101349417482" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 42455 } } peers { permanent_uuid: "fb362415e802498aa60beb90898b5715" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40153 } } peers { permanent_uuid: "6190c451021542509c1ea69a4199d874" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 43857 } }
I20260811 05:07:47.328482 31161 raft_consensus.cc:374] T 11104d48256740e191546050cf14a225 P 6190c451021542509c1ea69a4199d874 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:07:47.328508 31161 raft_consensus.cc:729] T 11104d48256740e191546050cf14a225 P 6190c451021542509c1ea69a4199d874 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6190c451021542509c1ea69a4199d874, State: Initialized, Role: FOLLOWER
I20260811 05:07:47.328536 31162 ts_tablet_manager.cc:1428] T 11104d48256740e191546050cf14a225 P fb362415e802498aa60beb90898b5715: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:47.328557 31161 consensus_queue.cc:260] T 11104d48256740e191546050cf14a225 P 6190c451021542509c1ea69a4199d874 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60ebd7d2397f475ea3e0101349417482" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 42455 } } peers { permanent_uuid: "fb362415e802498aa60beb90898b5715" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40153 } } peers { permanent_uuid: "6190c451021542509c1ea69a4199d874" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 43857 } }
I20260811 05:07:47.328656 31161 ts_tablet_manager.cc:1428] T 11104d48256740e191546050cf14a225 P 6190c451021542509c1ea69a4199d874: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:47.328907 31163 tablet_bootstrap.cc:492] T 11104d48256740e191546050cf14a225 P 60ebd7d2397f475ea3e0101349417482: No bootstrap required, opened a new log
I20260811 05:07:47.328966 31163 ts_tablet_manager.cc:1397] T 11104d48256740e191546050cf14a225 P 60ebd7d2397f475ea3e0101349417482: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 05:07:47.329165 31163 raft_consensus.cc:348] T 11104d48256740e191546050cf14a225 P 60ebd7d2397f475ea3e0101349417482 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60ebd7d2397f475ea3e0101349417482" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 42455 } } peers { permanent_uuid: "fb362415e802498aa60beb90898b5715" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40153 } } peers { permanent_uuid: "6190c451021542509c1ea69a4199d874" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 43857 } }
I20260811 05:07:47.329252 31163 raft_consensus.cc:374] T 11104d48256740e191546050cf14a225 P 60ebd7d2397f475ea3e0101349417482 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:07:47.329275 31163 raft_consensus.cc:729] T 11104d48256740e191546050cf14a225 P 60ebd7d2397f475ea3e0101349417482 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60ebd7d2397f475ea3e0101349417482, State: Initialized, Role: FOLLOWER
I20260811 05:07:47.329330 31163 consensus_queue.cc:260] T 11104d48256740e191546050cf14a225 P 60ebd7d2397f475ea3e0101349417482 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60ebd7d2397f475ea3e0101349417482" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 42455 } } peers { permanent_uuid: "fb362415e802498aa60beb90898b5715" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40153 } } peers { permanent_uuid: "6190c451021542509c1ea69a4199d874" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 43857 } }
I20260811 05:07:47.329515 31163 ts_tablet_manager.cc:1428] T 11104d48256740e191546050cf14a225 P 60ebd7d2397f475ea3e0101349417482: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:47.330619 31137 raft_consensus.cc:482] T 11104d48256740e191546050cf14a225 P fb362415e802498aa60beb90898b5715 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 05:07:47.330688 31137 raft_consensus.cc:504] T 11104d48256740e191546050cf14a225 P fb362415e802498aa60beb90898b5715 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60ebd7d2397f475ea3e0101349417482" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 42455 } } peers { permanent_uuid: "fb362415e802498aa60beb90898b5715" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40153 } } peers { permanent_uuid: "6190c451021542509c1ea69a4199d874" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 43857 } }
I20260811 05:07:47.330839 31137 leader_election.cc:288] T 11104d48256740e191546050cf14a225 P fb362415e802498aa60beb90898b5715 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60ebd7d2397f475ea3e0101349417482 (127.26.191.193:42455), 6190c451021542509c1ea69a4199d874 (127.26.191.195:43857)
I20260811 05:07:47.331008 30453 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11104d48256740e191546050cf14a225" candidate_uuid: "fb362415e802498aa60beb90898b5715" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60ebd7d2397f475ea3e0101349417482" is_pre_election: true
I20260811 05:07:47.331079 30453 raft_consensus.cc:2454] T 11104d48256740e191546050cf14a225 P 60ebd7d2397f475ea3e0101349417482 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fb362415e802498aa60beb90898b5715 in term 0.
I20260811 05:07:47.331185 30910 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11104d48256740e191546050cf14a225" candidate_uuid: "fb362415e802498aa60beb90898b5715" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6190c451021542509c1ea69a4199d874" is_pre_election: true
I20260811 05:07:47.331257 30570 leader_election.cc:302] T 11104d48256740e191546050cf14a225 P fb362415e802498aa60beb90898b5715 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60ebd7d2397f475ea3e0101349417482, fb362415e802498aa60beb90898b5715; no voters:
I20260811 05:07:47.331269 30910 raft_consensus.cc:2454] T 11104d48256740e191546050cf14a225 P 6190c451021542509c1ea69a4199d874 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fb362415e802498aa60beb90898b5715 in term 0.
I20260811 05:07:47.331336 31137 raft_consensus.cc:2781] T 11104d48256740e191546050cf14a225 P fb362415e802498aa60beb90898b5715 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 05:07:47.331369 31137 raft_consensus.cc:482] T 11104d48256740e191546050cf14a225 P fb362415e802498aa60beb90898b5715 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 05:07:47.331388 31137 raft_consensus.cc:3037] T 11104d48256740e191546050cf14a225 P fb362415e802498aa60beb90898b5715 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:07:47.332099 31137 raft_consensus.cc:504] T 11104d48256740e191546050cf14a225 P fb362415e802498aa60beb90898b5715 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60ebd7d2397f475ea3e0101349417482" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 42455 } } peers { permanent_uuid: "fb362415e802498aa60beb90898b5715" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40153 } } peers { permanent_uuid: "6190c451021542509c1ea69a4199d874" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 43857 } }
I20260811 05:07:47.332232 31137 leader_election.cc:288] T 11104d48256740e191546050cf14a225 P fb362415e802498aa60beb90898b5715 [CANDIDATE]: Term 1 election: Requested vote from peers 60ebd7d2397f475ea3e0101349417482 (127.26.191.193:42455), 6190c451021542509c1ea69a4199d874 (127.26.191.195:43857)
I20260811 05:07:47.332453 30453 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11104d48256740e191546050cf14a225" candidate_uuid: "fb362415e802498aa60beb90898b5715" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60ebd7d2397f475ea3e0101349417482"
I20260811 05:07:47.332538 30453 raft_consensus.cc:3037] T 11104d48256740e191546050cf14a225 P 60ebd7d2397f475ea3e0101349417482 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:07:47.333223 30453 raft_consensus.cc:2454] T 11104d48256740e191546050cf14a225 P 60ebd7d2397f475ea3e0101349417482 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb362415e802498aa60beb90898b5715 in term 1.
I20260811 05:07:47.333362 30910 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11104d48256740e191546050cf14a225" candidate_uuid: "fb362415e802498aa60beb90898b5715" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6190c451021542509c1ea69a4199d874"
I20260811 05:07:47.333421 30570 leader_election.cc:302] T 11104d48256740e191546050cf14a225 P fb362415e802498aa60beb90898b5715 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60ebd7d2397f475ea3e0101349417482, fb362415e802498aa60beb90898b5715; no voters:
I20260811 05:07:47.333453 30910 raft_consensus.cc:3037] T 11104d48256740e191546050cf14a225 P 6190c451021542509c1ea69a4199d874 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:07:47.333565 31137 raft_consensus.cc:2781] T 11104d48256740e191546050cf14a225 P fb362415e802498aa60beb90898b5715 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:07:47.333634 31137 raft_consensus.cc:686] T 11104d48256740e191546050cf14a225 P fb362415e802498aa60beb90898b5715 [term 1 LEADER]: Becoming Leader. State: Replica: fb362415e802498aa60beb90898b5715, State: Running, Role: LEADER
I20260811 05:07:47.333674 31137 consensus_queue.cc:237] T 11104d48256740e191546050cf14a225 P fb362415e802498aa60beb90898b5715 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60ebd7d2397f475ea3e0101349417482" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 42455 } } peers { permanent_uuid: "fb362415e802498aa60beb90898b5715" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40153 } } peers { permanent_uuid: "6190c451021542509c1ea69a4199d874" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 43857 } }
I20260811 05:07:47.334291 30910 raft_consensus.cc:2454] T 11104d48256740e191546050cf14a225 P 6190c451021542509c1ea69a4199d874 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb362415e802498aa60beb90898b5715 in term 1.
I20260811 05:07:47.334705 30200 catalog_manager.cc:5495] T 11104d48256740e191546050cf14a225 P fb362415e802498aa60beb90898b5715 reported cstate change: term changed from 0 to 1, leader changed from <none> to fb362415e802498aa60beb90898b5715 (127.26.191.194). New cstate: current_term: 1 leader_uuid: "fb362415e802498aa60beb90898b5715" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60ebd7d2397f475ea3e0101349417482" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 42455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fb362415e802498aa60beb90898b5715" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40153 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6190c451021542509c1ea69a4199d874" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 43857 } health_report { overall_health: UNKNOWN } } }
I20260811 05:07:47.344558 31175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:47.342052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52408 (local address 127.26.191.194:40153)
0811 05:07:47.342231 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:47.342233 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:47.342240 (+ 7us) server_negotiation.cc:407] Connection header received
0811 05:07:47.342269 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:47.342269 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:47.342286 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:47.342363 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:07:47.342523 (+ 160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:47.343018 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:47.343812 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:47.344033 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:47.344113 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:47.344266 (+ 153us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:07:47.344309 (+ 43us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:07:47.344375 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:47.344435 (+ 60us) server_negotiation.cc:299] Negotiation successful
0811 05:07:47.344460 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":151,"thread_start_us":105,"threads_started":1}
I20260811 05:07:47.347136 30453 raft_consensus.cc:1261] T 11104d48256740e191546050cf14a225 P 60ebd7d2397f475ea3e0101349417482 [term 1 FOLLOWER]: Refusing update from remote peer fb362415e802498aa60beb90898b5715: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:07:47.347177 30910 raft_consensus.cc:1261] T 11104d48256740e191546050cf14a225 P 6190c451021542509c1ea69a4199d874 [term 1 FOLLOWER]: Refusing update from remote peer fb362415e802498aa60beb90898b5715: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:07:47.347420 31137 consensus_queue.cc:1035] T 11104d48256740e191546050cf14a225 P fb362415e802498aa60beb90898b5715 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6190c451021542509c1ea69a4199d874" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 43857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:07:47.347539 31114 consensus_queue.cc:1035] T 11104d48256740e191546050cf14a225 P fb362415e802498aa60beb90898b5715 [LEADER]: Connected to new peer: Peer: permanent_uuid: "60ebd7d2397f475ea3e0101349417482" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 42455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:07:47.348698 31122 mvcc.cc:205] Tried to move back new op lower bound from 7317196256652103680 to 7317196256599126016. Current Snapshot: MvccSnapshot[applied={T|T < 7317196256652103680}]
I20260811 05:07:47.358984 30199 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:42264:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:07:47.359103 30199 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:42264:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:07:47.359743 30199 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1f0bd85d319f49448cda2b835175d76a: Sending DeleteTablet for 3 replicas of tablet 11104d48256740e191546050cf14a225
I20260811 05:07:47.360016 30644 tablet_service.cc:1514] Processing DeleteTablet for tablet 11104d48256740e191546050cf14a225 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:07:47 UTC) from {username='kudu', principal='kudu/127.26.191.254@KRBTEST.COM'} at 127.0.0.1:52386
I20260811 05:07:47.360047 30425 tablet_service.cc:1514] Processing DeleteTablet for tablet 11104d48256740e191546050cf14a225 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:07:47 UTC) from {username='kudu', principal='kudu/127.26.191.254@KRBTEST.COM'} at 127.0.0.1:35746
I20260811 05:07:47.360119 30884 tablet_service.cc:1514] Processing DeleteTablet for tablet 11104d48256740e191546050cf14a225 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:07:47 UTC) from {username='kudu', principal='kudu/127.26.191.254@KRBTEST.COM'} at 127.0.0.1:51926
I20260811 05:07:47.360215 31147 tablet_replica.cc:330] T 11104d48256740e191546050cf14a225 P 6190c451021542509c1ea69a4199d874: stopping tablet replica
I20260811 05:07:47.360180 31146 tablet_replica.cc:330] T 11104d48256740e191546050cf14a225 P fb362415e802498aa60beb90898b5715: stopping tablet replica
I20260811 05:07:47.360267 31146 raft_consensus.cc:2229] T 11104d48256740e191546050cf14a225 P fb362415e802498aa60beb90898b5715 [term 1 LEADER]: Raft consensus shutting down.
I20260811 05:07:47.360270 31147 raft_consensus.cc:2229] T 11104d48256740e191546050cf14a225 P 6190c451021542509c1ea69a4199d874 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 05:07:47.360311 31147 raft_consensus.cc:2258] T 11104d48256740e191546050cf14a225 P 6190c451021542509c1ea69a4199d874 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:07:47.360329 31146 raft_consensus.cc:2258] T 11104d48256740e191546050cf14a225 P fb362415e802498aa60beb90898b5715 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:07:47.360414 31148 tablet_replica.cc:330] T 11104d48256740e191546050cf14a225 P 60ebd7d2397f475ea3e0101349417482: stopping tablet replica
I20260811 05:07:47.360479 31148 raft_consensus.cc:2229] T 11104d48256740e191546050cf14a225 P 60ebd7d2397f475ea3e0101349417482 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 05:07:47.360523 31148 raft_consensus.cc:2258] T 11104d48256740e191546050cf14a225 P 60ebd7d2397f475ea3e0101349417482 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:07:47.360457 30199 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:42264:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 05:07:47.360622 30199 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 05:07:47.360754 31147 ts_tablet_manager.cc:1905] T 11104d48256740e191546050cf14a225 P 6190c451021542509c1ea69a4199d874: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:07:47.360919 31146 ts_tablet_manager.cc:1905] T 11104d48256740e191546050cf14a225 P fb362415e802498aa60beb90898b5715: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:07:47.361974 30425 tablet_service.cc:1467] Processing CreateTablet for tablet 849f591f40ba4ceb84d7112b20a5fbde (DEFAULT_TABLE table=test-table [id=4ab811f8fbf94387ac8e27fac4c22f8b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:07:47.362033 30644 tablet_service.cc:1467] Processing CreateTablet for tablet 849f591f40ba4ceb84d7112b20a5fbde (DEFAULT_TABLE table=test-table [id=4ab811f8fbf94387ac8e27fac4c22f8b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:07:47.362099 30425 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 849f591f40ba4ceb84d7112b20a5fbde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:07:47.362141 30644 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 849f591f40ba4ceb84d7112b20a5fbde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:07:47.362586 31147 ts_tablet_manager.cc:1918] T 11104d48256740e191546050cf14a225 P 6190c451021542509c1ea69a4199d874: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 05:07:47.362641 31147 log.cc:1196] T 11104d48256740e191546050cf14a225 P 6190c451021542509c1ea69a4199d874: Deleting WAL directory at /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/minicluster-data/ts-2/wal/wals/11104d48256740e191546050cf14a225
I20260811 05:07:47.362766 31146 ts_tablet_manager.cc:1918] T 11104d48256740e191546050cf14a225 P fb362415e802498aa60beb90898b5715: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 05:07:47.362826 31146 log.cc:1196] T 11104d48256740e191546050cf14a225 P fb362415e802498aa60beb90898b5715: Deleting WAL directory at /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/minicluster-data/ts-1/wal/wals/11104d48256740e191546050cf14a225
I20260811 05:07:47.362890 31147 ts_tablet_manager.cc:1939] T 11104d48256740e191546050cf14a225 P 6190c451021542509c1ea69a4199d874: Deleting consensus metadata
I20260811 05:07:47.363082 31146 ts_tablet_manager.cc:1939] T 11104d48256740e191546050cf14a225 P fb362415e802498aa60beb90898b5715: Deleting consensus metadata
I20260811 05:07:47.363466 30183 catalog_manager.cc:4841] TS fb362415e802498aa60beb90898b5715 (127.26.191.194:40153): tablet 11104d48256740e191546050cf14a225 (table test-table [id=7a4e7d0ad63240e4b4d103e99ca0ab6e]) successfully deleted
I20260811 05:07:47.363500 31162 tablet_bootstrap.cc:492] T 849f591f40ba4ceb84d7112b20a5fbde P fb362415e802498aa60beb90898b5715: Bootstrap starting.
I20260811 05:07:47.363547 30884 tablet_service.cc:1467] Processing CreateTablet for tablet 849f591f40ba4ceb84d7112b20a5fbde (DEFAULT_TABLE table=test-table [id=4ab811f8fbf94387ac8e27fac4c22f8b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:07:47.363649 30884 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 849f591f40ba4ceb84d7112b20a5fbde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:07:47.363835 31162 tablet_bootstrap.cc:654] T 849f591f40ba4ceb84d7112b20a5fbde P fb362415e802498aa60beb90898b5715: Neither blocks nor log segments found. Creating new log.
I20260811 05:07:47.363952 31148 ts_tablet_manager.cc:1905] T 11104d48256740e191546050cf14a225 P 60ebd7d2397f475ea3e0101349417482: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:07:47.364085 31163 tablet_bootstrap.cc:492] T 849f591f40ba4ceb84d7112b20a5fbde P 60ebd7d2397f475ea3e0101349417482: Bootstrap starting.
I20260811 05:07:47.364305 30183 catalog_manager.cc:4841] TS 6190c451021542509c1ea69a4199d874 (127.26.191.195:43857): tablet 11104d48256740e191546050cf14a225 (table test-table [id=7a4e7d0ad63240e4b4d103e99ca0ab6e]) successfully deleted
I20260811 05:07:47.364535 31163 tablet_bootstrap.cc:654] T 849f591f40ba4ceb84d7112b20a5fbde P 60ebd7d2397f475ea3e0101349417482: Neither blocks nor log segments found. Creating new log.
I20260811 05:07:47.365048 31161 tablet_bootstrap.cc:492] T 849f591f40ba4ceb84d7112b20a5fbde P 6190c451021542509c1ea69a4199d874: Bootstrap starting.
I20260811 05:07:47.365329 31163 tablet_bootstrap.cc:492] T 849f591f40ba4ceb84d7112b20a5fbde P 60ebd7d2397f475ea3e0101349417482: No bootstrap required, opened a new log
I20260811 05:07:47.365377 31163 ts_tablet_manager.cc:1397] T 849f591f40ba4ceb84d7112b20a5fbde P 60ebd7d2397f475ea3e0101349417482: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260811 05:07:47.365427 31161 tablet_bootstrap.cc:654] T 849f591f40ba4ceb84d7112b20a5fbde P 6190c451021542509c1ea69a4199d874: Neither blocks nor log segments found. Creating new log.
I20260811 05:07:47.365520 31148 ts_tablet_manager.cc:1918] T 11104d48256740e191546050cf14a225 P 60ebd7d2397f475ea3e0101349417482: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 05:07:47.365615 31148 log.cc:1196] T 11104d48256740e191546050cf14a225 P 60ebd7d2397f475ea3e0101349417482: Deleting WAL directory at /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/minicluster-data/ts-0/wal/wals/11104d48256740e191546050cf14a225
I20260811 05:07:47.365724 31162 tablet_bootstrap.cc:492] T 849f591f40ba4ceb84d7112b20a5fbde P fb362415e802498aa60beb90898b5715: No bootstrap required, opened a new log
I20260811 05:07:47.365770 31162 ts_tablet_manager.cc:1397] T 849f591f40ba4ceb84d7112b20a5fbde P fb362415e802498aa60beb90898b5715: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 05:07:47.365899 31148 ts_tablet_manager.cc:1939] T 11104d48256740e191546050cf14a225 P 60ebd7d2397f475ea3e0101349417482: Deleting consensus metadata
I20260811 05:07:47.365900 31162 raft_consensus.cc:348] T 849f591f40ba4ceb84d7112b20a5fbde P fb362415e802498aa60beb90898b5715 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60ebd7d2397f475ea3e0101349417482" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 42455 } } peers { permanent_uuid: "fb362415e802498aa60beb90898b5715" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40153 } } peers { permanent_uuid: "6190c451021542509c1ea69a4199d874" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 43857 } }
I20260811 05:07:47.365981 31162 raft_consensus.cc:374] T 849f591f40ba4ceb84d7112b20a5fbde P fb362415e802498aa60beb90898b5715 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:07:47.366000 31162 raft_consensus.cc:729] T 849f591f40ba4ceb84d7112b20a5fbde P fb362415e802498aa60beb90898b5715 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb362415e802498aa60beb90898b5715, State: Initialized, Role: FOLLOWER
I20260811 05:07:47.366040 31162 consensus_queue.cc:260] T 849f591f40ba4ceb84d7112b20a5fbde P fb362415e802498aa60beb90898b5715 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60ebd7d2397f475ea3e0101349417482" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 42455 } } peers { permanent_uuid: "fb362415e802498aa60beb90898b5715" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40153 } } peers { permanent_uuid: "6190c451021542509c1ea69a4199d874" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 43857 } }
I20260811 05:07:47.366144 31162 ts_tablet_manager.cc:1428] T 849f591f40ba4ceb84d7112b20a5fbde P fb362415e802498aa60beb90898b5715: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:47.366251 31161 tablet_bootstrap.cc:492] T 849f591f40ba4ceb84d7112b20a5fbde P 6190c451021542509c1ea69a4199d874: No bootstrap required, opened a new log
I20260811 05:07:47.365543 31163 raft_consensus.cc:348] T 849f591f40ba4ceb84d7112b20a5fbde P 60ebd7d2397f475ea3e0101349417482 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60ebd7d2397f475ea3e0101349417482" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 42455 } } peers { permanent_uuid: "fb362415e802498aa60beb90898b5715" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40153 } } peers { permanent_uuid: "6190c451021542509c1ea69a4199d874" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 43857 } }
I20260811 05:07:47.366286 31163 raft_consensus.cc:374] T 849f591f40ba4ceb84d7112b20a5fbde P 60ebd7d2397f475ea3e0101349417482 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:07:47.366292 31161 ts_tablet_manager.cc:1397] T 849f591f40ba4ceb84d7112b20a5fbde P 6190c451021542509c1ea69a4199d874: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 05:07:47.366312 31163 raft_consensus.cc:729] T 849f591f40ba4ceb84d7112b20a5fbde P 60ebd7d2397f475ea3e0101349417482 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60ebd7d2397f475ea3e0101349417482, State: Initialized, Role: FOLLOWER
I20260811 05:07:47.366358 31163 consensus_queue.cc:260] T 849f591f40ba4ceb84d7112b20a5fbde P 60ebd7d2397f475ea3e0101349417482 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60ebd7d2397f475ea3e0101349417482" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 42455 } } peers { permanent_uuid: "fb362415e802498aa60beb90898b5715" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40153 } } peers { permanent_uuid: "6190c451021542509c1ea69a4199d874" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 43857 } }
I20260811 05:07:47.366401 30179 catalog_manager.cc:4841] TS 60ebd7d2397f475ea3e0101349417482 (127.26.191.193:42455): tablet 11104d48256740e191546050cf14a225 (table test-table [id=7a4e7d0ad63240e4b4d103e99ca0ab6e]) successfully deleted
I20260811 05:07:47.366446 31163 ts_tablet_manager.cc:1428] T 849f591f40ba4ceb84d7112b20a5fbde P 60ebd7d2397f475ea3e0101349417482: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260811 05:07:47.366410 31161 raft_consensus.cc:348] T 849f591f40ba4ceb84d7112b20a5fbde P 6190c451021542509c1ea69a4199d874 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60ebd7d2397f475ea3e0101349417482" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 42455 } } peers { permanent_uuid: "fb362415e802498aa60beb90898b5715" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40153 } } peers { permanent_uuid: "6190c451021542509c1ea69a4199d874" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 43857 } }
I20260811 05:07:47.366473 31161 raft_consensus.cc:374] T 849f591f40ba4ceb84d7112b20a5fbde P 6190c451021542509c1ea69a4199d874 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:07:47.366495 31161 raft_consensus.cc:729] T 849f591f40ba4ceb84d7112b20a5fbde P 6190c451021542509c1ea69a4199d874 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6190c451021542509c1ea69a4199d874, State: Initialized, Role: FOLLOWER
I20260811 05:07:47.366544 31161 consensus_queue.cc:260] T 849f591f40ba4ceb84d7112b20a5fbde P 6190c451021542509c1ea69a4199d874 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60ebd7d2397f475ea3e0101349417482" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 42455 } } peers { permanent_uuid: "fb362415e802498aa60beb90898b5715" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40153 } } peers { permanent_uuid: "6190c451021542509c1ea69a4199d874" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 43857 } }
I20260811 05:07:47.366633 31161 ts_tablet_manager.cc:1428] T 849f591f40ba4ceb84d7112b20a5fbde P 6190c451021542509c1ea69a4199d874: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:47.578701 31129 raft_consensus.cc:482] T 849f591f40ba4ceb84d7112b20a5fbde P 6190c451021542509c1ea69a4199d874 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 05:07:47.578869 31129 raft_consensus.cc:504] T 849f591f40ba4ceb84d7112b20a5fbde P 6190c451021542509c1ea69a4199d874 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60ebd7d2397f475ea3e0101349417482" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 42455 } } peers { permanent_uuid: "fb362415e802498aa60beb90898b5715" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40153 } } peers { permanent_uuid: "6190c451021542509c1ea69a4199d874" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 43857 } }
I20260811 05:07:47.579092 31129 leader_election.cc:288] T 849f591f40ba4ceb84d7112b20a5fbde P 6190c451021542509c1ea69a4199d874 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60ebd7d2397f475ea3e0101349417482 (127.26.191.193:42455), fb362415e802498aa60beb90898b5715 (127.26.191.194:40153)
I20260811 05:07:47.579439 30670 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "849f591f40ba4ceb84d7112b20a5fbde" candidate_uuid: "6190c451021542509c1ea69a4199d874" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb362415e802498aa60beb90898b5715" is_pre_election: true
I20260811 05:07:47.579517 30453 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "849f591f40ba4ceb84d7112b20a5fbde" candidate_uuid: "6190c451021542509c1ea69a4199d874" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60ebd7d2397f475ea3e0101349417482" is_pre_election: true
I20260811 05:07:47.579648 30453 raft_consensus.cc:2454] T 849f591f40ba4ceb84d7112b20a5fbde P 60ebd7d2397f475ea3e0101349417482 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6190c451021542509c1ea69a4199d874 in term 0.
I20260811 05:07:47.579628 30670 raft_consensus.cc:2454] T 849f591f40ba4ceb84d7112b20a5fbde P fb362415e802498aa60beb90898b5715 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6190c451021542509c1ea69a4199d874 in term 0.
I20260811 05:07:47.579859 30792 leader_election.cc:302] T 849f591f40ba4ceb84d7112b20a5fbde P 6190c451021542509c1ea69a4199d874 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60ebd7d2397f475ea3e0101349417482, 6190c451021542509c1ea69a4199d874; no voters:
I20260811 05:07:47.580031 31129 raft_consensus.cc:2781] T 849f591f40ba4ceb84d7112b20a5fbde P 6190c451021542509c1ea69a4199d874 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 05:07:47.580116 31129 raft_consensus.cc:482] T 849f591f40ba4ceb84d7112b20a5fbde P 6190c451021542509c1ea69a4199d874 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 05:07:47.580147 31129 raft_consensus.cc:3037] T 849f591f40ba4ceb84d7112b20a5fbde P 6190c451021542509c1ea69a4199d874 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:07:47.581007 31129 raft_consensus.cc:504] T 849f591f40ba4ceb84d7112b20a5fbde P 6190c451021542509c1ea69a4199d874 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60ebd7d2397f475ea3e0101349417482" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 42455 } } peers { permanent_uuid: "fb362415e802498aa60beb90898b5715" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40153 } } peers { permanent_uuid: "6190c451021542509c1ea69a4199d874" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 43857 } }
I20260811 05:07:47.581193 31129 leader_election.cc:288] T 849f591f40ba4ceb84d7112b20a5fbde P 6190c451021542509c1ea69a4199d874 [CANDIDATE]: Term 1 election: Requested vote from peers 60ebd7d2397f475ea3e0101349417482 (127.26.191.193:42455), fb362415e802498aa60beb90898b5715 (127.26.191.194:40153)
I20260811 05:07:47.581389 30670 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "849f591f40ba4ceb84d7112b20a5fbde" candidate_uuid: "6190c451021542509c1ea69a4199d874" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb362415e802498aa60beb90898b5715"
I20260811 05:07:47.581516 30670 raft_consensus.cc:3037] T 849f591f40ba4ceb84d7112b20a5fbde P fb362415e802498aa60beb90898b5715 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:07:47.581454 30453 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "849f591f40ba4ceb84d7112b20a5fbde" candidate_uuid: "6190c451021542509c1ea69a4199d874" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60ebd7d2397f475ea3e0101349417482"
I20260811 05:07:47.581599 30453 raft_consensus.cc:3037] T 849f591f40ba4ceb84d7112b20a5fbde P 60ebd7d2397f475ea3e0101349417482 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:07:47.582177 30670 raft_consensus.cc:2454] T 849f591f40ba4ceb84d7112b20a5fbde P fb362415e802498aa60beb90898b5715 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6190c451021542509c1ea69a4199d874 in term 1.
I20260811 05:07:47.582417 30794 leader_election.cc:302] T 849f591f40ba4ceb84d7112b20a5fbde P 6190c451021542509c1ea69a4199d874 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6190c451021542509c1ea69a4199d874, fb362415e802498aa60beb90898b5715; no voters:
I20260811 05:07:47.582453 30453 raft_consensus.cc:2454] T 849f591f40ba4ceb84d7112b20a5fbde P 60ebd7d2397f475ea3e0101349417482 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6190c451021542509c1ea69a4199d874 in term 1.
I20260811 05:07:47.582607 31129 raft_consensus.cc:2781] T 849f591f40ba4ceb84d7112b20a5fbde P 6190c451021542509c1ea69a4199d874 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:07:47.582705 31129 raft_consensus.cc:686] T 849f591f40ba4ceb84d7112b20a5fbde P 6190c451021542509c1ea69a4199d874 [term 1 LEADER]: Becoming Leader. State: Replica: 6190c451021542509c1ea69a4199d874, State: Running, Role: LEADER
I20260811 05:07:47.582767 31129 consensus_queue.cc:237] T 849f591f40ba4ceb84d7112b20a5fbde P 6190c451021542509c1ea69a4199d874 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60ebd7d2397f475ea3e0101349417482" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 42455 } } peers { permanent_uuid: "fb362415e802498aa60beb90898b5715" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40153 } } peers { permanent_uuid: "6190c451021542509c1ea69a4199d874" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 43857 } }
I20260811 05:07:47.583498 30199 catalog_manager.cc:5495] T 849f591f40ba4ceb84d7112b20a5fbde P 6190c451021542509c1ea69a4199d874 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6190c451021542509c1ea69a4199d874 (127.26.191.195). New cstate: current_term: 1 leader_uuid: "6190c451021542509c1ea69a4199d874" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60ebd7d2397f475ea3e0101349417482" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 42455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fb362415e802498aa60beb90898b5715" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6190c451021542509c1ea69a4199d874" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 43857 } health_report { overall_health: HEALTHY } } }
I20260811 05:07:47.602941 31188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:47.600360 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51948 (local address 127.26.191.195:43857)
0811 05:07:47.600584 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:47.600586 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:47.600592 (+ 6us) server_negotiation.cc:407] Connection header received
0811 05:07:47.600611 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:47.600612 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:47.600622 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:47.600694 (+ 72us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:07:47.600910 (+ 216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:47.601410 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:47.602163 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:47.602391 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:47.602469 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:47.602632 (+ 163us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:07:47.602670 (+ 38us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:07:47.602743 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:47.602810 (+ 67us) server_negotiation.cc:299] Negotiation successful
0811 05:07:47.602835 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":183,"thread_start_us":134,"threads_started":1}
I20260811 05:07:47.605855 30670 raft_consensus.cc:1261] T 849f591f40ba4ceb84d7112b20a5fbde P fb362415e802498aa60beb90898b5715 [term 1 FOLLOWER]: Refusing update from remote peer 6190c451021542509c1ea69a4199d874: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:07:47.605875 30453 raft_consensus.cc:1261] T 849f591f40ba4ceb84d7112b20a5fbde P 60ebd7d2397f475ea3e0101349417482 [term 1 FOLLOWER]: Refusing update from remote peer 6190c451021542509c1ea69a4199d874: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:07:47.606125 31129 consensus_queue.cc:1035] T 849f591f40ba4ceb84d7112b20a5fbde P 6190c451021542509c1ea69a4199d874 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb362415e802498aa60beb90898b5715" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:07:47.606251 31129 consensus_queue.cc:1035] T 849f591f40ba4ceb84d7112b20a5fbde P 6190c451021542509c1ea69a4199d874 [LEADER]: Connected to new peer: Peer: permanent_uuid: "60ebd7d2397f475ea3e0101349417482" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 42455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 05:07:47.611420 31118 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260811 05:07:49.131597 30199 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:42264:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:07:49.131740 30199 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:42264:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:07:49.132777 30199 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1f0bd85d319f49448cda2b835175d76a: Sending DeleteTablet for 3 replicas of tablet 849f591f40ba4ceb84d7112b20a5fbde
I20260811 05:07:49.133069 30425 tablet_service.cc:1514] Processing DeleteTablet for tablet 849f591f40ba4ceb84d7112b20a5fbde with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:07:49 UTC) from {username='kudu', principal='kudu/127.26.191.254@KRBTEST.COM'} at 127.0.0.1:35746
I20260811 05:07:49.133104 30644 tablet_service.cc:1514] Processing DeleteTablet for tablet 849f591f40ba4ceb84d7112b20a5fbde with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:07:49 UTC) from {username='kudu', principal='kudu/127.26.191.254@KRBTEST.COM'} at 127.0.0.1:52386
I20260811 05:07:49.133172 30883 tablet_service.cc:1514] Processing DeleteTablet for tablet 849f591f40ba4ceb84d7112b20a5fbde with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:07:49 UTC) from {username='kudu', principal='kudu/127.26.191.254@KRBTEST.COM'} at 127.0.0.1:51926
I20260811 05:07:49.133410 31227 tablet_replica.cc:330] T 849f591f40ba4ceb84d7112b20a5fbde P 6190c451021542509c1ea69a4199d874: stopping tablet replica
I20260811 05:07:49.133451 31224 tablet_replica.cc:330] T 849f591f40ba4ceb84d7112b20a5fbde P 60ebd7d2397f475ea3e0101349417482: stopping tablet replica
I20260811 05:07:49.133497 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 30322
I20260811 05:07:49.133536 31227 raft_consensus.cc:2229] T 849f591f40ba4ceb84d7112b20a5fbde P 6190c451021542509c1ea69a4199d874 [term 1 LEADER]: Raft consensus shutting down.
I20260811 05:07:49.133605 31227 raft_consensus.cc:2258] T 849f591f40ba4ceb84d7112b20a5fbde P 6190c451021542509c1ea69a4199d874 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:07:49.143635 31223 tablet_replica.cc:330] T 849f591f40ba4ceb84d7112b20a5fbde P fb362415e802498aa60beb90898b5715: stopping tablet replica
I20260811 05:07:49.143746 31223 raft_consensus.cc:2229] T 849f591f40ba4ceb84d7112b20a5fbde P fb362415e802498aa60beb90898b5715 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 05:07:49.143800 31223 raft_consensus.cc:2258] T 849f591f40ba4ceb84d7112b20a5fbde P fb362415e802498aa60beb90898b5715 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:07:49.144130 31223 ts_tablet_manager.cc:1905] T 849f591f40ba4ceb84d7112b20a5fbde P fb362415e802498aa60beb90898b5715: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:07:49.144831 31227 ts_tablet_manager.cc:1905] T 849f591f40ba4ceb84d7112b20a5fbde P 6190c451021542509c1ea69a4199d874: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:07:49.146252 31223 ts_tablet_manager.cc:1918] T 849f591f40ba4ceb84d7112b20a5fbde P fb362415e802498aa60beb90898b5715: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 05:07:49.146404 31223 log.cc:1196] T 849f591f40ba4ceb84d7112b20a5fbde P fb362415e802498aa60beb90898b5715: Deleting WAL directory at /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/minicluster-data/ts-1/wal/wals/849f591f40ba4ceb84d7112b20a5fbde
I20260811 05:07:49.146770 31223 ts_tablet_manager.cc:1939] T 849f591f40ba4ceb84d7112b20a5fbde P fb362415e802498aa60beb90898b5715: Deleting consensus metadata
I20260811 05:07:49.147114 31227 ts_tablet_manager.cc:1918] T 849f591f40ba4ceb84d7112b20a5fbde P 6190c451021542509c1ea69a4199d874: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 05:07:49.147188 31227 log.cc:1196] T 849f591f40ba4ceb84d7112b20a5fbde P 6190c451021542509c1ea69a4199d874: Deleting WAL directory at /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424853995437-27391-0/minicluster-data/ts-2/wal/wals/849f591f40ba4ceb84d7112b20a5fbde
I20260811 05:07:49.147275 30183 catalog_manager.cc:4841] TS fb362415e802498aa60beb90898b5715 (127.26.191.194:40153): tablet 849f591f40ba4ceb84d7112b20a5fbde (table test-table [id=4ab811f8fbf94387ac8e27fac4c22f8b]) successfully deleted
I20260811 05:07:49.147504 31227 ts_tablet_manager.cc:1939] T 849f591f40ba4ceb84d7112b20a5fbde P 6190c451021542509c1ea69a4199d874: Deleting consensus metadata
I20260811 05:07:49.148465 30183 catalog_manager.cc:4841] TS 6190c451021542509c1ea69a4199d874 (127.26.191.195:43857): tablet 849f591f40ba4ceb84d7112b20a5fbde (table test-table [id=4ab811f8fbf94387ac8e27fac4c22f8b]) successfully deleted
W20260811 05:07:49.151731 30179 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.191.193:42455 (error 108)
I20260811 05:07:49.152081 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 30538
I20260811 05:07:49.159101 31231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:49.152235 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.193:42455 (local address 127.0.0.1:35748)
0811 05:07:49.158908 (+ 6673us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:49.159024 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.193:42455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":6626,"thread_start_us":72,"threads_started":1}
W20260811 05:07:49.166620 30179 catalog_manager.cc:4584] TS 60ebd7d2397f475ea3e0101349417482 (127.26.191.193:42455): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 849f591f40ba4ceb84d7112b20a5fbde: Network error: Client connection negotiation failed: client connection to 127.26.191.193:42455: connect: Connection refused (error 111)
I20260811 05:07:49.172333 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 30760
I20260811 05:07:49.183840 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 30160
2026-08-11T05:07:49Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (6073 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424853995437-27391-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 05:07:49 dist-test-slave-x5fp krb5kdc[31235](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 05:07:49 dist-test-slave-x5fp krb5kdc[31235](info): set up 2 sockets
Aug 11 05:07:49 dist-test-slave-x5fp krb5kdc[31235](info): commencing operation
krb5kdc: starting...
W20260811 05:07:50.468184 27391 mini_kdc.cc:121] Time spent starting KDC: real 1.257s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424853995437-27391-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424853995437-27391-0/krb5kdc/test-user.keytab.
Aug 11 05:07:50 dist-test-slave-x5fp krb5kdc[31235](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424870, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T05:07:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:07:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.191.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.191.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.191.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab.
Entry for principal kudu/127.26.191.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab.
I20260811 05:07:50.608143 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424853995437-27391-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424853995437-27391-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424853995437-27391-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.254:43237
--webserver_interface=127.26.191.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab
--principal=kudu/127.26.191.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:35553
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.191.254:43237
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:07:50.697208 31257 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:07:50.697448 31257 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:07:50.697472 31257 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:07:50.698585 31257 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:07:50.698621 31257 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:07:50.698637 31257 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:07:50.698650 31257 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:07:50.698662 31257 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:07:50.700105 31257 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:35553
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424853995437-27391-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424853995437-27391-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.191.254:43237
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab
--principal=kudu/127.26.191.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.254:43237
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.191.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31257
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424853995437-27391-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:07:50.700316 31257 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:07:50.700498 31257 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:07:50.706051 31266 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:07:50.706110 31257 server_base.cc:1034] running on GCE node
W20260811 05:07:50.706127 31265 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:50.706241 31271 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:07:50.706622 31257 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:07:50.706997 31257 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:07:50.708200 31257 hybrid_clock.cc:648] HybridClock initialized: now 1786424870708179 us; error 48 us; skew 500 ppm
Aug 11 05:07:50 dist-test-slave-x5fp krb5kdc[31235](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424870, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:07:50.715859 31257 init.cc:377] Logged in from keytab as kudu/127.26.191.254@KRBTEST.COM (short username kudu)
I20260811 05:07:50.716404 31257 webserver.cc:460] Webserver started at http://127.26.191.254:36379/ using document root <none> and password file <none>
I20260811 05:07:50.716660 31257 fs_manager.cc:359] Metadata directory not provided
I20260811 05:07:50.716710 31257 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:07:50.716948 31257 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:07:50.718140 31257 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424853995437-27391-0/minicluster-data/master-0/data/instance:
uuid: "9342bee6077a43c1b02e81922e873b38"
format_stamp: "Formatted at 2026-08-11 05:07:50 on dist-test-slave-x5fp"
server_key: "889632859156f3892712d1d6a4071866"
server_key_iv: "25bfee625c4dfe8df155b1d7969c1854"
server_key_version: "encryptionkey@0"
I20260811 05:07:50.718538 31257 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424853995437-27391-0/minicluster-data/master-0/wal/instance:
uuid: "9342bee6077a43c1b02e81922e873b38"
format_stamp: "Formatted at 2026-08-11 05:07:50 on dist-test-slave-x5fp"
server_key: "889632859156f3892712d1d6a4071866"
server_key_iv: "25bfee625c4dfe8df155b1d7969c1854"
server_key_version: "encryptionkey@0"
I20260811 05:07:50.720070 31257 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 05:07:50.721091 31279 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:50.721335 31257 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:07:50.721441 31257 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424853995437-27391-0/minicluster-data/master-0/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424853995437-27391-0/minicluster-data/master-0/wal
uuid: "9342bee6077a43c1b02e81922e873b38"
format_stamp: "Formatted at 2026-08-11 05:07:50 on dist-test-slave-x5fp"
server_key: "889632859156f3892712d1d6a4071866"
server_key_iv: "25bfee625c4dfe8df155b1d7969c1854"
server_key_version: "encryptionkey@0"
I20260811 05:07:50.721501 31257 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424853995437-27391-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424853995437-27391-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424853995437-27391-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:07:50.731098 31257 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:07:50.733500 31257 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:07:50.733614 31257 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:07:50.737669 31257 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.254:43237
I20260811 05:07:50.737767 31369 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.254:43237 every 8 connection(s)
I20260811 05:07:50.738343 31257 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
I20260811 05:07:50.739112 31370 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:07:50.741580 31370 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9342bee6077a43c1b02e81922e873b38: Bootstrap starting.
I20260811 05:07:50.742156 31370 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9342bee6077a43c1b02e81922e873b38: Neither blocks nor log segments found. Creating new log.
I20260811 05:07:50.742411 31370 log.cc:824] T 00000000000000000000000000000000 P 9342bee6077a43c1b02e81922e873b38: Log is configured to *not* fsync() on all Append() calls
I20260811 05:07:50.743171 31370 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9342bee6077a43c1b02e81922e873b38: No bootstrap required, opened a new log
I20260811 05:07:50.744946 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 31257
I20260811 05:07:50.744879 31370 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9342bee6077a43c1b02e81922e873b38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9342bee6077a43c1b02e81922e873b38" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 43237 } }
I20260811 05:07:50.745028 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424853995437-27391-0/minicluster-data/master-0/wal/instance
I20260811 05:07:50.745045 31370 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9342bee6077a43c1b02e81922e873b38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:07:50.745117 31370 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9342bee6077a43c1b02e81922e873b38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9342bee6077a43c1b02e81922e873b38, State: Initialized, Role: FOLLOWER
I20260811 05:07:50.745260 27391 external_mini_cluster.cc:1428] Setting key a2bc18afbb7cd9a30d38fbfc8e2d324c
I20260811 05:07:50.745322 31370 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9342bee6077a43c1b02e81922e873b38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9342bee6077a43c1b02e81922e873b38" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 43237 } }
I20260811 05:07:50.745417 31370 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9342bee6077a43c1b02e81922e873b38 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:07:50.745477 31370 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9342bee6077a43c1b02e81922e873b38 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:07:50.745532 31370 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9342bee6077a43c1b02e81922e873b38 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:07:50.747040 31370 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9342bee6077a43c1b02e81922e873b38 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9342bee6077a43c1b02e81922e873b38" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 43237 } }
I20260811 05:07:50.747141 31370 leader_election.cc:302] T 00000000000000000000000000000000 P 9342bee6077a43c1b02e81922e873b38 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9342bee6077a43c1b02e81922e873b38; no voters:
I20260811 05:07:50.747371 31370 leader_election.cc:288] T 00000000000000000000000000000000 P 9342bee6077a43c1b02e81922e873b38 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 05:07:50.747391 31376 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9342bee6077a43c1b02e81922e873b38 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:07:50.747586 31376 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9342bee6077a43c1b02e81922e873b38 [term 1 LEADER]: Becoming Leader. State: Replica: 9342bee6077a43c1b02e81922e873b38, State: Running, Role: LEADER
I20260811 05:07:50.747725 31370 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9342bee6077a43c1b02e81922e873b38 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:07:50.747695 31376 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9342bee6077a43c1b02e81922e873b38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9342bee6077a43c1b02e81922e873b38" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 43237 } }
I20260811 05:07:50.748234 31377 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9342bee6077a43c1b02e81922e873b38 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9342bee6077a43c1b02e81922e873b38. Latest consensus state: current_term: 1 leader_uuid: "9342bee6077a43c1b02e81922e873b38" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9342bee6077a43c1b02e81922e873b38" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 43237 } } }
I20260811 05:07:50.748329 31377 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9342bee6077a43c1b02e81922e873b38 [sys.catalog]: This master's current role is: LEADER
I20260811 05:07:50.748819 31378 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9342bee6077a43c1b02e81922e873b38 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9342bee6077a43c1b02e81922e873b38" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9342bee6077a43c1b02e81922e873b38" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 43237 } } }
I20260811 05:07:50.748986 31378 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9342bee6077a43c1b02e81922e873b38 [sys.catalog]: This master's current role is: LEADER
I20260811 05:07:50.748873 31388 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:07:50.750046 31388 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:07:50.751725 31388 catalog_manager.cc:1347] Generated new cluster ID: f34fda3ab7ce4d16882123e4dcf1bd3b
I20260811 05:07:50.751782 31388 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 05:07:50 dist-test-slave-x5fp krb5kdc[31235](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424870, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
I20260811 05:07:50.757526 31374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:50.745879 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43856 (local address 127.26.191.254:43237)
0811 05:07:50.746164 (+ 285us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:50.746210 (+ 46us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:50.746249 (+ 39us) server_negotiation.cc:407] Connection header received
0811 05:07:50.746424 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:50.746434 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:50.746506 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:50.746674 (+ 168us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:50.747471 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:50.748889 (+ 1418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:50.749932 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:50.750546 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:50.750664 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:50.753672 (+ 3008us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:50.753682 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:50.753683 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:07:50.753695 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:50.755723 (+ 2028us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:50.756193 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:50.756196 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:50.756197 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:50.756320 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:50.756537 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:50.756538 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:50.756538 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:50.756882 (+ 344us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:50.757043 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:50.757185 (+ 142us) server_negotiation.cc:299] Negotiation successful
0811 05:07:50.757323 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":230,"thread_start_us":109,"threads_started":1}
I20260811 05:07:50.781584 31388 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:07:50.782382 31388 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:07:50.790197 31388 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9342bee6077a43c1b02e81922e873b38: Generated new TSK 0
I20260811 05:07:50.790437 31388 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.191.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.191.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.191.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.193.keytab.
Entry for principal kudu/127.26.191.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.193.keytab.
I20260811 05:07:50.828936 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.191.193:0
--local_ip_for_outbound_sockets=127.26.191.193
--webserver_interface=127.26.191.193
--webserver_port=0
--tserver_master_addrs=127.26.191.254:43237
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.193.keytab
--principal=kudu/127.26.191.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:35553
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:07:50.918264 31414 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:07:50.918527 31414 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:07:50.918567 31414 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:07:50.919790 31414 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:07:50.919866 31414 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:07:50.919919 31414 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.191.193
I20260811 05:07:50.921496 31414 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:35553
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.193.keytab
--principal=kudu/127.26.191.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.191.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.191.193
--webserver_port=0
--tserver_master_addrs=127.26.191.254:43237
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31414
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.191.193
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:07:50.921788 31414 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:07:50.922043 31414 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:07:50.927409 31423 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:07:50.927572 31414 server_base.cc:1034] running on GCE node
W20260811 05:07:50.927378 31427 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:50.927394 31425 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:07:50.927949 31414 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:07:50.928223 31414 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:07:50.929388 31414 hybrid_clock.cc:648] HybridClock initialized: now 1786424870929368 us; error 39 us; skew 500 ppm
Aug 11 05:07:50 dist-test-slave-x5fp krb5kdc[31235](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424870, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:07:50.932106 31414 init.cc:377] Logged in from keytab as kudu/127.26.191.193@KRBTEST.COM (short username kudu)
I20260811 05:07:50.932617 31414 webserver.cc:460] Webserver started at http://127.26.191.193:39545/ using document root <none> and password file <none>
I20260811 05:07:50.932900 31414 fs_manager.cc:359] Metadata directory not provided
I20260811 05:07:50.932950 31414 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:07:50.933051 31414 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:07:50.934105 31414 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-0/data/instance:
uuid: "d4637e153975461e9bb031e094510e77"
format_stamp: "Formatted at 2026-08-11 05:07:50 on dist-test-slave-x5fp"
server_key: "83f30a17e1bff4d9ef01a2929e78283a"
server_key_iv: "41530b6617047f18055e080d1b8c0955"
server_key_version: "encryptionkey@0"
I20260811 05:07:50.934432 31414 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-0/wal/instance:
uuid: "d4637e153975461e9bb031e094510e77"
format_stamp: "Formatted at 2026-08-11 05:07:50 on dist-test-slave-x5fp"
server_key: "83f30a17e1bff4d9ef01a2929e78283a"
server_key_iv: "41530b6617047f18055e080d1b8c0955"
server_key_version: "encryptionkey@0"
I20260811 05:07:50.935853 31414 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 05:07:50.936755 31438 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:50.937042 31414 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:07:50.937150 31414 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-0/wal
uuid: "d4637e153975461e9bb031e094510e77"
format_stamp: "Formatted at 2026-08-11 05:07:50 on dist-test-slave-x5fp"
server_key: "83f30a17e1bff4d9ef01a2929e78283a"
server_key_iv: "41530b6617047f18055e080d1b8c0955"
server_key_version: "encryptionkey@0"
I20260811 05:07:50.937218 31414 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:07:50.944541 31414 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:07:50.947082 31414 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:07:50.947249 31414 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:07:50.947490 31414 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:07:50.947960 31414 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:07:50.948037 31414 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:50.948088 31414 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:07:50.948134 31414 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:50.955329 31414 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.193:35599
I20260811 05:07:50.955453 31602 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.193:35599 every 8 connection(s)
I20260811 05:07:50.955832 31414 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-0/data/info.pb
Aug 11 05:07:50 dist-test-slave-x5fp krb5kdc[31235](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424870, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.193@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
I20260811 05:07:50.965883 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 31414
I20260811 05:07:50.966010 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-0/wal/instance
I20260811 05:07:50.966216 27391 external_mini_cluster.cc:1428] Setting key a9d9203dcb95def3c52b88b8b4520210
I20260811 05:07:50.966399 31374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:50.956808 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.193:54019 (local address 127.26.191.254:43237)
0811 05:07:50.956887 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:50.956889 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:50.957064 (+ 175us) server_negotiation.cc:407] Connection header received
0811 05:07:50.957621 (+ 557us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:50.957623 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:50.957638 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:50.957702 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:50.958866 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:50.959397 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:50.960480 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:50.960684 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:50.960838 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:50.963285 (+ 2447us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:50.963287 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:50.963287 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:07:50.963296 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:50.964848 (+ 1552us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:50.965308 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:50.965309 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:50.965309 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:50.965374 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:50.965671 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:50.965672 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:50.965672 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:50.965802 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:50.965875 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:50.966211 (+ 336us) server_negotiation.cc:299] Negotiation successful
0811 05:07:50.966304 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 05:07:50.966619 31607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:50.956701 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:43237 (local address 127.26.191.193:54019)
0811 05:07:50.956923 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:50.956968 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:50.957496 (+ 528us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:50.957807 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:50.957811 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:50.958504 (+ 693us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:07:50.958732 (+ 228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:50.958738 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:50.959509 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:50.959510 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:50.960381 (+ 871us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:50.960384 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:50.960852 (+ 468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:50.960854 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:50.960995 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:50.961571 (+ 576us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:07:50.961580 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:07:50.963147 (+ 1567us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:07:50.964954 (+ 1807us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:07:50.964963 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:07:50.964965 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:07:50.965224 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:07:50.965445 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:07:50.965446 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:07:50.965447 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:07:50.965572 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:07:50.965877 (+ 305us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:07:50.965886 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:07:50.966066 (+ 180us) client_negotiation.cc:769] Sending connection context
0811 05:07:50.966174 (+ 108us) client_negotiation.cc:240] Negotiation successful
0811 05:07:50.966359 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":119,"threads_started":1}
I20260811 05:07:50.967093 31603 heartbeater.cc:347] Connected to a master server at 127.26.191.254:43237
I20260811 05:07:50.967192 31603 heartbeater.cc:464] Registering TS with master...
I20260811 05:07:50.967406 31603 heartbeater.cc:511] Master 127.26.191.254:43237 requested a full tablet report, sending...
I20260811 05:07:50.968031 31306 ts_manager.cc:194] Registered new tserver with Master: d4637e153975461e9bb031e094510e77 (127.26.191.193:35599)
I20260811 05:07:50.968608 31306 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.191.193@KRBTEST.COM'} at 127.26.191.193:54019
WARNING: no policy specified for kudu/127.26.191.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.191.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.191.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.194.keytab.
Entry for principal kudu/127.26.191.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.194.keytab.
I20260811 05:07:51.000990 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.191.194:0
--local_ip_for_outbound_sockets=127.26.191.194
--webserver_interface=127.26.191.194
--webserver_port=0
--tserver_master_addrs=127.26.191.254:43237
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.194.keytab
--principal=kudu/127.26.191.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:35553
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:07:51.092104 31612 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:07:51.092455 31612 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:07:51.092507 31612 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:07:51.093961 31612 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:07:51.094050 31612 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:07:51.094097 31612 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.191.194
I20260811 05:07:51.095781 31612 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:35553
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.194.keytab
--principal=kudu/127.26.191.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.191.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.191.194
--webserver_port=0
--tserver_master_addrs=127.26.191.254:43237
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31612
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.191.194
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:07:51.096127 31612 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:07:51.096396 31612 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:07:51.101945 31625 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:51.101922 31621 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:51.101922 31622 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:07:51.102439 31612 server_base.cc:1034] running on GCE node
I20260811 05:07:51.102727 31612 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:07:51.102970 31612 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:07:51.104135 31612 hybrid_clock.cc:648] HybridClock initialized: now 1786424871104123 us; error 37 us; skew 500 ppm
Aug 11 05:07:51 dist-test-slave-x5fp krb5kdc[31235](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424871, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:07:51.107302 31612 init.cc:377] Logged in from keytab as kudu/127.26.191.194@KRBTEST.COM (short username kudu)
I20260811 05:07:51.107834 31612 webserver.cc:460] Webserver started at http://127.26.191.194:43181/ using document root <none> and password file <none>
I20260811 05:07:51.108095 31612 fs_manager.cc:359] Metadata directory not provided
I20260811 05:07:51.108146 31612 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:07:51.108284 31612 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:07:51.109504 31612 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-1/data/instance:
uuid: "cda1a01a772e483aa3d3379a4c6a8f73"
format_stamp: "Formatted at 2026-08-11 05:07:51 on dist-test-slave-x5fp"
server_key: "aaad2d0056c9019ca52c1c7f8296352f"
server_key_iv: "3b6d28769329d46f70d8bbf26490f00d"
server_key_version: "encryptionkey@0"
I20260811 05:07:51.109944 31612 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-1/wal/instance:
uuid: "cda1a01a772e483aa3d3379a4c6a8f73"
format_stamp: "Formatted at 2026-08-11 05:07:51 on dist-test-slave-x5fp"
server_key: "aaad2d0056c9019ca52c1c7f8296352f"
server_key_iv: "3b6d28769329d46f70d8bbf26490f00d"
server_key_version: "encryptionkey@0"
I20260811 05:07:51.111493 31612 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 05:07:51.112828 31637 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:51.113065 31612 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:07:51.113174 31612 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-1/wal
uuid: "cda1a01a772e483aa3d3379a4c6a8f73"
format_stamp: "Formatted at 2026-08-11 05:07:51 on dist-test-slave-x5fp"
server_key: "aaad2d0056c9019ca52c1c7f8296352f"
server_key_iv: "3b6d28769329d46f70d8bbf26490f00d"
server_key_version: "encryptionkey@0"
I20260811 05:07:51.113279 31612 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:07:51.126706 31612 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:07:51.129480 31612 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:07:51.129676 31612 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:07:51.130014 31612 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:07:51.130399 31612 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:07:51.130440 31612 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:51.130466 31612 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:07:51.130481 31612 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:51.137132 31612 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.194:41353
I20260811 05:07:51.137223 31809 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.194:41353 every 8 connection(s)
I20260811 05:07:51.137627 31612 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-1/data/info.pb
I20260811 05:07:51.138046 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 31612
I20260811 05:07:51.138157 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-1/wal/instance
I20260811 05:07:51.138383 27391 external_mini_cluster.cc:1428] Setting key 8087072a7ce32bb68f063655a8bc1f05
Aug 11 05:07:51 dist-test-slave-x5fp krb5kdc[31235](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424871, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.194@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.26.191.195@KRBTEST.COM; defaulting to no policy
I20260811 05:07:51.151381 31374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:51.138568 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.194:46485 (local address 127.26.191.254:43237)
0811 05:07:51.138630 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:51.138633 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:51.138962 (+ 329us) server_negotiation.cc:407] Connection header received
0811 05:07:51.139786 (+ 824us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:51.139787 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:51.139799 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:51.139859 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:51.141356 (+ 1497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:51.142300 (+ 944us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:51.143554 (+ 1254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:51.143947 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:51.144056 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:51.147100 (+ 3044us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:51.147102 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:51.147102 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:07:51.147110 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:51.149414 (+ 2304us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:51.150089 (+ 675us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:51.150090 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:51.150090 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:51.150155 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:51.150569 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:51.150571 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:51.150571 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:51.150731 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:51.150806 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:51.151200 (+ 394us) server_negotiation.cc:299] Negotiation successful
0811 05:07:51.151302 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 05:07:51.151635 31814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:51.138548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:43237 (local address 127.26.191.194:46485)
0811 05:07:51.138811 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:51.138863 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:51.139643 (+ 780us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:51.139945 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:51.139950 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:51.140894 (+ 944us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:07:51.141213 (+ 319us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:51.141221 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:51.142459 (+ 1238us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:51.142460 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:51.143435 (+ 975us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:51.143438 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:51.144082 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:51.144083 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:51.144212 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:51.145066 (+ 854us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:07:51.145076 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:07:51.146952 (+ 1876us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:07:51.149525 (+ 2573us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:07:51.149539 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:07:51.149542 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:07:51.149976 (+ 434us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:07:51.150254 (+ 278us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:07:51.150255 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:07:51.150256 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:07:51.150458 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:07:51.150836 (+ 378us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:07:51.150845 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:07:51.151023 (+ 178us) client_negotiation.cc:769] Sending connection context
0811 05:07:51.151136 (+ 113us) client_negotiation.cc:240] Negotiation successful
0811 05:07:51.151288 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":108,"threads_started":1}
I20260811 05:07:51.152181 31810 heartbeater.cc:347] Connected to a master server at 127.26.191.254:43237
I20260811 05:07:51.152311 31810 heartbeater.cc:464] Registering TS with master...
I20260811 05:07:51.152635 31810 heartbeater.cc:511] Master 127.26.191.254:43237 requested a full tablet report, sending...
I20260811 05:07:51.153321 31306 ts_manager.cc:194] Registered new tserver with Master: cda1a01a772e483aa3d3379a4c6a8f73 (127.26.191.194:41353)
I20260811 05:07:51.153767 31306 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.191.194@KRBTEST.COM'} at 127.26.191.194:46485
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.191.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.191.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.195.keytab.
Entry for principal kudu/127.26.191.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.195.keytab.
I20260811 05:07:51.172935 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.191.195:0
--local_ip_for_outbound_sockets=127.26.191.195
--webserver_interface=127.26.191.195
--webserver_port=0
--tserver_master_addrs=127.26.191.254:43237
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.195.keytab
--principal=kudu/127.26.191.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:35553
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:07:51.262296 31819 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:07:51.262576 31819 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:07:51.262619 31819 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:07:51.263854 31819 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:07:51.263926 31819 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:07:51.263972 31819 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.191.195
I20260811 05:07:51.265575 31819 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:35553
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.195.keytab
--principal=kudu/127.26.191.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.191.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.191.195
--webserver_port=0
--tserver_master_addrs=127.26.191.254:43237
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31819
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.191.195
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:07:51.265875 31819 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:07:51.266129 31819 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:07:51.271736 31826 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:51.271744 31825 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:51.271806 31828 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:07:51.272558 31819 server_base.cc:1034] running on GCE node
I20260811 05:07:51.272845 31819 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:07:51.273138 31819 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:07:51.274313 31819 hybrid_clock.cc:648] HybridClock initialized: now 1786424871274359 us; error 92 us; skew 500 ppm
Aug 11 05:07:51 dist-test-slave-x5fp krb5kdc[31235](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424871, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:07:51.277366 31819 init.cc:377] Logged in from keytab as kudu/127.26.191.195@KRBTEST.COM (short username kudu)
I20260811 05:07:51.277899 31819 webserver.cc:460] Webserver started at http://127.26.191.195:38325/ using document root <none> and password file <none>
I20260811 05:07:51.278184 31819 fs_manager.cc:359] Metadata directory not provided
I20260811 05:07:51.278275 31819 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:07:51.278451 31819 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:07:51.279711 31819 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-2/data/instance:
uuid: "1c94881eeac3415190c30b4d758d57f9"
format_stamp: "Formatted at 2026-08-11 05:07:51 on dist-test-slave-x5fp"
server_key: "3bbd3b7bca349f2dd263c24fbcd22eda"
server_key_iv: "7f6ff160d169660ad0edba69a36c5e76"
server_key_version: "encryptionkey@0"
I20260811 05:07:51.280136 31819 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-2/wal/instance:
uuid: "1c94881eeac3415190c30b4d758d57f9"
format_stamp: "Formatted at 2026-08-11 05:07:51 on dist-test-slave-x5fp"
server_key: "3bbd3b7bca349f2dd263c24fbcd22eda"
server_key_iv: "7f6ff160d169660ad0edba69a36c5e76"
server_key_version: "encryptionkey@0"
I20260811 05:07:51.281798 31819 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.004s
I20260811 05:07:51.282989 31836 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:51.283215 31819 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.001s
I20260811 05:07:51.283341 31819 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-2/wal
uuid: "1c94881eeac3415190c30b4d758d57f9"
format_stamp: "Formatted at 2026-08-11 05:07:51 on dist-test-slave-x5fp"
server_key: "3bbd3b7bca349f2dd263c24fbcd22eda"
server_key_iv: "7f6ff160d169660ad0edba69a36c5e76"
server_key_version: "encryptionkey@0"
I20260811 05:07:51.283427 31819 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:07:51.299212 31819 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:07:51.301956 31819 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:07:51.302157 31819 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:07:51.302500 31819 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:07:51.302873 31819 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:07:51.302938 31819 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:51.302983 31819 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:07:51.303010 31819 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:51.309437 31819 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.195:44323
I20260811 05:07:51.309479 32012 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.195:44323 every 8 connection(s)
I20260811 05:07:51.309984 31819 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-2/data/info.pb
Aug 11 05:07:51 dist-test-slave-x5fp krb5kdc[31235](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424871, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.195@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
I20260811 05:07:51.320158 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 31819
I20260811 05:07:51.320302 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-2/wal/instance
I20260811 05:07:51.320497 27391 external_mini_cluster.cc:1428] Setting key 11971151e01eb507f849e86596f804f0
I20260811 05:07:51.321735 31374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:51.310938 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.195:51009 (local address 127.26.191.254:43237)
0811 05:07:51.311020 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:51.311023 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:51.311382 (+ 359us) server_negotiation.cc:407] Connection header received
0811 05:07:51.311969 (+ 587us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:51.311970 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:51.311981 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:51.312044 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:51.313265 (+ 1221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:51.313860 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:51.314955 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:51.315185 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:51.315273 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:51.318131 (+ 2858us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:51.318133 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:51.318133 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:07:51.318140 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:51.319793 (+ 1653us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:51.320391 (+ 598us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:51.320393 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:51.320393 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:51.320470 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:51.320847 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:51.320848 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:51.320848 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:51.321020 (+ 172us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:51.321091 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:51.321512 (+ 421us) server_negotiation.cc:299] Negotiation successful
0811 05:07:51.321630 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 05:07:51.322006 32015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:51.310907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:43237 (local address 127.26.191.195:51009)
0811 05:07:51.311189 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:51.311270 (+ 81us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:51.311862 (+ 592us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:51.312152 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:51.312156 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:51.312912 (+ 756us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:07:51.313128 (+ 216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:51.313134 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:51.313969 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:51.313970 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:51.314849 (+ 879us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:51.314851 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:51.315315 (+ 464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:51.315316 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:51.315444 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:51.316106 (+ 662us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:07:51.316116 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:07:51.318011 (+ 1895us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:07:51.319886 (+ 1875us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:07:51.319893 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:07:51.319895 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:07:51.320305 (+ 410us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:07:51.320553 (+ 248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:07:51.320554 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:07:51.320554 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:07:51.320712 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:07:51.321167 (+ 455us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:07:51.321176 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:07:51.321349 (+ 173us) client_negotiation.cc:769] Sending connection context
0811 05:07:51.321485 (+ 136us) client_negotiation.cc:240] Negotiation successful
0811 05:07:51.321663 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":129,"threads_started":1}
I20260811 05:07:51.322429 32013 heartbeater.cc:347] Connected to a master server at 127.26.191.254:43237
I20260811 05:07:51.322523 32013 heartbeater.cc:464] Registering TS with master...
I20260811 05:07:51.322742 32013 heartbeater.cc:511] Master 127.26.191.254:43237 requested a full tablet report, sending...
I20260811 05:07:51.323097 31306 ts_manager.cc:194] Registered new tserver with Master: 1c94881eeac3415190c30b4d758d57f9 (127.26.191.195:44323)
I20260811 05:07:51.323489 31306 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.191.195@KRBTEST.COM'} at 127.26.191.195:51009
I20260811 05:07:51.333161 27391 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260811 05:07:51.347934 31374 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:07:51.346883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43862 (local address 127.26.191.254:43237)
0811 05:07:51.346965 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:51.346967 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:51.347072 (+ 105us) server_negotiation.cc:407] Connection header received
0811 05:07:51.347127 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:51.347128 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:51.347138 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:51.347207 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:51.347810 (+ 603us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43862: BlockingRecv error: recv got EOF from 127.0.0.1:43862 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 05:07:51.348953 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 31414
I20260811 05:07:51.368397 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 31612
I20260811 05:07:51.378561 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 31819
I20260811 05:07:51.393025 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 31257
2026-08-11T05:07:51Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (2211 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786424853995437-27391-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 05:07:51 dist-test-slave-x5fp krb5kdc[32034](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 05:07:51 dist-test-slave-x5fp krb5kdc[32034](info): set up 2 sockets
Aug 11 05:07:51 dist-test-slave-x5fp krb5kdc[32034](info): commencing operation
krb5kdc: starting...
W20260811 05:07:52.674269 27391 mini_kdc.cc:121] Time spent starting KDC: real 1.251s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786424853995437-27391-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786424853995437-27391-0/krb5kdc/test-user.keytab.
Aug 11 05:07:52 dist-test-slave-x5fp krb5kdc[32034](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424872, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T05:07:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:07:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.191.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.191.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.191.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab.
Entry for principal kudu/127.26.191.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab.
I20260811 05:07:52.808643 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786424853995437-27391-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786424853995437-27391-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786424853995437-27391-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.254:32915
--webserver_interface=127.26.191.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab
--principal=kudu/127.26.191.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:37733
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.191.254:32915
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:07:52.894268 32065 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:07:52.894559 32065 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:07:52.894606 32065 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:07:52.895860 32065 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:07:52.895942 32065 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:07:52.895967 32065 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:07:52.895987 32065 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:07:52.896019 32065 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:07:52.897691 32065 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:37733
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786424853995437-27391-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786424853995437-27391-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.191.254:32915
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab
--principal=kudu/127.26.191.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.254:32915
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.191.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32065
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786424853995437-27391-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:07:52.898005 32065 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:07:52.898278 32065 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:07:52.903998 32072 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:52.904204 32073 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:52.904000 32075 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:07:52.904701 32065 server_base.cc:1034] running on GCE node
I20260811 05:07:52.905033 32065 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:07:52.905318 32065 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:07:52.906481 32065 hybrid_clock.cc:648] HybridClock initialized: now 1786424872906438 us; error 55 us; skew 500 ppm
Aug 11 05:07:52 dist-test-slave-x5fp krb5kdc[32034](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424872, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:07:52.909473 32065 init.cc:377] Logged in from keytab as kudu/127.26.191.254@KRBTEST.COM (short username kudu)
I20260811 05:07:52.910214 32065 webserver.cc:460] Webserver started at http://127.26.191.254:39365/ using document root <none> and password file <none>
I20260811 05:07:52.910534 32065 fs_manager.cc:359] Metadata directory not provided
I20260811 05:07:52.910593 32065 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:07:52.910749 32065 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:07:52.912050 32065 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786424853995437-27391-0/minicluster-data/master-0/data/instance:
uuid: "a3c8dfb82b524653b6612a3edea31d1f"
format_stamp: "Formatted at 2026-08-11 05:07:52 on dist-test-slave-x5fp"
server_key: "9eae916e94b3d914dcbfb20753a5a727"
server_key_iv: "8af3e958c4ba6596f20befb3e4861bee"
server_key_version: "encryptionkey@0"
I20260811 05:07:52.912499 32065 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786424853995437-27391-0/minicluster-data/master-0/wal/instance:
uuid: "a3c8dfb82b524653b6612a3edea31d1f"
format_stamp: "Formatted at 2026-08-11 05:07:52 on dist-test-slave-x5fp"
server_key: "9eae916e94b3d914dcbfb20753a5a727"
server_key_iv: "8af3e958c4ba6596f20befb3e4861bee"
server_key_version: "encryptionkey@0"
I20260811 05:07:52.914389 32065 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.000s
I20260811 05:07:52.915572 32090 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:52.916081 32065 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:07:52.916181 32065 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786424853995437-27391-0/minicluster-data/master-0/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786424853995437-27391-0/minicluster-data/master-0/wal
uuid: "a3c8dfb82b524653b6612a3edea31d1f"
format_stamp: "Formatted at 2026-08-11 05:07:52 on dist-test-slave-x5fp"
server_key: "9eae916e94b3d914dcbfb20753a5a727"
server_key_iv: "8af3e958c4ba6596f20befb3e4861bee"
server_key_version: "encryptionkey@0"
I20260811 05:07:52.916478 32065 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786424853995437-27391-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786424853995437-27391-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786424853995437-27391-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:07:52.929284 32065 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:07:52.932081 32065 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:07:52.932371 32065 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:07:52.938061 32065 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.254:32915
I20260811 05:07:52.938457 32177 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.254:32915 every 8 connection(s)
I20260811 05:07:52.938531 32065 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
I20260811 05:07:52.939369 32178 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:07:52.942090 32178 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a3c8dfb82b524653b6612a3edea31d1f: Bootstrap starting.
I20260811 05:07:52.942807 32178 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a3c8dfb82b524653b6612a3edea31d1f: Neither blocks nor log segments found. Creating new log.
I20260811 05:07:52.943181 32178 log.cc:824] T 00000000000000000000000000000000 P a3c8dfb82b524653b6612a3edea31d1f: Log is configured to *not* fsync() on all Append() calls
I20260811 05:07:52.944049 32178 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a3c8dfb82b524653b6612a3edea31d1f: No bootstrap required, opened a new log
I20260811 05:07:52.945446 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 32065
I20260811 05:07:52.945572 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786424853995437-27391-0/minicluster-data/master-0/wal/instance
I20260811 05:07:52.945775 27391 external_mini_cluster.cc:1428] Setting key b484bb44be99f33ef695982d798f8d0d
I20260811 05:07:52.946630 32178 raft_consensus.cc:348] T 00000000000000000000000000000000 P a3c8dfb82b524653b6612a3edea31d1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3c8dfb82b524653b6612a3edea31d1f" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 32915 } }
I20260811 05:07:52.946823 32178 raft_consensus.cc:374] T 00000000000000000000000000000000 P a3c8dfb82b524653b6612a3edea31d1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:07:52.946897 32178 raft_consensus.cc:729] T 00000000000000000000000000000000 P a3c8dfb82b524653b6612a3edea31d1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3c8dfb82b524653b6612a3edea31d1f, State: Initialized, Role: FOLLOWER
I20260811 05:07:52.947081 32178 consensus_queue.cc:260] T 00000000000000000000000000000000 P a3c8dfb82b524653b6612a3edea31d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3c8dfb82b524653b6612a3edea31d1f" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 32915 } }
I20260811 05:07:52.947160 32178 raft_consensus.cc:388] T 00000000000000000000000000000000 P a3c8dfb82b524653b6612a3edea31d1f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:07:52.947184 32178 raft_consensus.cc:482] T 00000000000000000000000000000000 P a3c8dfb82b524653b6612a3edea31d1f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:07:52.947257 32178 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a3c8dfb82b524653b6612a3edea31d1f [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:07:52.948174 32178 raft_consensus.cc:504] T 00000000000000000000000000000000 P a3c8dfb82b524653b6612a3edea31d1f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3c8dfb82b524653b6612a3edea31d1f" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 32915 } }
I20260811 05:07:52.948318 32178 leader_election.cc:302] T 00000000000000000000000000000000 P a3c8dfb82b524653b6612a3edea31d1f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a3c8dfb82b524653b6612a3edea31d1f; no voters:
I20260811 05:07:52.948557 32178 leader_election.cc:288] T 00000000000000000000000000000000 P a3c8dfb82b524653b6612a3edea31d1f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 05:07:52.948592 32184 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a3c8dfb82b524653b6612a3edea31d1f [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:07:52.948740 32184 raft_consensus.cc:686] T 00000000000000000000000000000000 P a3c8dfb82b524653b6612a3edea31d1f [term 1 LEADER]: Becoming Leader. State: Replica: a3c8dfb82b524653b6612a3edea31d1f, State: Running, Role: LEADER
I20260811 05:07:52.948905 32178 sys_catalog.cc:564] T 00000000000000000000000000000000 P a3c8dfb82b524653b6612a3edea31d1f [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:07:52.948916 32184 consensus_queue.cc:237] T 00000000000000000000000000000000 P a3c8dfb82b524653b6612a3edea31d1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3c8dfb82b524653b6612a3edea31d1f" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 32915 } }
I20260811 05:07:52.949529 32186 sys_catalog.cc:455] T 00000000000000000000000000000000 P a3c8dfb82b524653b6612a3edea31d1f [sys.catalog]: SysCatalogTable state changed. Reason: New leader a3c8dfb82b524653b6612a3edea31d1f. Latest consensus state: current_term: 1 leader_uuid: "a3c8dfb82b524653b6612a3edea31d1f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3c8dfb82b524653b6612a3edea31d1f" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 32915 } } }
I20260811 05:07:52.949632 32186 sys_catalog.cc:458] T 00000000000000000000000000000000 P a3c8dfb82b524653b6612a3edea31d1f [sys.catalog]: This master's current role is: LEADER
I20260811 05:07:52.950181 32185 sys_catalog.cc:455] T 00000000000000000000000000000000 P a3c8dfb82b524653b6612a3edea31d1f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a3c8dfb82b524653b6612a3edea31d1f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3c8dfb82b524653b6612a3edea31d1f" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 32915 } } }
I20260811 05:07:52.950276 32185 sys_catalog.cc:458] T 00000000000000000000000000000000 P a3c8dfb82b524653b6612a3edea31d1f [sys.catalog]: This master's current role is: LEADER
W20260811 05:07:52.951130 32207 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a3c8dfb82b524653b6612a3edea31d1f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 05:07:52.951205 32207 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 05:07:52.951865 32192 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:07:52.952093 32192 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 11 05:07:52 dist-test-slave-x5fp krb5kdc[32034](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424872, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
I20260811 05:07:52.954121 32192 catalog_manager.cc:1347] Generated new cluster ID: 0897da0960bf4afbb4bbc2cf14db7ee5
I20260811 05:07:52.954186 32192 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:07:52.958323 32183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:52.946408 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46906 (local address 127.26.191.254:32915)
0811 05:07:52.946939 (+ 531us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:52.946966 (+ 27us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:52.947001 (+ 35us) server_negotiation.cc:407] Connection header received
0811 05:07:52.947190 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:52.947227 (+ 37us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:52.947291 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:52.947434 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:52.948398 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:52.949703 (+ 1305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:52.950816 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:52.951559 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:52.951686 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:52.954557 (+ 2871us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:52.954561 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:52.954561 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:07:52.954575 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:52.956511 (+ 1936us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:52.957037 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:52.957040 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:52.957041 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:52.957170 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:52.957405 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:52.957406 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:52.957407 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:52.957667 (+ 260us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:52.957864 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:52.957934 (+ 70us) server_negotiation.cc:299] Negotiation successful
0811 05:07:52.958086 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":472,"thread_start_us":437,"threads_started":1}
I20260811 05:07:52.959273 27391 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 05:07:52.978093 32192 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:07:52.978403 32183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:52.974436 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46912 (local address 127.26.191.254:32915)
0811 05:07:52.974492 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:52.974495 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:52.974651 (+ 156us) server_negotiation.cc:407] Connection header received
0811 05:07:52.974738 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:52.974739 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:52.974763 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:52.974828 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:52.975252 (+ 424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:52.975767 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:52.976528 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:52.976833 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:52.976910 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:52.977760 (+ 850us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:52.977762 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:52.977763 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:07:52.978068 (+ 305us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:52.978092 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:07:52.978102 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:52.978182 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:52.978299 (+ 117us) server_negotiation.cc:299] Negotiation successful
0811 05:07:52.978328 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 05:07:52.978961 32192 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:07:52.985960 32192 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a3c8dfb82b524653b6612a3edea31d1f: Generated new TSK 0
I20260811 05:07:52.986217 32192 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 05:07:52.993364 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 32065
2026-08-11T05:07:53Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1599 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424853995437-27391-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 05:07:53 dist-test-slave-x5fp krb5kdc[32242](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 05:07:53 dist-test-slave-x5fp krb5kdc[32242](info): set up 2 sockets
Aug 11 05:07:53 dist-test-slave-x5fp krb5kdc[32242](info): commencing operation
krb5kdc: starting...
W20260811 05:07:54.382210 27391 mini_kdc.cc:121] Time spent starting KDC: real 1.360s user 0.001s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424853995437-27391-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424853995437-27391-0/krb5kdc/test-user.keytab.
Aug 11 05:07:54 dist-test-slave-x5fp krb5kdc[32242](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424874, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T05:07:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:07:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.191.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.191.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.191.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab.
Entry for principal kudu/127.26.191.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab.
I20260811 05:07:54.525108 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424853995437-27391-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424853995437-27391-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424853995437-27391-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.254:46599
--webserver_interface=127.26.191.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab
--principal=kudu/127.26.191.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:37919
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.191.254:46599
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:07:54.612110 32261 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:07:54.612385 32261 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:07:54.612445 32261 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:07:54.613665 32261 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:07:54.613739 32261 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:07:54.613763 32261 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:07:54.613785 32261 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:07:54.613842 32261 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:07:54.615355 32261 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:37919
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424853995437-27391-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424853995437-27391-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.191.254:46599
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab
--principal=kudu/127.26.191.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.254:46599
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.191.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32261
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424853995437-27391-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:07:54.615638 32261 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:07:54.615880 32261 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:07:54.620838 32272 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:54.620816 32277 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:54.620952 32274 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:07:54.621218 32261 server_base.cc:1034] running on GCE node
I20260811 05:07:54.621559 32261 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:07:54.621861 32261 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:07:54.623057 32261 hybrid_clock.cc:648] HybridClock initialized: now 1786424874623044 us; error 42 us; skew 500 ppm
Aug 11 05:07:54 dist-test-slave-x5fp krb5kdc[32242](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424874, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:07:54.625916 32261 init.cc:377] Logged in from keytab as kudu/127.26.191.254@KRBTEST.COM (short username kudu)
I20260811 05:07:54.626448 32261 webserver.cc:460] Webserver started at http://127.26.191.254:34435/ using document root <none> and password file <none>
I20260811 05:07:54.626740 32261 fs_manager.cc:359] Metadata directory not provided
I20260811 05:07:54.626817 32261 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:07:54.626993 32261 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:07:54.628829 32261 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424853995437-27391-0/minicluster-data/master-0/data/instance:
uuid: "3f9247f154bf45ec8383950c7654f7b4"
format_stamp: "Formatted at 2026-08-11 05:07:54 on dist-test-slave-x5fp"
server_key: "950a3a01c82416cf07bf0ec15eeef490"
server_key_iv: "ee2c63adc3f220aff6b2bd0cef41fe67"
server_key_version: "encryptionkey@0"
I20260811 05:07:54.629254 32261 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424853995437-27391-0/minicluster-data/master-0/wal/instance:
uuid: "3f9247f154bf45ec8383950c7654f7b4"
format_stamp: "Formatted at 2026-08-11 05:07:54 on dist-test-slave-x5fp"
server_key: "950a3a01c82416cf07bf0ec15eeef490"
server_key_iv: "ee2c63adc3f220aff6b2bd0cef41fe67"
server_key_version: "encryptionkey@0"
I20260811 05:07:54.630797 32261 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 05:07:54.631783 32285 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:54.632014 32261 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:07:54.632124 32261 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424853995437-27391-0/minicluster-data/master-0/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424853995437-27391-0/minicluster-data/master-0/wal
uuid: "3f9247f154bf45ec8383950c7654f7b4"
format_stamp: "Formatted at 2026-08-11 05:07:54 on dist-test-slave-x5fp"
server_key: "950a3a01c82416cf07bf0ec15eeef490"
server_key_iv: "ee2c63adc3f220aff6b2bd0cef41fe67"
server_key_version: "encryptionkey@0"
I20260811 05:07:54.632216 32261 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424853995437-27391-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424853995437-27391-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424853995437-27391-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:07:54.660956 32261 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:07:54.663722 32261 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:07:54.663959 32261 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:07:54.668556 32261 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.254:46599
I20260811 05:07:54.668653 32363 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.254:46599 every 8 connection(s)
I20260811 05:07:54.669044 32261 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
I20260811 05:07:54.670408 32364 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:07:54.671895 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 32261
I20260811 05:07:54.672015 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424853995437-27391-0/minicluster-data/master-0/wal/instance
I20260811 05:07:54.672219 27391 external_mini_cluster.cc:1428] Setting key bf20102be20e3ce52d9524eb74c4deba
I20260811 05:07:54.673440 32364 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3f9247f154bf45ec8383950c7654f7b4: Bootstrap starting.
I20260811 05:07:54.674264 32364 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3f9247f154bf45ec8383950c7654f7b4: Neither blocks nor log segments found. Creating new log.
I20260811 05:07:54.674656 32364 log.cc:824] T 00000000000000000000000000000000 P 3f9247f154bf45ec8383950c7654f7b4: Log is configured to *not* fsync() on all Append() calls
I20260811 05:07:54.675421 32364 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3f9247f154bf45ec8383950c7654f7b4: No bootstrap required, opened a new log
I20260811 05:07:54.678006 32364 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3f9247f154bf45ec8383950c7654f7b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f9247f154bf45ec8383950c7654f7b4" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 46599 } }
I20260811 05:07:54.678243 32364 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3f9247f154bf45ec8383950c7654f7b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:07:54.678287 32364 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3f9247f154bf45ec8383950c7654f7b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f9247f154bf45ec8383950c7654f7b4, State: Initialized, Role: FOLLOWER
I20260811 05:07:54.678434 32364 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3f9247f154bf45ec8383950c7654f7b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f9247f154bf45ec8383950c7654f7b4" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 46599 } }
I20260811 05:07:54.678550 32364 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3f9247f154bf45ec8383950c7654f7b4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:07:54.678592 32364 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3f9247f154bf45ec8383950c7654f7b4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:07:54.678646 32364 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3f9247f154bf45ec8383950c7654f7b4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:07:54.679495 32364 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3f9247f154bf45ec8383950c7654f7b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f9247f154bf45ec8383950c7654f7b4" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 46599 } }
I20260811 05:07:54.679600 32364 leader_election.cc:302] T 00000000000000000000000000000000 P 3f9247f154bf45ec8383950c7654f7b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3f9247f154bf45ec8383950c7654f7b4; no voters:
I20260811 05:07:54.679847 32364 leader_election.cc:288] T 00000000000000000000000000000000 P 3f9247f154bf45ec8383950c7654f7b4 [CANDIDATE]: Term 1 election: Requested vote from peers
Aug 11 05:07:54 dist-test-slave-x5fp krb5kdc[32242](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424874, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
I20260811 05:07:54.679865 32371 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3f9247f154bf45ec8383950c7654f7b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:07:54.680007 32371 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3f9247f154bf45ec8383950c7654f7b4 [term 1 LEADER]: Becoming Leader. State: Replica: 3f9247f154bf45ec8383950c7654f7b4, State: Running, Role: LEADER
I20260811 05:07:54.680167 32364 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3f9247f154bf45ec8383950c7654f7b4 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:07:54.680158 32371 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3f9247f154bf45ec8383950c7654f7b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f9247f154bf45ec8383950c7654f7b4" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 46599 } }
I20260811 05:07:54.680670 32373 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3f9247f154bf45ec8383950c7654f7b4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3f9247f154bf45ec8383950c7654f7b4. Latest consensus state: current_term: 1 leader_uuid: "3f9247f154bf45ec8383950c7654f7b4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f9247f154bf45ec8383950c7654f7b4" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 46599 } } }
I20260811 05:07:54.680794 32373 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3f9247f154bf45ec8383950c7654f7b4 [sys.catalog]: This master's current role is: LEADER
I20260811 05:07:54.681033 32372 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3f9247f154bf45ec8383950c7654f7b4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3f9247f154bf45ec8383950c7654f7b4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f9247f154bf45ec8383950c7654f7b4" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 46599 } } }
I20260811 05:07:54.681123 32381 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:07:54.681159 32372 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3f9247f154bf45ec8383950c7654f7b4 [sys.catalog]: This master's current role is: LEADER
I20260811 05:07:54.683190 32381 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:07:54.684566 32369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:54.672844 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34386 (local address 127.26.191.254:46599)
0811 05:07:54.673032 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:54.673041 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:54.673068 (+ 27us) server_negotiation.cc:407] Connection header received
0811 05:07:54.673482 (+ 414us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:54.673516 (+ 34us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:54.673593 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:54.673715 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:54.674618 (+ 903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:54.675692 (+ 1074us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:54.676847 (+ 1155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:54.677299 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:54.677394 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:54.680489 (+ 3095us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:54.680493 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:54.680494 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:07:54.680506 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:54.682573 (+ 2067us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:54.683063 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:54.683067 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:54.683067 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:54.683201 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:54.683454 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:54.683455 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:54.683455 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:54.683775 (+ 320us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:54.683944 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:54.684088 (+ 144us) server_negotiation.cc:299] Negotiation successful
0811 05:07:54.684253 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":95,"threads_started":1}
I20260811 05:07:54.685325 32381 catalog_manager.cc:1347] Generated new cluster ID: 6e70c89e1da641338c9ab86761a48204
I20260811 05:07:54.685393 32381 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:07:54.707115 32381 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:07:54.707800 32381 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:07:54.716334 32381 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3f9247f154bf45ec8383950c7654f7b4: Generated new TSK 0
I20260811 05:07:54.716593 32381 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.191.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.191.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.191.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.193.keytab.
Entry for principal kudu/127.26.191.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.193.keytab.
I20260811 05:07:54.752231 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.191.193:0
--local_ip_for_outbound_sockets=127.26.191.193
--webserver_interface=127.26.191.193
--webserver_port=0
--tserver_master_addrs=127.26.191.254:46599
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.193.keytab
--principal=kudu/127.26.191.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:37919
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:07:54.839270 32406 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:07:54.839483 32406 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:07:54.839507 32406 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:07:54.840698 32406 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:07:54.840766 32406 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:07:54.840794 32406 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.191.193
I20260811 05:07:54.842285 32406 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:37919
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.193.keytab
--principal=kudu/127.26.191.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.191.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.191.193
--webserver_port=0
--tserver_master_addrs=127.26.191.254:46599
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32406
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.191.193
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:07:54.842532 32406 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:07:54.842785 32406 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:07:54.848155 32413 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:54.848135 32416 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:07:54.848186 32406 server_base.cc:1034] running on GCE node
W20260811 05:07:54.848165 32412 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:07:54.848609 32406 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:07:54.848896 32406 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:07:54.850059 32406 hybrid_clock.cc:648] HybridClock initialized: now 1786424874850043 us; error 30 us; skew 500 ppm
Aug 11 05:07:54 dist-test-slave-x5fp krb5kdc[32242](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424874, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:07:54.852872 32406 init.cc:377] Logged in from keytab as kudu/127.26.191.193@KRBTEST.COM (short username kudu)
I20260811 05:07:54.853466 32406 webserver.cc:460] Webserver started at http://127.26.191.193:46783/ using document root <none> and password file <none>
I20260811 05:07:54.853724 32406 fs_manager.cc:359] Metadata directory not provided
I20260811 05:07:54.853801 32406 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:07:54.853956 32406 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:07:54.855151 32406 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-0/data/instance:
uuid: "31538e6d055e443a99657d49e2dfc37e"
format_stamp: "Formatted at 2026-08-11 05:07:54 on dist-test-slave-x5fp"
server_key: "136e00dee4d06dac380d58782b61d860"
server_key_iv: "99381918e818947ec3a185cb36c59850"
server_key_version: "encryptionkey@0"
I20260811 05:07:54.855576 32406 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-0/wal/instance:
uuid: "31538e6d055e443a99657d49e2dfc37e"
format_stamp: "Formatted at 2026-08-11 05:07:54 on dist-test-slave-x5fp"
server_key: "136e00dee4d06dac380d58782b61d860"
server_key_iv: "99381918e818947ec3a185cb36c59850"
server_key_version: "encryptionkey@0"
I20260811 05:07:54.857256 32406 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 05:07:54.858259 32429 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:54.858518 32406 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:07:54.858649 32406 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-0/wal
uuid: "31538e6d055e443a99657d49e2dfc37e"
format_stamp: "Formatted at 2026-08-11 05:07:54 on dist-test-slave-x5fp"
server_key: "136e00dee4d06dac380d58782b61d860"
server_key_iv: "99381918e818947ec3a185cb36c59850"
server_key_version: "encryptionkey@0"
I20260811 05:07:54.858727 32406 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:07:54.885586 32406 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:07:54.887809 32406 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:07:54.888000 32406 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:07:54.888321 32406 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:07:54.888672 32406 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:07:54.888757 32406 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:54.888803 32406 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:07:54.888829 32406 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:54.895251 32406 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.193:35393
I20260811 05:07:54.895401 32608 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.193:35393 every 8 connection(s)
I20260811 05:07:54.895699 32406 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-0/data/info.pb
I20260811 05:07:54.898455 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 32406
I20260811 05:07:54.898545 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-0/wal/instance
I20260811 05:07:54.898752 27391 external_mini_cluster.cc:1428] Setting key 39442af4cefa478612277252014bf24a
Aug 11 05:07:54 dist-test-slave-x5fp krb5kdc[32242](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424874, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.193@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
I20260811 05:07:54.905577 32369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:54.896492 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.193:39697 (local address 127.26.191.254:46599)
0811 05:07:54.896560 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:54.896562 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:54.896746 (+ 184us) server_negotiation.cc:407] Connection header received
0811 05:07:54.897269 (+ 523us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:54.897270 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:54.897280 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:54.897341 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:54.898285 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:54.899010 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:54.900029 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:54.900262 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:54.900340 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:54.902661 (+ 2321us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:54.902663 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:54.902663 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:07:54.902670 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:54.904010 (+ 1340us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:54.904472 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:54.904473 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:54.904473 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:54.904537 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:54.904847 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:54.904848 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:54.904849 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:54.904983 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:54.905060 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:54.905377 (+ 317us) server_negotiation.cc:299] Negotiation successful
0811 05:07:54.905479 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 05:07:54.905783 32613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:54.896426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:46599 (local address 127.26.191.193:39697)
0811 05:07:54.896594 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:54.896638 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:54.897177 (+ 539us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:54.897395 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:54.897398 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:54.897985 (+ 587us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:07:54.898186 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:54.898191 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:54.899098 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:54.899099 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:54.899929 (+ 830us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:54.899932 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:54.900353 (+ 421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:54.900354 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:54.900493 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:54.901109 (+ 616us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:07:54.901117 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:07:54.902546 (+ 1429us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:07:54.904120 (+ 1574us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:07:54.904129 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:07:54.904131 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:07:54.904384 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:07:54.904608 (+ 224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:07:54.904608 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:07:54.904609 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:07:54.904789 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:07:54.905063 (+ 274us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:07:54.905071 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:07:54.905221 (+ 150us) client_negotiation.cc:769] Sending connection context
0811 05:07:54.905338 (+ 117us) client_negotiation.cc:240] Negotiation successful
0811 05:07:54.905524 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":91,"threads_started":1}
I20260811 05:07:54.906615 32609 heartbeater.cc:347] Connected to a master server at 127.26.191.254:46599
I20260811 05:07:54.906723 32609 heartbeater.cc:464] Registering TS with master...
I20260811 05:07:54.906997 32609 heartbeater.cc:511] Master 127.26.191.254:46599 requested a full tablet report, sending...
I20260811 05:07:54.907717 32309 ts_manager.cc:194] Registered new tserver with Master: 31538e6d055e443a99657d49e2dfc37e (127.26.191.193:35393)
I20260811 05:07:54.908710 32309 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.191.193@KRBTEST.COM'} at 127.26.191.193:39697
WARNING: no policy specified for kudu/127.26.191.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.191.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.191.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.194.keytab.
Entry for principal kudu/127.26.191.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.194.keytab.
I20260811 05:07:54.928498 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.191.194:0
--local_ip_for_outbound_sockets=127.26.191.194
--webserver_interface=127.26.191.194
--webserver_port=0
--tserver_master_addrs=127.26.191.254:46599
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.194.keytab
--principal=kudu/127.26.191.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:37919
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:07:55.017534 32617 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:07:55.017762 32617 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:07:55.017789 32617 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:07:55.018991 32617 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:07:55.019032 32617 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:07:55.019059 32617 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.191.194
I20260811 05:07:55.020524 32617 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:37919
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.194.keytab
--principal=kudu/127.26.191.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.191.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.191.194
--webserver_port=0
--tserver_master_addrs=127.26.191.254:46599
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32617
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.191.194
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:07:55.020803 32617 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:07:55.021035 32617 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 05:07:55.026772 32617 server_base.cc:1034] running on GCE node
W20260811 05:07:55.026705 32626 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:55.026681 32630 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:55.026681 32627 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:07:55.027258 32617 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:07:55.027547 32617 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:07:55.028824 32617 hybrid_clock.cc:648] HybridClock initialized: now 1786424875028762 us; error 66 us; skew 500 ppm
Aug 11 05:07:55 dist-test-slave-x5fp krb5kdc[32242](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424875, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:07:55.031896 32617 init.cc:377] Logged in from keytab as kudu/127.26.191.194@KRBTEST.COM (short username kudu)
I20260811 05:07:55.032428 32617 webserver.cc:460] Webserver started at http://127.26.191.194:42067/ using document root <none> and password file <none>
I20260811 05:07:55.032706 32617 fs_manager.cc:359] Metadata directory not provided
I20260811 05:07:55.032852 32617 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:07:55.033016 32617 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:07:55.034139 32617 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-1/data/instance:
uuid: "b27dbd93869549e29db0d448508adbb9"
format_stamp: "Formatted at 2026-08-11 05:07:55 on dist-test-slave-x5fp"
server_key: "94d295847abf83c3912346f3f51b68d9"
server_key_iv: "e9c8a08290c0c955a1a10806d7c9a0b1"
server_key_version: "encryptionkey@0"
I20260811 05:07:55.034534 32617 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-1/wal/instance:
uuid: "b27dbd93869549e29db0d448508adbb9"
format_stamp: "Formatted at 2026-08-11 05:07:55 on dist-test-slave-x5fp"
server_key: "94d295847abf83c3912346f3f51b68d9"
server_key_iv: "e9c8a08290c0c955a1a10806d7c9a0b1"
server_key_version: "encryptionkey@0"
I20260811 05:07:55.036059 32617 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 05:07:55.037199 32638 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:55.037433 32617 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 05:07:55.037554 32617 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-1/wal
uuid: "b27dbd93869549e29db0d448508adbb9"
format_stamp: "Formatted at 2026-08-11 05:07:55 on dist-test-slave-x5fp"
server_key: "94d295847abf83c3912346f3f51b68d9"
server_key_iv: "e9c8a08290c0c955a1a10806d7c9a0b1"
server_key_version: "encryptionkey@0"
I20260811 05:07:55.037655 32617 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:07:55.063256 32617 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:07:55.065899 32617 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:07:55.066075 32617 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:07:55.066349 32617 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:07:55.066692 32617 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:07:55.066751 32617 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:55.066798 32617 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:07:55.066823 32617 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:55.073199 32617 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.194:40291
I20260811 05:07:55.073263 344 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.194:40291 every 8 connection(s)
I20260811 05:07:55.073643 32617 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-1/data/info.pb
I20260811 05:07:55.074926 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 32617
I20260811 05:07:55.075022 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-1/wal/instance
I20260811 05:07:55.075230 27391 external_mini_cluster.cc:1428] Setting key bef8bfae5095a9e9bb096cd9df3142f3
Aug 11 05:07:55 dist-test-slave-x5fp krb5kdc[32242](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424875, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.194@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
I20260811 05:07:55.085485 32369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:55.074540 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.194:40839 (local address 127.26.191.254:46599)
0811 05:07:55.074629 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:55.074632 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:55.074772 (+ 140us) server_negotiation.cc:407] Connection header received
0811 05:07:55.075402 (+ 630us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:55.075404 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:55.075417 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:55.075491 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:55.076599 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:55.077396 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:55.079011 (+ 1615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:55.079208 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:55.079276 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:55.082171 (+ 2895us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:55.082172 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:55.082173 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:07:55.082181 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:55.083756 (+ 1575us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:55.084229 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:55.084230 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:55.084230 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:55.084296 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:55.084568 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:55.084570 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:55.084570 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:55.084703 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:55.084817 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:55.085119 (+ 302us) server_negotiation.cc:299] Negotiation successful
0811 05:07:55.085395 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 05:07:55.085552 348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:55.074439 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:46599 (local address 127.26.191.194:40839)
0811 05:07:55.074618 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:55.074669 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:55.075285 (+ 616us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:55.075566 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:55.075571 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:55.076274 (+ 703us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:07:55.076495 (+ 221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:55.076501 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:55.077521 (+ 1020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:55.077521 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:55.078880 (+ 1359us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:55.078884 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:55.079312 (+ 428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:55.079313 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:55.079473 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:55.080152 (+ 679us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:07:55.080163 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:07:55.082058 (+ 1895us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:07:55.083869 (+ 1811us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:07:55.083879 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:07:55.083882 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:07:55.084136 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:07:55.084373 (+ 237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:07:55.084374 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:07:55.084375 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:07:55.084499 (+ 124us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:07:55.084807 (+ 308us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:07:55.084815 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:07:55.084975 (+ 160us) client_negotiation.cc:769] Sending connection context
0811 05:07:55.085093 (+ 118us) client_negotiation.cc:240] Negotiation successful
0811 05:07:55.085293 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":71,"threads_started":1}
WARNING: no policy specified for kudu/127.26.191.195@KRBTEST.COM; defaulting to no policy
I20260811 05:07:55.086421 345 heartbeater.cc:347] Connected to a master server at 127.26.191.254:46599
I20260811 05:07:55.086584 345 heartbeater.cc:464] Registering TS with master...
I20260811 05:07:55.086815 345 heartbeater.cc:511] Master 127.26.191.254:46599 requested a full tablet report, sending...
I20260811 05:07:55.087277 32309 ts_manager.cc:194] Registered new tserver with Master: b27dbd93869549e29db0d448508adbb9 (127.26.191.194:40291)
I20260811 05:07:55.087709 32309 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.191.194@KRBTEST.COM'} at 127.26.191.194:40839
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.191.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.191.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.195.keytab.
Entry for principal kudu/127.26.191.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.195.keytab.
I20260811 05:07:55.109558 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.191.195:0
--local_ip_for_outbound_sockets=127.26.191.195
--webserver_interface=127.26.191.195
--webserver_port=0
--tserver_master_addrs=127.26.191.254:46599
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.195.keytab
--principal=kudu/127.26.191.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:37919
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:07:55.196498 355 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:07:55.196808 355 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:07:55.196841 355 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:07:55.198028 355 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:07:55.198071 355 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:07:55.198103 355 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.191.195
I20260811 05:07:55.199555 355 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:37919
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.195.keytab
--principal=kudu/127.26.191.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.191.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.191.195
--webserver_port=0
--tserver_master_addrs=127.26.191.254:46599
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.355
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.191.195
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:07:55.199761 355 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:07:55.199957 355 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:07:55.205260 368 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:55.205255 364 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:55.205265 362 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:07:55.205416 355 server_base.cc:1034] running on GCE node
I20260811 05:07:55.205755 355 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:07:55.205996 355 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:07:55.207142 355 hybrid_clock.cc:648] HybridClock initialized: now 1786424875207070 us; error 86 us; skew 500 ppm
Aug 11 05:07:55 dist-test-slave-x5fp krb5kdc[32242](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424875, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:07:55.209869 355 init.cc:377] Logged in from keytab as kudu/127.26.191.195@KRBTEST.COM (short username kudu)
I20260811 05:07:55.210333 355 webserver.cc:460] Webserver started at http://127.26.191.195:41545/ using document root <none> and password file <none>
I20260811 05:07:55.210563 355 fs_manager.cc:359] Metadata directory not provided
I20260811 05:07:55.210613 355 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:07:55.210800 355 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:07:55.211898 355 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-2/data/instance:
uuid: "9941a47fb4314adebdd4e88ceb178010"
format_stamp: "Formatted at 2026-08-11 05:07:55 on dist-test-slave-x5fp"
server_key: "47d714338b61b966de7972ac83220406"
server_key_iv: "61aa3ef9d5c8360072e1d7cbc52aa592"
server_key_version: "encryptionkey@0"
I20260811 05:07:55.212277 355 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-2/wal/instance:
uuid: "9941a47fb4314adebdd4e88ceb178010"
format_stamp: "Formatted at 2026-08-11 05:07:55 on dist-test-slave-x5fp"
server_key: "47d714338b61b966de7972ac83220406"
server_key_iv: "61aa3ef9d5c8360072e1d7cbc52aa592"
server_key_version: "encryptionkey@0"
I20260811 05:07:55.213788 355 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 05:07:55.214597 382 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:55.214931 355 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:07:55.215040 355 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-2/wal
uuid: "9941a47fb4314adebdd4e88ceb178010"
format_stamp: "Formatted at 2026-08-11 05:07:55 on dist-test-slave-x5fp"
server_key: "47d714338b61b966de7972ac83220406"
server_key_iv: "61aa3ef9d5c8360072e1d7cbc52aa592"
server_key_version: "encryptionkey@0"
I20260811 05:07:55.215116 355 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:07:55.229576 355 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:07:55.232092 355 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:07:55.232275 355 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:07:55.232544 355 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:07:55.233003 355 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:07:55.233062 355 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:55.233107 355 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:07:55.233152 355 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:55.239483 355 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.195:43009
I20260811 05:07:55.239566 595 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.195:43009 every 8 connection(s)
I20260811 05:07:55.239897 355 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-2/data/info.pb
I20260811 05:07:55.246174 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 355
I20260811 05:07:55.246261 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424853995437-27391-0/minicluster-data/ts-2/wal/instance
Aug 11 05:07:55 dist-test-slave-x5fp krb5kdc[32242](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424875, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.195@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
I20260811 05:07:55.246488 27391 external_mini_cluster.cc:1428] Setting key 6dfd3e19a14b934cf4535886a9082e2c
I20260811 05:07:55.250627 32369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:55.240669 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.195:48135 (local address 127.26.191.254:46599)
0811 05:07:55.240785 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:55.240788 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:55.240973 (+ 185us) server_negotiation.cc:407] Connection header received
0811 05:07:55.241509 (+ 536us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:55.241514 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:55.241526 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:55.241578 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:55.242497 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:55.243004 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:55.244122 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:55.244321 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:55.244381 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:55.247062 (+ 2681us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:55.247064 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:55.247064 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:07:55.247072 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:55.248884 (+ 1812us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:55.249349 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:55.249350 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:55.249350 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:55.249426 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:55.249900 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:55.249901 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:55.249901 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:55.250036 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:55.250100 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:55.250443 (+ 343us) server_negotiation.cc:299] Negotiation successful
0811 05:07:55.250551 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260811 05:07:55.250758 598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:55.240628 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:46599 (local address 127.26.191.195:48135)
0811 05:07:55.240842 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:55.240881 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:55.241403 (+ 522us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:55.241632 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:55.241635 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:55.242221 (+ 586us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:07:55.242419 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:55.242424 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:55.243106 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:55.243107 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:55.244027 (+ 920us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:55.244030 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:55.244404 (+ 374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:55.244405 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:55.244579 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:55.245210 (+ 631us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:07:55.245219 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:07:55.246902 (+ 1683us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:07:55.248968 (+ 2066us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:07:55.248976 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:07:55.248978 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:07:55.249242 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:07:55.249505 (+ 263us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:07:55.249506 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:07:55.249506 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:07:55.249630 (+ 124us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:07:55.250118 (+ 488us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:07:55.250125 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:07:55.250269 (+ 144us) client_negotiation.cc:769] Sending connection context
0811 05:07:55.250377 (+ 108us) client_negotiation.cc:240] Negotiation successful
0811 05:07:55.250529 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":118,"threads_started":1}
I20260811 05:07:55.251448 596 heartbeater.cc:347] Connected to a master server at 127.26.191.254:46599
I20260811 05:07:55.251572 596 heartbeater.cc:464] Registering TS with master...
I20260811 05:07:55.251804 596 heartbeater.cc:511] Master 127.26.191.254:46599 requested a full tablet report, sending...
I20260811 05:07:55.252275 32309 ts_manager.cc:194] Registered new tserver with Master: 9941a47fb4314adebdd4e88ceb178010 (127.26.191.195:43009)
I20260811 05:07:55.252794 32309 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.191.195@KRBTEST.COM'} at 127.26.191.195:48135
I20260811 05:07:55.258641 27391 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 05:07:55 dist-test-slave-x5fp krb5kdc[32242](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424875, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 11 05:07:55 dist-test-slave-x5fp krb5kdc[32242](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424875, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
I20260811 05:07:55.286123 32369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:55.277575 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34388 (local address 127.26.191.254:46599)
0811 05:07:55.277716 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:55.277718 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:55.277821 (+ 103us) server_negotiation.cc:407] Connection header received
0811 05:07:55.277961 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:55.277963 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:55.277977 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:55.278080 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:55.278833 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:55.279400 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:55.280300 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:55.280544 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:55.280613 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:55.283311 (+ 2698us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:55.283313 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:55.283313 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:07:55.283321 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:55.284687 (+ 1366us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:55.285161 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:55.285163 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:55.285163 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:55.285242 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:55.285448 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:55.285449 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:55.285450 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:55.285635 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:55.285817 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:55.285955 (+ 138us) server_negotiation.cc:299] Negotiation successful
0811 05:07:55.286043 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
W20260811 05:07:55.286446 32309 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:34388
I20260811 05:07:55.287047 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 32406
I20260811 05:07:55.305990 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 32617
I20260811 05:07:55.325325 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 355
I20260811 05:07:55.336233 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 32261
2026-08-11T05:07:55Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (2347 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424853995437-27391-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 05:07:55 dist-test-slave-x5fp krb5kdc[611](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 05:07:55 dist-test-slave-x5fp krb5kdc[611](info): set up 2 sockets
Aug 11 05:07:55 dist-test-slave-x5fp krb5kdc[611](info): commencing operation
krb5kdc: starting...
W20260811 05:07:56.706743 27391 mini_kdc.cc:121] Time spent starting KDC: real 1.336s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424853995437-27391-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424853995437-27391-0/krb5kdc/test-user.keytab.
Aug 11 05:07:56 dist-test-slave-x5fp krb5kdc[611](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424876, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T05:07:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:07:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.191.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.191.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.191.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab.
Entry for principal kudu/127.26.191.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab.
I20260811 05:07:56.852077 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424853995437-27391-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424853995437-27391-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424853995437-27391-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.254:37391
--webserver_interface=127.26.191.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab
--principal=kudu/127.26.191.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:33519
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.191.254:37391
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:07:56.942348 631 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:07:56.942634 631 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:07:56.942690 631 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:07:56.944043 631 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:07:56.944116 631 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:07:56.944141 631 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:07:56.944162 631 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:07:56.944193 631 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:07:56.945859 631 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:33519
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424853995437-27391-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424853995437-27391-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.191.254:37391
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab
--principal=kudu/127.26.191.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.254:37391
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.191.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.631
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424853995437-27391-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:07:56.946178 631 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:07:56.946439 631 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:07:56.951714 644 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:56.951713 642 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:07:56.951862 631 server_base.cc:1034] running on GCE node
W20260811 05:07:56.951713 646 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:07:56.952303 631 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:07:56.952693 631 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:07:56.953905 631 hybrid_clock.cc:648] HybridClock initialized: now 1786424876953882 us; error 39 us; skew 500 ppm
Aug 11 05:07:56 dist-test-slave-x5fp krb5kdc[611](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424876, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:07:56.960489 631 init.cc:377] Logged in from keytab as kudu/127.26.191.254@KRBTEST.COM (short username kudu)
I20260811 05:07:56.961113 631 webserver.cc:460] Webserver started at http://127.26.191.254:39867/ using document root <none> and password file <none>
I20260811 05:07:56.961402 631 fs_manager.cc:359] Metadata directory not provided
I20260811 05:07:56.961479 631 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:07:56.961642 631 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:07:56.962811 631 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424853995437-27391-0/minicluster-data/master-0/data/instance:
uuid: "d226f7605d164eeba96116eb8d2cfbb7"
format_stamp: "Formatted at 2026-08-11 05:07:56 on dist-test-slave-x5fp"
server_key: "0742f4a8f845040870dd526c600b5279"
server_key_iv: "1eff84d9d4465b4820cb3bdedf578733"
server_key_version: "encryptionkey@0"
I20260811 05:07:56.963215 631 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424853995437-27391-0/minicluster-data/master-0/wal/instance:
uuid: "d226f7605d164eeba96116eb8d2cfbb7"
format_stamp: "Formatted at 2026-08-11 05:07:56 on dist-test-slave-x5fp"
server_key: "0742f4a8f845040870dd526c600b5279"
server_key_iv: "1eff84d9d4465b4820cb3bdedf578733"
server_key_version: "encryptionkey@0"
I20260811 05:07:56.964780 631 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 05:07:56.965647 658 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:56.965941 631 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:07:56.966087 631 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424853995437-27391-0/minicluster-data/master-0/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424853995437-27391-0/minicluster-data/master-0/wal
uuid: "d226f7605d164eeba96116eb8d2cfbb7"
format_stamp: "Formatted at 2026-08-11 05:07:56 on dist-test-slave-x5fp"
server_key: "0742f4a8f845040870dd526c600b5279"
server_key_iv: "1eff84d9d4465b4820cb3bdedf578733"
server_key_version: "encryptionkey@0"
I20260811 05:07:56.966176 631 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424853995437-27391-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424853995437-27391-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424853995437-27391-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:07:56.979931 631 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:07:56.982568 631 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:07:56.982750 631 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:07:56.987382 631 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.254:37391
I20260811 05:07:56.987430 733 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.254:37391 every 8 connection(s)
I20260811 05:07:56.988013 631 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
I20260811 05:07:56.988828 734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:07:56.989246 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 631
I20260811 05:07:56.989380 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424853995437-27391-0/minicluster-data/master-0/wal/instance
I20260811 05:07:56.989569 27391 external_mini_cluster.cc:1428] Setting key 2d68de82d26f2e225af778464a217853
I20260811 05:07:56.992676 734 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d226f7605d164eeba96116eb8d2cfbb7: Bootstrap starting.
I20260811 05:07:56.993494 734 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d226f7605d164eeba96116eb8d2cfbb7: Neither blocks nor log segments found. Creating new log.
I20260811 05:07:56.993798 734 log.cc:824] T 00000000000000000000000000000000 P d226f7605d164eeba96116eb8d2cfbb7: Log is configured to *not* fsync() on all Append() calls
I20260811 05:07:56.994516 734 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d226f7605d164eeba96116eb8d2cfbb7: No bootstrap required, opened a new log
I20260811 05:07:56.996600 734 raft_consensus.cc:348] T 00000000000000000000000000000000 P d226f7605d164eeba96116eb8d2cfbb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d226f7605d164eeba96116eb8d2cfbb7" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 37391 } }
I20260811 05:07:56.996824 734 raft_consensus.cc:374] T 00000000000000000000000000000000 P d226f7605d164eeba96116eb8d2cfbb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
Aug 11 05:07:56 dist-test-slave-x5fp krb5kdc[611](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424876, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
I20260811 05:07:56.996865 734 raft_consensus.cc:729] T 00000000000000000000000000000000 P d226f7605d164eeba96116eb8d2cfbb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d226f7605d164eeba96116eb8d2cfbb7, State: Initialized, Role: FOLLOWER
I20260811 05:07:56.997018 734 consensus_queue.cc:260] T 00000000000000000000000000000000 P d226f7605d164eeba96116eb8d2cfbb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d226f7605d164eeba96116eb8d2cfbb7" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 37391 } }
I20260811 05:07:56.997128 734 raft_consensus.cc:388] T 00000000000000000000000000000000 P d226f7605d164eeba96116eb8d2cfbb7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:07:56.997174 734 raft_consensus.cc:482] T 00000000000000000000000000000000 P d226f7605d164eeba96116eb8d2cfbb7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:07:56.997231 734 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d226f7605d164eeba96116eb8d2cfbb7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:07:56.997783 734 raft_consensus.cc:504] T 00000000000000000000000000000000 P d226f7605d164eeba96116eb8d2cfbb7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d226f7605d164eeba96116eb8d2cfbb7" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 37391 } }
I20260811 05:07:56.997920 734 leader_election.cc:302] T 00000000000000000000000000000000 P d226f7605d164eeba96116eb8d2cfbb7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d226f7605d164eeba96116eb8d2cfbb7; no voters:
I20260811 05:07:56.998117 734 leader_election.cc:288] T 00000000000000000000000000000000 P d226f7605d164eeba96116eb8d2cfbb7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 05:07:56.998288 745 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d226f7605d164eeba96116eb8d2cfbb7 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:07:56.998399 734 sys_catalog.cc:564] T 00000000000000000000000000000000 P d226f7605d164eeba96116eb8d2cfbb7 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:07:56.998509 745 raft_consensus.cc:686] T 00000000000000000000000000000000 P d226f7605d164eeba96116eb8d2cfbb7 [term 1 LEADER]: Becoming Leader. State: Replica: d226f7605d164eeba96116eb8d2cfbb7, State: Running, Role: LEADER
I20260811 05:07:56.998622 745 consensus_queue.cc:237] T 00000000000000000000000000000000 P d226f7605d164eeba96116eb8d2cfbb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d226f7605d164eeba96116eb8d2cfbb7" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 37391 } }
I20260811 05:07:56.999462 748 sys_catalog.cc:455] T 00000000000000000000000000000000 P d226f7605d164eeba96116eb8d2cfbb7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d226f7605d164eeba96116eb8d2cfbb7. Latest consensus state: current_term: 1 leader_uuid: "d226f7605d164eeba96116eb8d2cfbb7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d226f7605d164eeba96116eb8d2cfbb7" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 37391 } } }
I20260811 05:07:56.999557 748 sys_catalog.cc:458] T 00000000000000000000000000000000 P d226f7605d164eeba96116eb8d2cfbb7 [sys.catalog]: This master's current role is: LEADER
I20260811 05:07:56.999760 747 sys_catalog.cc:455] T 00000000000000000000000000000000 P d226f7605d164eeba96116eb8d2cfbb7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d226f7605d164eeba96116eb8d2cfbb7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d226f7605d164eeba96116eb8d2cfbb7" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 37391 } } }
I20260811 05:07:56.999956 747 sys_catalog.cc:458] T 00000000000000000000000000000000 P d226f7605d164eeba96116eb8d2cfbb7 [sys.catalog]: This master's current role is: LEADER
W20260811 05:07:57.000491 767 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d226f7605d164eeba96116eb8d2cfbb7: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 05:07:57.000603 767 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 05:07:57.000684 763 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:07:57.000933 763 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:07:57.001948 741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:56.990145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32884 (local address 127.26.191.254:37391)
0811 05:07:56.990312 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:56.990324 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:56.990359 (+ 35us) server_negotiation.cc:407] Connection header received
0811 05:07:56.990903 (+ 544us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:56.990913 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:56.990982 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:56.991148 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:56.991831 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:56.993269 (+ 1438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:56.994171 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:56.994653 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:56.994782 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:56.997545 (+ 2763us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:56.997555 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:56.997555 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:07:56.997567 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:57.000046 (+ 2479us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:57.000525 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:57.000528 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:57.000528 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:57.000644 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:57.000899 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:57.000900 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:57.000901 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:57.001261 (+ 360us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:57.001441 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:57.001593 (+ 152us) server_negotiation.cc:299] Negotiation successful
0811 05:07:57.001776 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":83,"threads_started":1}
I20260811 05:07:57.003160 763 catalog_manager.cc:1347] Generated new cluster ID: d55189d3b1c24a83b6cb875536f60bf5
I20260811 05:07:57.003221 763 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:07:57.019133 763 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:07:57.019784 763 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:07:57.026456 763 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d226f7605d164eeba96116eb8d2cfbb7: Generated new TSK 0
I20260811 05:07:57.026736 763 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.191.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.191.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.191.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.193.keytab.
Entry for principal kudu/127.26.191.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.193.keytab.
I20260811 05:07:57.063688 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424853995437-27391-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424853995437-27391-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424853995437-27391-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424853995437-27391-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.191.193:0
--local_ip_for_outbound_sockets=127.26.191.193
--webserver_interface=127.26.191.193
--webserver_port=0
--tserver_master_addrs=127.26.191.254:37391
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.193.keytab
--principal=kudu/127.26.191.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:33519
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:07:57.173266 780 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:07:57.173494 780 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:07:57.173521 780 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:07:57.174780 780 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:07:57.174832 780 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:07:57.174862 780 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.191.193
I20260811 05:07:57.176460 780 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:33519
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424853995437-27391-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424853995437-27391-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.193.keytab
--principal=kudu/127.26.191.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.191.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424853995437-27391-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.191.193
--webserver_port=0
--tserver_master_addrs=127.26.191.254:37391
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.780
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.191.193
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424853995437-27391-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:07:57.176784 780 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:07:57.177080 780 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:07:57.182695 790 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:57.182651 792 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:07:57.182823 780 server_base.cc:1034] running on GCE node
W20260811 05:07:57.182687 788 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:07:57.183153 780 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:07:57.183445 780 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:07:57.184595 780 hybrid_clock.cc:648] HybridClock initialized: now 1786424877184571 us; error 39 us; skew 500 ppm
Aug 11 05:07:57 dist-test-slave-x5fp krb5kdc[611](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424877, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:07:57.187489 780 init.cc:377] Logged in from keytab as kudu/127.26.191.193@KRBTEST.COM (short username kudu)
I20260811 05:07:57.187971 780 webserver.cc:460] Webserver started at http://127.26.191.193:45667/ using document root <none> and password file <none>
I20260811 05:07:57.188215 780 fs_manager.cc:359] Metadata directory not provided
I20260811 05:07:57.188288 780 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:07:57.188447 780 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:07:57.189627 780 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424853995437-27391-0/minicluster-data/ts-0/data/instance:
uuid: "488b50db38f74435b8f8a840591bf2a0"
format_stamp: "Formatted at 2026-08-11 05:07:57 on dist-test-slave-x5fp"
server_key: "9dd6908f9edbf568a4fcacf223d99b68"
server_key_iv: "5a1a669e876325f27eb04099e0544fb7"
server_key_version: "encryptionkey@0"
I20260811 05:07:57.190006 780 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424853995437-27391-0/minicluster-data/ts-0/wal/instance:
uuid: "488b50db38f74435b8f8a840591bf2a0"
format_stamp: "Formatted at 2026-08-11 05:07:57 on dist-test-slave-x5fp"
server_key: "9dd6908f9edbf568a4fcacf223d99b68"
server_key_iv: "5a1a669e876325f27eb04099e0544fb7"
server_key_version: "encryptionkey@0"
I20260811 05:07:57.191615 780 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 05:07:57.192480 806 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:57.192796 780 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 05:07:57.192909 780 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424853995437-27391-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424853995437-27391-0/minicluster-data/ts-0/wal
uuid: "488b50db38f74435b8f8a840591bf2a0"
format_stamp: "Formatted at 2026-08-11 05:07:57 on dist-test-slave-x5fp"
server_key: "9dd6908f9edbf568a4fcacf223d99b68"
server_key_iv: "5a1a669e876325f27eb04099e0544fb7"
server_key_version: "encryptionkey@0"
I20260811 05:07:57.192997 780 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424853995437-27391-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424853995437-27391-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424853995437-27391-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:07:57.212999 780 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:07:57.215605 780 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:07:57.215792 780 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:07:57.216074 780 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:07:57.216426 780 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:07:57.216483 780 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:57.216521 780 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:07:57.216569 780 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:57.223230 780 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.193:44713
I20260811 05:07:57.223277 986 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.193:44713 every 8 connection(s)
I20260811 05:07:57.223628 780 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424853995437-27391-0/minicluster-data/ts-0/data/info.pb
Aug 11 05:07:57 dist-test-slave-x5fp krb5kdc[611](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424877, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.193@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
I20260811 05:07:57.231474 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 780
I20260811 05:07:57.231568 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424853995437-27391-0/minicluster-data/ts-0/wal/instance
I20260811 05:07:57.231824 27391 external_mini_cluster.cc:1428] Setting key b7fcbaa5b4f1df428ed686d809f3b142
I20260811 05:07:57.234357 741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:57.224443 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.193:33023 (local address 127.26.191.254:37391)
0811 05:07:57.224531 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:57.224534 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:57.224765 (+ 231us) server_negotiation.cc:407] Connection header received
0811 05:07:57.225768 (+ 1003us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:57.225770 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:57.225782 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:57.225857 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:57.226539 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:57.227083 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:57.228188 (+ 1105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:57.228429 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:57.228492 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:57.230902 (+ 2410us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:57.230904 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:57.230904 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:07:57.230911 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:57.232826 (+ 1915us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:57.233284 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:57.233285 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:57.233286 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:57.233356 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:57.233634 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:57.233635 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:57.233635 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:57.233773 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:57.233849 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:57.234152 (+ 303us) server_negotiation.cc:299] Negotiation successful
0811 05:07:57.234261 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 05:07:57.234577 990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:57.224373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:37391 (local address 127.26.191.193:33023)
0811 05:07:57.224606 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:57.224653 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:57.225661 (+ 1008us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:57.225941 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:57.225945 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:57.226221 (+ 276us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:07:57.226424 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:57.226429 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:57.227208 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:57.227209 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:57.228082 (+ 873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:57.228085 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:57.228530 (+ 445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:57.228531 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:57.228651 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:57.229303 (+ 652us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:07:57.229312 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:07:57.230785 (+ 1473us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:07:57.232924 (+ 2139us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:07:57.232933 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:07:57.232936 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:07:57.233189 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:07:57.233433 (+ 244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:07:57.233434 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:07:57.233434 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:07:57.233554 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:07:57.233855 (+ 301us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:07:57.233863 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:07:57.234005 (+ 142us) client_negotiation.cc:769] Sending connection context
0811 05:07:57.234116 (+ 111us) client_negotiation.cc:240] Negotiation successful
0811 05:07:57.234299 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":101,"threads_started":1}
I20260811 05:07:57.235157 987 heartbeater.cc:347] Connected to a master server at 127.26.191.254:37391
I20260811 05:07:57.235296 987 heartbeater.cc:464] Registering TS with master...
I20260811 05:07:57.235504 987 heartbeater.cc:511] Master 127.26.191.254:37391 requested a full tablet report, sending...
I20260811 05:07:57.236130 684 ts_manager.cc:194] Registered new tserver with Master: 488b50db38f74435b8f8a840591bf2a0 (127.26.191.193:44713)
I20260811 05:07:57.236833 684 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.191.193@KRBTEST.COM'} at 127.26.191.193:33023
WARNING: no policy specified for kudu/127.26.191.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.191.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.191.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.194.keytab.
Entry for principal kudu/127.26.191.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.194.keytab.
I20260811 05:07:57.263866 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424853995437-27391-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424853995437-27391-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424853995437-27391-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424853995437-27391-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.191.194:0
--local_ip_for_outbound_sockets=127.26.191.194
--webserver_interface=127.26.191.194
--webserver_port=0
--tserver_master_addrs=127.26.191.254:37391
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.194.keytab
--principal=kudu/127.26.191.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:33519
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:07:57.353183 994 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:07:57.353443 994 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:07:57.353472 994 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:07:57.354913 994 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:07:57.354982 994 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:07:57.355016 994 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.191.194
I20260811 05:07:57.356858 994 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:33519
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424853995437-27391-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424853995437-27391-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.194.keytab
--principal=kudu/127.26.191.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.191.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424853995437-27391-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.191.194
--webserver_port=0
--tserver_master_addrs=127.26.191.254:37391
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.994
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.191.194
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424853995437-27391-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:07:57.357156 994 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:07:57.357450 994 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:07:57.363176 1005 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:57.363255 1003 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:57.363224 1009 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:07:57.364117 994 server_base.cc:1034] running on GCE node
I20260811 05:07:57.364566 994 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:07:57.365005 994 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:07:57.366220 994 hybrid_clock.cc:648] HybridClock initialized: now 1786424877366164 us; error 78 us; skew 500 ppm
Aug 11 05:07:57 dist-test-slave-x5fp krb5kdc[611](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424877, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:07:57.369316 994 init.cc:377] Logged in from keytab as kudu/127.26.191.194@KRBTEST.COM (short username kudu)
I20260811 05:07:57.369820 994 webserver.cc:460] Webserver started at http://127.26.191.194:42329/ using document root <none> and password file <none>
I20260811 05:07:57.370133 994 fs_manager.cc:359] Metadata directory not provided
I20260811 05:07:57.370208 994 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:07:57.370383 994 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:07:57.371544 994 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424853995437-27391-0/minicluster-data/ts-1/data/instance:
uuid: "a63e248a3263416b8906e867becea335"
format_stamp: "Formatted at 2026-08-11 05:07:57 on dist-test-slave-x5fp"
server_key: "aface8173ba53de9aa7a1183066c6e02"
server_key_iv: "88ccefbfcbd50de69b77a95027ae0ac6"
server_key_version: "encryptionkey@0"
I20260811 05:07:57.371948 994 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424853995437-27391-0/minicluster-data/ts-1/wal/instance:
uuid: "a63e248a3263416b8906e867becea335"
format_stamp: "Formatted at 2026-08-11 05:07:57 on dist-test-slave-x5fp"
server_key: "aface8173ba53de9aa7a1183066c6e02"
server_key_iv: "88ccefbfcbd50de69b77a95027ae0ac6"
server_key_version: "encryptionkey@0"
I20260811 05:07:57.373612 994 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 05:07:57.374657 1021 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:57.374989 994 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 05:07:57.375133 994 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424853995437-27391-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424853995437-27391-0/minicluster-data/ts-1/wal
uuid: "a63e248a3263416b8906e867becea335"
format_stamp: "Formatted at 2026-08-11 05:07:57 on dist-test-slave-x5fp"
server_key: "aface8173ba53de9aa7a1183066c6e02"
server_key_iv: "88ccefbfcbd50de69b77a95027ae0ac6"
server_key_version: "encryptionkey@0"
I20260811 05:07:57.375222 994 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424853995437-27391-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424853995437-27391-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424853995437-27391-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:07:57.386879 994 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:07:57.389622 994 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:07:57.389813 994 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:07:57.390148 994 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:07:57.390494 994 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:07:57.390553 994 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:57.390600 994 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:07:57.390630 994 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:57.396932 994 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.194:39081
I20260811 05:07:57.396981 1205 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.194:39081 every 8 connection(s)
I20260811 05:07:57.397325 994 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424853995437-27391-0/minicluster-data/ts-1/data/info.pb
I20260811 05:07:57.400696 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 994
I20260811 05:07:57.400889 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424853995437-27391-0/minicluster-data/ts-1/wal/instance
I20260811 05:07:57.401108 27391 external_mini_cluster.cc:1428] Setting key 8586c23d118f17c380503ba92c464428
Aug 11 05:07:57 dist-test-slave-x5fp krb5kdc[611](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424877, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.194@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
I20260811 05:07:57.409375 741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:57.398249 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.194:36433 (local address 127.26.191.254:37391)
0811 05:07:57.398323 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:57.398326 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:57.398620 (+ 294us) server_negotiation.cc:407] Connection header received
0811 05:07:57.399902 (+ 1282us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:57.399903 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:57.399917 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:57.399985 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:57.400994 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:57.401755 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:57.402932 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:57.403261 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:57.403348 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:57.405957 (+ 2609us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:57.405959 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:57.405959 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:07:57.405968 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:57.407655 (+ 1687us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:57.408180 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:57.408182 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:57.408182 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:57.408253 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:57.408564 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:57.408565 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:57.408565 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:57.408703 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:57.408812 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:57.409156 (+ 344us) server_negotiation.cc:299] Negotiation successful
0811 05:07:57.409261 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 05:07:57.409579 1215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:57.398207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:37391 (local address 127.26.191.194:36433)
0811 05:07:57.398453 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:57.398524 (+ 71us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:57.399762 (+ 1238us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:57.400120 (+ 358us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:57.400124 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:57.400430 (+ 306us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:07:57.400800 (+ 370us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:57.400809 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:57.401863 (+ 1054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:57.401864 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:57.402833 (+ 969us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:57.402837 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:57.403377 (+ 540us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:57.403378 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:57.403494 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:57.404179 (+ 685us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:07:57.404189 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:07:57.405826 (+ 1637us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:07:57.407781 (+ 1955us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:07:57.407791 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:07:57.407793 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:07:57.408076 (+ 283us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:07:57.408330 (+ 254us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:07:57.408331 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:07:57.408332 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:07:57.408471 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:07:57.408819 (+ 348us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:07:57.408827 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:07:57.408996 (+ 169us) client_negotiation.cc:769] Sending connection context
0811 05:07:57.409117 (+ 121us) client_negotiation.cc:240] Negotiation successful
0811 05:07:57.409311 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":99,"threads_started":1}
I20260811 05:07:57.410162 1208 heartbeater.cc:347] Connected to a master server at 127.26.191.254:37391
I20260811 05:07:57.410272 1208 heartbeater.cc:464] Registering TS with master...
I20260811 05:07:57.410511 1208 heartbeater.cc:511] Master 127.26.191.254:37391 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.26.191.195@KRBTEST.COM; defaulting to no policy
I20260811 05:07:57.411063 684 ts_manager.cc:194] Registered new tserver with Master: a63e248a3263416b8906e867becea335 (127.26.191.194:39081)
I20260811 05:07:57.411523 684 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.191.194@KRBTEST.COM'} at 127.26.191.194:36433
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.191.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.191.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.195.keytab.
Entry for principal kudu/127.26.191.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.195.keytab.
I20260811 05:07:57.432924 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424853995437-27391-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424853995437-27391-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424853995437-27391-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424853995437-27391-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.191.195:0
--local_ip_for_outbound_sockets=127.26.191.195
--webserver_interface=127.26.191.195
--webserver_port=0
--tserver_master_addrs=127.26.191.254:37391
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.195.keytab
--principal=kudu/127.26.191.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:33519
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:07:57.529240 1220 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:07:57.529497 1220 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:07:57.529528 1220 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:07:57.530821 1220 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:07:57.530870 1220 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:07:57.530902 1220 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.191.195
I20260811 05:07:57.532605 1220 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:33519
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424853995437-27391-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424853995437-27391-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.195.keytab
--principal=kudu/127.26.191.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.191.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424853995437-27391-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.191.195
--webserver_port=0
--tserver_master_addrs=127.26.191.254:37391
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1220
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.191.195
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424853995437-27391-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:07:57.532943 1220 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:07:57.533182 1220 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:07:57.539040 1229 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:57.539096 1228 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:57.539094 1232 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:07:57.539824 1220 server_base.cc:1034] running on GCE node
I20260811 05:07:57.540120 1220 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:07:57.540452 1220 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:07:57.541716 1220 hybrid_clock.cc:648] HybridClock initialized: now 1786424877541686 us; error 45 us; skew 500 ppm
Aug 11 05:07:57 dist-test-slave-x5fp krb5kdc[611](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424877, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:07:57.544875 1220 init.cc:377] Logged in from keytab as kudu/127.26.191.195@KRBTEST.COM (short username kudu)
I20260811 05:07:57.545408 1220 webserver.cc:460] Webserver started at http://127.26.191.195:33245/ using document root <none> and password file <none>
I20260811 05:07:57.545662 1220 fs_manager.cc:359] Metadata directory not provided
I20260811 05:07:57.545739 1220 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:07:57.545902 1220 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:07:57.547039 1220 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424853995437-27391-0/minicluster-data/ts-2/data/instance:
uuid: "515bebf269c046b7930822af49650319"
format_stamp: "Formatted at 2026-08-11 05:07:57 on dist-test-slave-x5fp"
server_key: "178672cf298970bbb6aa5612de2c9938"
server_key_iv: "99a4d36843529a3af570e219ecf03b99"
server_key_version: "encryptionkey@0"
I20260811 05:07:57.547443 1220 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424853995437-27391-0/minicluster-data/ts-2/wal/instance:
uuid: "515bebf269c046b7930822af49650319"
format_stamp: "Formatted at 2026-08-11 05:07:57 on dist-test-slave-x5fp"
server_key: "178672cf298970bbb6aa5612de2c9938"
server_key_iv: "99a4d36843529a3af570e219ecf03b99"
server_key_version: "encryptionkey@0"
I20260811 05:07:57.549118 1220 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 05:07:57.550194 1243 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:57.550503 1220 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:07:57.550628 1220 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424853995437-27391-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424853995437-27391-0/minicluster-data/ts-2/wal
uuid: "515bebf269c046b7930822af49650319"
format_stamp: "Formatted at 2026-08-11 05:07:57 on dist-test-slave-x5fp"
server_key: "178672cf298970bbb6aa5612de2c9938"
server_key_iv: "99a4d36843529a3af570e219ecf03b99"
server_key_version: "encryptionkey@0"
I20260811 05:07:57.550724 1220 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424853995437-27391-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424853995437-27391-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424853995437-27391-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:07:57.563421 1220 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:07:57.565936 1220 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:07:57.566124 1220 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:07:57.566399 1220 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:07:57.566742 1220 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:07:57.566809 1220 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:57.566851 1220 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:07:57.566898 1220 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:57.573467 1220 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.195:36285
I20260811 05:07:57.573597 1420 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.195:36285 every 8 connection(s)
I20260811 05:07:57.573927 1220 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424853995437-27391-0/minicluster-data/ts-2/data/info.pb
I20260811 05:07:57.579936 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 1220
I20260811 05:07:57.580063 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424853995437-27391-0/minicluster-data/ts-2/wal/instance
I20260811 05:07:57.580255 27391 external_mini_cluster.cc:1428] Setting key 3dac58e503a35a919c807c38f406b312
Aug 11 05:07:57 dist-test-slave-x5fp krb5kdc[611](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424877, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.195@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
I20260811 05:07:57.584488 741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:57.574809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.195:59717 (local address 127.26.191.254:37391)
0811 05:07:57.574927 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:57.574929 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:57.575096 (+ 167us) server_negotiation.cc:407] Connection header received
0811 05:07:57.576151 (+ 1055us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:57.576153 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:57.576166 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:57.576226 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:57.576984 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:57.577500 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:57.578641 (+ 1141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:57.578844 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:57.578926 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:57.581752 (+ 2826us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:57.581753 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:57.581753 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:07:57.581761 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:57.583048 (+ 1287us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:57.583500 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:57.583502 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:57.583502 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:57.583572 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:57.583879 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:57.583880 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:57.583880 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:57.584012 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:57.584089 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:57.584345 (+ 256us) server_negotiation.cc:299] Negotiation successful
0811 05:07:57.584419 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260811 05:07:57.584694 1427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:57.574711 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:37391 (local address 127.26.191.195:59717)
0811 05:07:57.574953 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:57.575007 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:57.576032 (+ 1025us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:57.576311 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:57.576315 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:57.576585 (+ 270us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:07:57.576877 (+ 292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:57.576882 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:57.577597 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:57.577598 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:57.578541 (+ 943us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:57.578544 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:57.578947 (+ 403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:57.578948 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:57.579078 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:57.579710 (+ 632us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:07:57.579720 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:07:57.581665 (+ 1945us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:07:57.583140 (+ 1475us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:07:57.583147 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:07:57.583149 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:07:57.583403 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:07:57.583647 (+ 244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:07:57.583648 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:07:57.583648 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:07:57.583755 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:07:57.584089 (+ 334us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:07:57.584093 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:07:57.584218 (+ 125us) client_negotiation.cc:769] Sending connection context
0811 05:07:57.584309 (+ 91us) client_negotiation.cc:240] Negotiation successful
0811 05:07:57.584438 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":90,"threads_started":1}
I20260811 05:07:57.585327 1422 heartbeater.cc:347] Connected to a master server at 127.26.191.254:37391
I20260811 05:07:57.585438 1422 heartbeater.cc:464] Registering TS with master...
I20260811 05:07:57.585624 1422 heartbeater.cc:511] Master 127.26.191.254:37391 requested a full tablet report, sending...
I20260811 05:07:57.586191 684 ts_manager.cc:194] Registered new tserver with Master: 515bebf269c046b7930822af49650319 (127.26.191.195:36285)
I20260811 05:07:57.586598 684 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.191.195@KRBTEST.COM'} at 127.26.191.195:59717
I20260811 05:07:57.593021 27391 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 05:07:57 dist-test-slave-x5fp krb5kdc[611](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424877, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 05:07:57 dist-test-slave-x5fp krb5kdc[611](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424877, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.191.193@KRBTEST.COM
I20260811 05:07:57.620169 1433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:57.611269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34524 (local address 127.26.191.193:44713)
0811 05:07:57.611544 (+ 275us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:57.611550 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:57.611564 (+ 14us) server_negotiation.cc:407] Connection header received
0811 05:07:57.611596 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:57.611599 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:57.611615 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:57.611705 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:57.612364 (+ 659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:57.613378 (+ 1014us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:57.614182 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:57.614574 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:57.614644 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:57.617330 (+ 2686us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:57.617340 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:57.617341 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:07:57.617348 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:57.619039 (+ 1691us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:57.619414 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:57.619417 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:57.619417 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:57.619480 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:57.619667 (+ 187us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:57.619668 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:57.619668 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:57.619841 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:57.619973 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:57.620018 (+ 45us) server_negotiation.cc:299] Negotiation successful
0811 05:07:57.620085 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":223,"thread_start_us":141,"threads_started":1}
Aug 11 05:07:57 dist-test-slave-x5fp krb5kdc[611](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424877, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
I20260811 05:07:57.629920 741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:57.621866 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32896 (local address 127.26.191.254:37391)
0811 05:07:57.621937 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:57.621939 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:57.621948 (+ 9us) server_negotiation.cc:407] Connection header received
0811 05:07:57.621975 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:57.621977 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:57.621993 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:57.622042 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:57.622592 (+ 550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:57.623195 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:57.624021 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:57.624240 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:57.624306 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:57.626904 (+ 2598us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:57.626906 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:57.626907 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:07:57.626914 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:57.628461 (+ 1547us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:57.629020 (+ 559us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:57.629021 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:57.629021 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:57.629090 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:57.629331 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:57.629331 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:57.629332 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:57.629508 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:57.629602 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:57.629762 (+ 160us) server_negotiation.cc:299] Negotiation successful
0811 05:07:57.629841 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
W20260811 05:07:57.630237 684 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:32896
I20260811 05:07:57.630656 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 780
I20260811 05:07:57.643499 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 994
I20260811 05:07:57.661687 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 1220
I20260811 05:07:57.674835 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 631
2026-08-11T05:07:57Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (2334 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 05:07:57 dist-test-slave-x5fp krb5kdc[1443](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 05:07:57 dist-test-slave-x5fp krb5kdc[1443](info): set up 2 sockets
Aug 11 05:07:57 dist-test-slave-x5fp krb5kdc[1443](info): commencing operation
krb5kdc: starting...
W20260811 05:07:58.996019 27391 mini_kdc.cc:121] Time spent starting KDC: real 1.291s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/krb5kdc/test-user.keytab.
Aug 11 05:07:59 dist-test-slave-x5fp krb5kdc[1443](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424879, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T05:07:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:07:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.191.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.191.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.191.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab.
Entry for principal kudu/127.26.191.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab.
I20260811 05:07:59.136234 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.254:37979
--webserver_interface=127.26.191.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab
--principal=kudu/127.26.191.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:43187
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.191.254:37979
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:07:59.226804 1458 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:07:59.227084 1458 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:07:59.227125 1458 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:07:59.228425 1458 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:07:59.228502 1458 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:07:59.228526 1458 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:07:59.228549 1458 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:07:59.228585 1458 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:07:59.230284 1458 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:43187
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.191.254:37979
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab
--principal=kudu/127.26.191.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.254:37979
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.191.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1458
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:07:59.230592 1458 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:07:59.230849 1458 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:07:59.236459 1469 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:59.236459 1470 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:07:59.236477 1458 server_base.cc:1034] running on GCE node
W20260811 05:07:59.236507 1475 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:07:59.237188 1458 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:07:59.237571 1458 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:07:59.238739 1458 hybrid_clock.cc:648] HybridClock initialized: now 1786424879238715 us; error 46 us; skew 500 ppm
Aug 11 05:07:59 dist-test-slave-x5fp krb5kdc[1443](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424879, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:07:59.241642 1458 init.cc:377] Logged in from keytab as kudu/127.26.191.254@KRBTEST.COM (short username kudu)
I20260811 05:07:59.242038 1458 fs_manager.cc:359] Metadata directory not provided
I20260811 05:07:59.242092 1458 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:07:59.242300 1458 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:07:59.243502 1458 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/minicluster-data/master-0/data/instance:
uuid: "f571ef974bc84b61a7d53674c8799744"
format_stamp: "Formatted at 2026-08-11 05:07:59 on dist-test-slave-x5fp"
server_key: "eb9efc30b452ee83c511934b489dadd8"
server_key_iv: "bbac341366c4e0df4eb2f8630cdd3f79"
server_key_version: "encryptionkey@0"
I20260811 05:07:59.243906 1458 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/minicluster-data/master-0/wal/instance:
uuid: "f571ef974bc84b61a7d53674c8799744"
format_stamp: "Formatted at 2026-08-11 05:07:59 on dist-test-slave-x5fp"
server_key: "eb9efc30b452ee83c511934b489dadd8"
server_key_iv: "bbac341366c4e0df4eb2f8630cdd3f79"
server_key_version: "encryptionkey@0"
I20260811 05:07:59.245524 1458 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 05:07:59.246481 1482 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:59.246723 1458 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:07:59.246862 1458 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/minicluster-data/master-0/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/minicluster-data/master-0/wal
uuid: "f571ef974bc84b61a7d53674c8799744"
format_stamp: "Formatted at 2026-08-11 05:07:59 on dist-test-slave-x5fp"
server_key: "eb9efc30b452ee83c511934b489dadd8"
server_key_iv: "bbac341366c4e0df4eb2f8630cdd3f79"
server_key_version: "encryptionkey@0"
I20260811 05:07:59.246968 1458 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:07:59.261992 1458 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:07:59.264200 1458 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:07:59.264377 1458 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:07:59.268707 1458 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.254:37979
I20260811 05:07:59.268822 1564 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.254:37979 every 8 connection(s)
I20260811 05:07:59.269129 1458 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
I20260811 05:07:59.270157 1566 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:07:59.272845 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 1458
I20260811 05:07:59.272986 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/minicluster-data/master-0/wal/instance
I20260811 05:07:59.273234 27391 external_mini_cluster.cc:1428] Setting key c1b4d61a9e78c4a9ef3bb96162b787f2
I20260811 05:07:59.273470 1566 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f571ef974bc84b61a7d53674c8799744: Bootstrap starting.
I20260811 05:07:59.274374 1566 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f571ef974bc84b61a7d53674c8799744: Neither blocks nor log segments found. Creating new log.
I20260811 05:07:59.274780 1566 log.cc:824] T 00000000000000000000000000000000 P f571ef974bc84b61a7d53674c8799744: Log is configured to *not* fsync() on all Append() calls
I20260811 05:07:59.275714 1566 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f571ef974bc84b61a7d53674c8799744: No bootstrap required, opened a new log
I20260811 05:07:59.278316 1566 raft_consensus.cc:348] T 00000000000000000000000000000000 P f571ef974bc84b61a7d53674c8799744 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f571ef974bc84b61a7d53674c8799744" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 37979 } }
I20260811 05:07:59.278481 1566 raft_consensus.cc:374] T 00000000000000000000000000000000 P f571ef974bc84b61a7d53674c8799744 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:07:59.278507 1566 raft_consensus.cc:729] T 00000000000000000000000000000000 P f571ef974bc84b61a7d53674c8799744 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f571ef974bc84b61a7d53674c8799744, State: Initialized, Role: FOLLOWER
I20260811 05:07:59.278729 1566 consensus_queue.cc:260] T 00000000000000000000000000000000 P f571ef974bc84b61a7d53674c8799744 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f571ef974bc84b61a7d53674c8799744" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 37979 } }
I20260811 05:07:59.278812 1566 raft_consensus.cc:388] T 00000000000000000000000000000000 P f571ef974bc84b61a7d53674c8799744 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:07:59.278865 1566 raft_consensus.cc:482] T 00000000000000000000000000000000 P f571ef974bc84b61a7d53674c8799744 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:07:59.279258 1566 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f571ef974bc84b61a7d53674c8799744 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:07:59.279990 1566 raft_consensus.cc:504] T 00000000000000000000000000000000 P f571ef974bc84b61a7d53674c8799744 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f571ef974bc84b61a7d53674c8799744" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 37979 } }
I20260811 05:07:59.280123 1566 leader_election.cc:302] T 00000000000000000000000000000000 P f571ef974bc84b61a7d53674c8799744 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f571ef974bc84b61a7d53674c8799744; no voters:
I20260811 05:07:59.280373 1566 leader_election.cc:288] T 00000000000000000000000000000000 P f571ef974bc84b61a7d53674c8799744 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 05:07:59.280409 1572 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f571ef974bc84b61a7d53674c8799744 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:07:59.280586 1572 raft_consensus.cc:686] T 00000000000000000000000000000000 P f571ef974bc84b61a7d53674c8799744 [term 1 LEADER]: Becoming Leader. State: Replica: f571ef974bc84b61a7d53674c8799744, State: Running, Role: LEADER
Aug 11 05:07:59 dist-test-slave-x5fp krb5kdc[1443](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424879, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
I20260811 05:07:59.280735 1566 sys_catalog.cc:564] T 00000000000000000000000000000000 P f571ef974bc84b61a7d53674c8799744 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:07:59.280794 1572 consensus_queue.cc:237] T 00000000000000000000000000000000 P f571ef974bc84b61a7d53674c8799744 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f571ef974bc84b61a7d53674c8799744" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 37979 } }
I20260811 05:07:59.281280 1572 sys_catalog.cc:455] T 00000000000000000000000000000000 P f571ef974bc84b61a7d53674c8799744 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f571ef974bc84b61a7d53674c8799744. Latest consensus state: current_term: 1 leader_uuid: "f571ef974bc84b61a7d53674c8799744" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f571ef974bc84b61a7d53674c8799744" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 37979 } } }
I20260811 05:07:59.281376 1576 sys_catalog.cc:455] T 00000000000000000000000000000000 P f571ef974bc84b61a7d53674c8799744 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f571ef974bc84b61a7d53674c8799744" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f571ef974bc84b61a7d53674c8799744" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 37979 } } }
I20260811 05:07:59.281548 1572 sys_catalog.cc:458] T 00000000000000000000000000000000 P f571ef974bc84b61a7d53674c8799744 [sys.catalog]: This master's current role is: LEADER
I20260811 05:07:59.281558 1576 sys_catalog.cc:458] T 00000000000000000000000000000000 P f571ef974bc84b61a7d53674c8799744 [sys.catalog]: This master's current role is: LEADER
I20260811 05:07:59.281864 1587 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:07:59.282428 1587 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:07:59.284452 1587 catalog_manager.cc:1347] Generated new cluster ID: b695c182e7a14d57b72d5505d1ce6704
I20260811 05:07:59.284533 1587 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:07:59.286449 1569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:59.273898 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44662 (local address 127.26.191.254:37979)
0811 05:07:59.274097 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:59.274108 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:59.274143 (+ 35us) server_negotiation.cc:407] Connection header received
0811 05:07:59.274645 (+ 502us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:59.274652 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:59.274703 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:59.274831 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:59.275860 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:59.276813 (+ 953us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:59.278091 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:59.278552 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:59.278679 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:59.281385 (+ 2706us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:59.281390 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:59.281390 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:07:59.281403 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:59.283996 (+ 2593us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:59.284433 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:59.284436 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:59.284437 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:59.284613 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:59.284932 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:59.284943 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:59.284944 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:59.285318 (+ 374us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:59.285503 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:59.286041 (+ 538us) server_negotiation.cc:299] Negotiation successful
0811 05:07:59.286222 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":110,"threads_started":1}
I20260811 05:07:59.293104 1587 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:07:59.293641 1587 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:07:59.296885 1587 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f571ef974bc84b61a7d53674c8799744: Generated new TSK 0
I20260811 05:07:59.297093 1587 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.191.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.191.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.191.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.193.keytab.
Entry for principal kudu/127.26.191.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.193.keytab.
I20260811 05:07:59.336815 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.191.193:0
--local_ip_for_outbound_sockets=127.26.191.193
--webserver_interface=127.26.191.193
--webserver_port=0
--tserver_master_addrs=127.26.191.254:37979
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.193.keytab
--principal=kudu/127.26.191.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:43187
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:07:59.424101 1606 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:07:59.424355 1606 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:07:59.424401 1606 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:07:59.425643 1606 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:07:59.425711 1606 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:07:59.425757 1606 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.191.193
I20260811 05:07:59.427323 1606 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:43187
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.193.keytab
--principal=kudu/127.26.191.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.191.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.191.193
--webserver_port=0
--tserver_master_addrs=127.26.191.254:37979
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1606
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.191.193
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:07:59.427599 1606 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:07:59.427852 1606 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:07:59.433393 1614 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:59.433370 1613 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:07:59.433475 1606 server_base.cc:1034] running on GCE node
W20260811 05:07:59.433377 1621 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:07:59.433893 1606 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:07:59.434156 1606 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:07:59.435338 1606 hybrid_clock.cc:648] HybridClock initialized: now 1786424879435272 us; error 101 us; skew 500 ppm
Aug 11 05:07:59 dist-test-slave-x5fp krb5kdc[1443](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424879, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:07:59.438352 1606 init.cc:377] Logged in from keytab as kudu/127.26.191.193@KRBTEST.COM (short username kudu)
I20260811 05:07:59.438712 1606 fs_manager.cc:359] Metadata directory not provided
I20260811 05:07:59.438774 1606 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:07:59.438882 1606 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:07:59.440028 1606 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/minicluster-data/ts-0/data/instance:
uuid: "45a404de691c41dab768eb3773ac0583"
format_stamp: "Formatted at 2026-08-11 05:07:59 on dist-test-slave-x5fp"
server_key: "ed2cb31beb948a74aff62f70b653a717"
server_key_iv: "4d3f1b64f5ffa7d8667ac05e839f3e0d"
server_key_version: "encryptionkey@0"
I20260811 05:07:59.440375 1606 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/minicluster-data/ts-0/wal/instance:
uuid: "45a404de691c41dab768eb3773ac0583"
format_stamp: "Formatted at 2026-08-11 05:07:59 on dist-test-slave-x5fp"
server_key: "ed2cb31beb948a74aff62f70b653a717"
server_key_iv: "4d3f1b64f5ffa7d8667ac05e839f3e0d"
server_key_version: "encryptionkey@0"
I20260811 05:07:59.442031 1606 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 05:07:59.443037 1632 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:59.443315 1606 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 05:07:59.443434 1606 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/minicluster-data/ts-0/wal
uuid: "45a404de691c41dab768eb3773ac0583"
format_stamp: "Formatted at 2026-08-11 05:07:59 on dist-test-slave-x5fp"
server_key: "ed2cb31beb948a74aff62f70b653a717"
server_key_iv: "4d3f1b64f5ffa7d8667ac05e839f3e0d"
server_key_version: "encryptionkey@0"
I20260811 05:07:59.443531 1606 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:07:59.461189 1606 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:07:59.463809 1606 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:07:59.464015 1606 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:07:59.464296 1606 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:07:59.464694 1606 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:07:59.464794 1606 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:59.464843 1606 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:07:59.464879 1606 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:59.471679 1606 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.193:40231
I20260811 05:07:59.471727 1814 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.193:40231 every 8 connection(s)
I20260811 05:07:59.472059 1606 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/minicluster-data/ts-0/data/info.pb
I20260811 05:07:59.473618 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 1606
I20260811 05:07:59.473730 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/minicluster-data/ts-0/wal/instance
I20260811 05:07:59.473918 27391 external_mini_cluster.cc:1428] Setting key c7069931c1bea05e85dc055a9c798d3d
Aug 11 05:07:59 dist-test-slave-x5fp krb5kdc[1443](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424879, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.193@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
I20260811 05:07:59.484187 1569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:59.472918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.193:44927 (local address 127.26.191.254:37979)
0811 05:07:59.472964 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:59.472966 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:59.473186 (+ 220us) server_negotiation.cc:407] Connection header received
0811 05:07:59.473900 (+ 714us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:59.473901 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:59.473913 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:59.474012 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:59.475514 (+ 1502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:59.476029 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:59.477391 (+ 1362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:59.477772 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:59.477872 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:59.480408 (+ 2536us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:59.480410 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:59.480411 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:07:59.480420 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:59.482389 (+ 1969us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:59.482843 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:59.482845 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:59.482845 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:59.482923 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:59.483404 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:59.483405 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:59.483406 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:59.483573 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:59.483652 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:59.483937 (+ 285us) server_negotiation.cc:299] Negotiation successful
0811 05:07:59.484042 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 05:07:59.484275 1820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:59.472877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:37979 (local address 127.26.191.193:44927)
0811 05:07:59.473048 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:59.473095 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:59.473775 (+ 680us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:59.474138 (+ 363us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:59.474142 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:59.474493 (+ 351us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:07:59.475341 (+ 848us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:59.475348 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:59.476133 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:59.476134 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:59.477290 (+ 1156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:59.477293 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:59.477900 (+ 607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:59.477902 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:59.478035 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:59.478677 (+ 642us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:07:59.478687 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:07:59.480292 (+ 1605us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:07:59.482499 (+ 2207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:07:59.482507 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:07:59.482509 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:07:59.482759 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:07:59.483181 (+ 422us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:07:59.483182 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:07:59.483183 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:07:59.483315 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:07:59.483650 (+ 335us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:07:59.483655 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:07:59.483791 (+ 136us) client_negotiation.cc:769] Sending connection context
0811 05:07:59.483883 (+ 92us) client_negotiation.cc:240] Negotiation successful
0811 05:07:59.484056 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":95,"threads_started":1}
WARNING: no policy specified for kudu/127.26.191.194@KRBTEST.COM; defaulting to no policy
I20260811 05:07:59.485172 1815 heartbeater.cc:347] Connected to a master server at 127.26.191.254:37979
I20260811 05:07:59.485311 1815 heartbeater.cc:464] Registering TS with master...
I20260811 05:07:59.485476 1815 heartbeater.cc:511] Master 127.26.191.254:37979 requested a full tablet report, sending...
I20260811 05:07:59.486084 1505 ts_manager.cc:194] Registered new tserver with Master: 45a404de691c41dab768eb3773ac0583 (127.26.191.193:40231)
I20260811 05:07:59.486732 1505 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.191.193@KRBTEST.COM'} at 127.26.191.193:44927
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.191.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.191.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.194.keytab.
Entry for principal kudu/127.26.191.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.194.keytab.
I20260811 05:07:59.504122 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.191.194:0
--local_ip_for_outbound_sockets=127.26.191.194
--webserver_interface=127.26.191.194
--webserver_port=0
--tserver_master_addrs=127.26.191.254:37979
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.194.keytab
--principal=kudu/127.26.191.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:43187
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:07:59.593024 1826 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:07:59.593327 1826 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:07:59.593364 1826 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:07:59.595011 1826 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:07:59.595098 1826 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:07:59.595134 1826 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.191.194
I20260811 05:07:59.597195 1826 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:43187
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.194.keytab
--principal=kudu/127.26.191.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.191.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.191.194
--webserver_port=0
--tserver_master_addrs=127.26.191.254:37979
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1826
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.191.194
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:07:59.597463 1826 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:07:59.597671 1826 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:07:59.603302 1834 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:59.603253 1831 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:59.603289 1839 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:07:59.603647 1826 server_base.cc:1034] running on GCE node
I20260811 05:07:59.603960 1826 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:07:59.604270 1826 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:07:59.605494 1826 hybrid_clock.cc:648] HybridClock initialized: now 1786424879605463 us; error 47 us; skew 500 ppm
Aug 11 05:07:59 dist-test-slave-x5fp krb5kdc[1443](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424879, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:07:59.608884 1826 init.cc:377] Logged in from keytab as kudu/127.26.191.194@KRBTEST.COM (short username kudu)
I20260811 05:07:59.609508 1826 fs_manager.cc:359] Metadata directory not provided
I20260811 05:07:59.609601 1826 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:07:59.609766 1826 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:07:59.610957 1826 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/minicluster-data/ts-1/data/instance:
uuid: "cadc0dbf044a4e92953fb9c9bb4e1f3b"
format_stamp: "Formatted at 2026-08-11 05:07:59 on dist-test-slave-x5fp"
server_key: "a702ac4a650d6d740642d45d1c473d64"
server_key_iv: "5cfba128b62baeff39112e459f000901"
server_key_version: "encryptionkey@0"
I20260811 05:07:59.611393 1826 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/minicluster-data/ts-1/wal/instance:
uuid: "cadc0dbf044a4e92953fb9c9bb4e1f3b"
format_stamp: "Formatted at 2026-08-11 05:07:59 on dist-test-slave-x5fp"
server_key: "a702ac4a650d6d740642d45d1c473d64"
server_key_iv: "5cfba128b62baeff39112e459f000901"
server_key_version: "encryptionkey@0"
I20260811 05:07:59.613077 1826 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 05:07:59.614045 1849 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:59.614259 1826 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:07:59.614372 1826 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/minicluster-data/ts-1/wal
uuid: "cadc0dbf044a4e92953fb9c9bb4e1f3b"
format_stamp: "Formatted at 2026-08-11 05:07:59 on dist-test-slave-x5fp"
server_key: "a702ac4a650d6d740642d45d1c473d64"
server_key_iv: "5cfba128b62baeff39112e459f000901"
server_key_version: "encryptionkey@0"
I20260811 05:07:59.614445 1826 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:07:59.628620 1826 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:07:59.631487 1826 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:07:59.631623 1826 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:07:59.631878 1826 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:07:59.632279 1826 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:07:59.632330 1826 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:59.632355 1826 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:07:59.632367 1826 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:59.639034 1826 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.194:43347
I20260811 05:07:59.639070 2042 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.194:43347 every 8 connection(s)
I20260811 05:07:59.639395 1826 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/minicluster-data/ts-1/data/info.pb
I20260811 05:07:59.640829 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 1826
I20260811 05:07:59.640955 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/minicluster-data/ts-1/wal/instance
I20260811 05:07:59.641141 27391 external_mini_cluster.cc:1428] Setting key 8d2886604f27475e2c68fe77366d174e
Aug 11 05:07:59 dist-test-slave-x5fp krb5kdc[1443](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424879, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.194@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
I20260811 05:07:59.651762 1569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:59.640278 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.194:51327 (local address 127.26.191.254:37979)
0811 05:07:59.640365 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:59.640367 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:59.640532 (+ 165us) server_negotiation.cc:407] Connection header received
0811 05:07:59.641443 (+ 911us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:59.641444 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:59.641481 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:59.641543 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:59.642950 (+ 1407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:59.643704 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:59.644927 (+ 1223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:59.645245 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:59.645333 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:59.648276 (+ 2943us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:59.648277 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:59.648278 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:07:59.648286 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:59.649977 (+ 1691us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:59.650563 (+ 586us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:59.650565 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:59.650565 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:59.650682 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:59.651018 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:59.651019 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:59.651020 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:59.651175 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:59.651233 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:59.651611 (+ 378us) server_negotiation.cc:299] Negotiation successful
0811 05:07:59.651689 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
WARNING: no policy specified for kudu/127.26.191.195@KRBTEST.COM; defaulting to no policy
I20260811 05:07:59.652123 2047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:59.640224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:37979 (local address 127.26.191.194:51327)
0811 05:07:59.640405 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:59.640446 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:59.641245 (+ 799us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:59.641685 (+ 440us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:59.641691 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:59.642171 (+ 480us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:07:59.642776 (+ 605us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:59.642783 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:59.643874 (+ 1091us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:59.643875 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:59.644824 (+ 949us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:59.644828 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:59.645359 (+ 531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:59.645360 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:59.645479 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:59.646127 (+ 648us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:07:59.646137 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:07:59.648154 (+ 2017us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:07:59.650094 (+ 1940us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:07:59.650105 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:07:59.650108 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:07:59.650460 (+ 352us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:07:59.650762 (+ 302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:07:59.650763 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:07:59.650763 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:07:59.650927 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:07:59.651235 (+ 308us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:07:59.651244 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:07:59.651455 (+ 211us) client_negotiation.cc:769] Sending connection context
0811 05:07:59.651589 (+ 134us) client_negotiation.cc:240] Negotiation successful
0811 05:07:59.651773 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":96,"threads_started":1}
I20260811 05:07:59.653002 2043 heartbeater.cc:347] Connected to a master server at 127.26.191.254:37979
I20260811 05:07:59.653100 2043 heartbeater.cc:464] Registering TS with master...
I20260811 05:07:59.653276 2043 heartbeater.cc:511] Master 127.26.191.254:37979 requested a full tablet report, sending...
I20260811 05:07:59.653787 1505 ts_manager.cc:194] Registered new tserver with Master: cadc0dbf044a4e92953fb9c9bb4e1f3b (127.26.191.194:43347)
I20260811 05:07:59.654210 1505 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.191.194@KRBTEST.COM'} at 127.26.191.194:51327
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.191.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.191.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.195.keytab.
Entry for principal kudu/127.26.191.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.195.keytab.
I20260811 05:07:59.672353 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.191.195:0
--local_ip_for_outbound_sockets=127.26.191.195
--webserver_interface=127.26.191.195
--webserver_port=0
--tserver_master_addrs=127.26.191.254:37979
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.195.keytab
--principal=kudu/127.26.191.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:43187
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:07:59.761997 2053 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:07:59.762243 2053 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:07:59.762269 2053 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:07:59.763448 2053 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:07:59.763487 2053 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:07:59.763516 2053 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.191.195
I20260811 05:07:59.765142 2053 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:43187
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.195.keytab
--principal=kudu/127.26.191.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.191.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.191.195
--webserver_port=0
--tserver_master_addrs=127.26.191.254:37979
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2053
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.191.195
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:07:59.765419 2053 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:07:59.765671 2053 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:07:59.771356 2060 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:59.771374 2066 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:59.771474 2061 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:07:59.771950 2053 server_base.cc:1034] running on GCE node
I20260811 05:07:59.772257 2053 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:07:59.772584 2053 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:07:59.773808 2053 hybrid_clock.cc:648] HybridClock initialized: now 1786424879773800 us; error 68 us; skew 500 ppm
Aug 11 05:07:59 dist-test-slave-x5fp krb5kdc[1443](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424879, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:07:59.777055 2053 init.cc:377] Logged in from keytab as kudu/127.26.191.195@KRBTEST.COM (short username kudu)
I20260811 05:07:59.777483 2053 fs_manager.cc:359] Metadata directory not provided
I20260811 05:07:59.777570 2053 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:07:59.777774 2053 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:07:59.779021 2053 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/minicluster-data/ts-2/data/instance:
uuid: "ebf96a6f404d48c894096defa759926a"
format_stamp: "Formatted at 2026-08-11 05:07:59 on dist-test-slave-x5fp"
server_key: "c4742e90bd6d39139054bfc51e00b346"
server_key_iv: "d2bb8317cb6d410af9c3ebf79ca23e12"
server_key_version: "encryptionkey@0"
I20260811 05:07:59.779469 2053 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/minicluster-data/ts-2/wal/instance:
uuid: "ebf96a6f404d48c894096defa759926a"
format_stamp: "Formatted at 2026-08-11 05:07:59 on dist-test-slave-x5fp"
server_key: "c4742e90bd6d39139054bfc51e00b346"
server_key_iv: "d2bb8317cb6d410af9c3ebf79ca23e12"
server_key_version: "encryptionkey@0"
I20260811 05:07:59.781159 2053 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.001s
I20260811 05:07:59.782217 2078 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:59.782467 2053 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 05:07:59.782583 2053 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/minicluster-data/ts-2/wal
uuid: "ebf96a6f404d48c894096defa759926a"
format_stamp: "Formatted at 2026-08-11 05:07:59 on dist-test-slave-x5fp"
server_key: "c4742e90bd6d39139054bfc51e00b346"
server_key_iv: "d2bb8317cb6d410af9c3ebf79ca23e12"
server_key_version: "encryptionkey@0"
I20260811 05:07:59.782646 2053 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:07:59.798753 2053 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:07:59.801611 2053 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:07:59.801817 2053 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:07:59.802102 2053 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:07:59.802482 2053 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:07:59.802546 2053 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:59.802595 2053 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:07:59.802631 2053 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:59.809859 2053 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.195:35679
I20260811 05:07:59.809973 2283 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.195:35679 every 8 connection(s)
I20260811 05:07:59.810266 2053 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/minicluster-data/ts-2/data/info.pb
Aug 11 05:07:59 dist-test-slave-x5fp krb5kdc[1443](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424879, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.195@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
I20260811 05:07:59.819690 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 2053
I20260811 05:07:59.819809 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/minicluster-data/ts-2/wal/instance
I20260811 05:07:59.820024 27391 external_mini_cluster.cc:1428] Setting key ee5e04ba97471339ba7e95ef342a996c
I20260811 05:07:59.821851 1569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:59.811337 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.195:43385 (local address 127.26.191.254:37979)
0811 05:07:59.811450 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:59.811452 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:59.811575 (+ 123us) server_negotiation.cc:407] Connection header received
0811 05:07:59.812101 (+ 526us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:59.812102 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:59.812114 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:59.812173 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:59.813342 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:59.813902 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:59.815034 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:59.815233 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:59.815317 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:59.818067 (+ 2750us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:59.818069 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:59.818069 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:07:59.818080 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:59.819892 (+ 1812us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:59.820426 (+ 534us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:59.820428 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:59.820428 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:59.820498 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:59.820983 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:59.820984 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:59.820984 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:59.821145 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:59.821201 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:59.821674 (+ 473us) server_negotiation.cc:299] Negotiation successful
0811 05:07:59.821754 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260811 05:07:59.822118 2287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:59.811184 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:37979 (local address 127.26.191.195:43385)
0811 05:07:59.811414 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:59.811457 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:59.811998 (+ 541us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:59.812230 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:59.812234 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:59.812541 (+ 307us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:07:59.813210 (+ 669us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:59.813216 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:59.814017 (+ 801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:59.814018 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:59.814897 (+ 879us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:59.814900 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:59.815382 (+ 482us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:59.815384 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:59.815520 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:59.816173 (+ 653us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:07:59.816184 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:07:59.817940 (+ 1756us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:07:59.819985 (+ 2045us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:07:59.819992 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:07:59.819994 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:07:59.820334 (+ 340us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:07:59.820612 (+ 278us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:07:59.820614 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:07:59.820614 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:07:59.820892 (+ 278us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:07:59.821340 (+ 448us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:07:59.821348 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:07:59.821517 (+ 169us) client_negotiation.cc:769] Sending connection context
0811 05:07:59.821619 (+ 102us) client_negotiation.cc:240] Negotiation successful
0811 05:07:59.821806 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":108,"threads_started":1}
I20260811 05:07:59.822816 2285 heartbeater.cc:347] Connected to a master server at 127.26.191.254:37979
I20260811 05:07:59.822929 2285 heartbeater.cc:464] Registering TS with master...
I20260811 05:07:59.823057 2285 heartbeater.cc:511] Master 127.26.191.254:37979 requested a full tablet report, sending...
I20260811 05:07:59.823482 1505 ts_manager.cc:194] Registered new tserver with Master: ebf96a6f404d48c894096defa759926a (127.26.191.195:35679)
I20260811 05:07:59.823915 1505 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.191.195@KRBTEST.COM'} at 127.26.191.195:43385
I20260811 05:07:59.832659 27391 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 05:07:59.841130 1569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:59.834119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44678 (local address 127.26.191.254:37979)
0811 05:07:59.834203 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:59.834206 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:59.834310 (+ 104us) server_negotiation.cc:407] Connection header received
0811 05:07:59.834392 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:59.834393 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:59.834411 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:59.834476 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:59.835094 (+ 618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:59.835603 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:59.836327 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:59.836521 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:59.836600 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:59.838164 (+ 1564us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:59.838165 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:59.838166 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:07:59.838181 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:59.839645 (+ 1464us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:59.840118 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:59.840120 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:59.840120 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:59.840193 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:59.840435 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:59.840436 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:59.840436 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:59.840617 (+ 181us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:59.840819 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:59.840909 (+ 90us) server_negotiation.cc:299] Negotiation successful
0811 05:07:59.841006 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 05:07:59.843079 1505 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44678:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 05:07:59.844769 1505 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 05:07:59.852701 2308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:59.847774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.195:35679 (local address 127.0.0.1:60202)
0811 05:07:59.848823 (+ 1049us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:59.848833 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:59.848918 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:59.849112 (+ 194us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:59.849113 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:59.849115 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:07:59.849167 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:59.849169 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:59.850316 (+ 1147us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:59.850317 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:59.851345 (+ 1028us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:59.851348 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:59.852336 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:59.852337 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:59.852440 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:59.852458 (+ 18us) client_negotiation.cc:769] Sending connection context
0811 05:07:59.852540 (+ 82us) client_negotiation.cc:240] Negotiation successful
0811 05:07:59.852604 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1024,"thread_start_us":111,"threads_started":1}
I20260811 05:07:59.853094 2309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:59.847844 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60202 (local address 127.26.191.195:35679)
0811 05:07:59.848403 (+ 559us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:59.848408 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:59.848913 (+ 505us) server_negotiation.cc:407] Connection header received
0811 05:07:59.848993 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:59.848995 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:59.849012 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:59.849118 (+ 106us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:07:59.849232 (+ 114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:59.850194 (+ 962us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:59.851420 (+ 1226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:59.852242 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:59.852327 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:59.852385 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:59.852949 (+ 564us) server_negotiation.cc:299] Negotiation successful
0811 05:07:59.853000 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":521,"thread_start_us":138,"threads_started":1}
I20260811 05:07:59.853781 2311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:59.848027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41958 (local address 127.26.191.193:40231)
0811 05:07:59.848238 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:59.848245 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:59.848265 (+ 20us) server_negotiation.cc:407] Connection header received
0811 05:07:59.848423 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:59.848426 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:59.848443 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:59.848518 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:07:59.848843 (+ 325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:59.850028 (+ 1185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:59.852585 (+ 2557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:59.853422 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:59.853514 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:59.853550 (+ 36us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:59.853675 (+ 125us) server_negotiation.cc:299] Negotiation successful
0811 05:07:59.853711 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":158,"thread_start_us":94,"threads_started":1}
I20260811 05:07:59.853790 2307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:59.847729 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.193:40231 (local address 127.0.0.1:41958)
0811 05:07:59.848218 (+ 489us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:59.848228 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:59.848288 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:59.848623 (+ 335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:59.848624 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:59.848626 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:07:59.848680 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:59.848684 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:59.850131 (+ 1447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:59.850131 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:59.852458 (+ 2327us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:59.852461 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:59.853515 (+ 1054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:59.853516 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:59.853581 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:59.853585 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 05:07:59.853652 (+ 67us) client_negotiation.cc:240] Negotiation successful
0811 05:07:59.853696 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":468,"mutex_wait_us":1045,"spinlock_wait_cycles":768,"thread_start_us":133,"threads_started":1}
I20260811 05:07:59.853927 2169 tablet_service.cc:1467] Processing CreateTablet for tablet 6852addbe1a5433cb6d87924511007bc (DEFAULT_TABLE table=test-table [id=ff25ba5e39c54357abef38d6320057cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:07:59.854398 2169 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6852addbe1a5433cb6d87924511007bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:07:59.857336 2314 tablet_bootstrap.cc:492] T 6852addbe1a5433cb6d87924511007bc P ebf96a6f404d48c894096defa759926a: Bootstrap starting.
I20260811 05:07:59.857352 1707 tablet_service.cc:1467] Processing CreateTablet for tablet 6852addbe1a5433cb6d87924511007bc (DEFAULT_TABLE table=test-table [id=ff25ba5e39c54357abef38d6320057cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:07:59.857753 1707 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6852addbe1a5433cb6d87924511007bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:07:59.858117 2314 tablet_bootstrap.cc:654] T 6852addbe1a5433cb6d87924511007bc P ebf96a6f404d48c894096defa759926a: Neither blocks nor log segments found. Creating new log.
I20260811 05:07:59.858879 2314 log.cc:824] T 6852addbe1a5433cb6d87924511007bc P ebf96a6f404d48c894096defa759926a: Log is configured to *not* fsync() on all Append() calls
I20260811 05:07:59.859839 2314 tablet_bootstrap.cc:492] T 6852addbe1a5433cb6d87924511007bc P ebf96a6f404d48c894096defa759926a: No bootstrap required, opened a new log
I20260811 05:07:59.859916 2314 ts_tablet_manager.cc:1397] T 6852addbe1a5433cb6d87924511007bc P ebf96a6f404d48c894096defa759926a: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 05:07:59.861171 2306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:59.847729 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.194:43347 (local address 127.0.0.1:56064)
0811 05:07:59.848027 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:59.848072 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:59.848348 (+ 276us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:59.848597 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:59.848601 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:59.848603 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:07:59.848672 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:59.848673 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:59.850148 (+ 1475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:59.850149 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:59.852117 (+ 1968us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:59.852118 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:59.853353 (+ 1235us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:59.853354 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:59.860896 (+ 7542us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:59.860902 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 05:07:59.861003 (+ 101us) client_negotiation.cc:240] Negotiation successful
0811 05:07:59.861068 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":268,"mutex_wait_us":1103,"thread_start_us":70,"threads_started":1}
I20260811 05:07:59.861191 2313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:59.848051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56064 (local address 127.26.191.194:43347)
0811 05:07:59.848301 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:59.848304 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:59.848317 (+ 13us) server_negotiation.cc:407] Connection header received
0811 05:07:59.848455 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:59.848457 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:59.848474 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:59.848551 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:07:59.848809 (+ 258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:59.850005 (+ 1196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:59.852214 (+ 2209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:59.853145 (+ 931us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:59.853243 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:59.853312 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:59.861039 (+ 7727us) server_negotiation.cc:299] Negotiation successful
0811 05:07:59.861103 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":222,"thread_start_us":130,"threads_started":1}
I20260811 05:07:59.861809 2317 tablet_bootstrap.cc:492] T 6852addbe1a5433cb6d87924511007bc P 45a404de691c41dab768eb3773ac0583: Bootstrap starting.
I20260811 05:07:59.862066 2314 raft_consensus.cc:348] T 6852addbe1a5433cb6d87924511007bc P ebf96a6f404d48c894096defa759926a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45a404de691c41dab768eb3773ac0583" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 40231 } } peers { permanent_uuid: "ebf96a6f404d48c894096defa759926a" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 35679 } } peers { permanent_uuid: "cadc0dbf044a4e92953fb9c9bb4e1f3b" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 43347 } }
I20260811 05:07:59.862243 2314 raft_consensus.cc:374] T 6852addbe1a5433cb6d87924511007bc P ebf96a6f404d48c894096defa759926a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:07:59.862283 2314 raft_consensus.cc:729] T 6852addbe1a5433cb6d87924511007bc P ebf96a6f404d48c894096defa759926a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebf96a6f404d48c894096defa759926a, State: Initialized, Role: FOLLOWER
I20260811 05:07:59.862336 1930 tablet_service.cc:1467] Processing CreateTablet for tablet 6852addbe1a5433cb6d87924511007bc (DEFAULT_TABLE table=test-table [id=ff25ba5e39c54357abef38d6320057cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:07:59.862457 2314 consensus_queue.cc:260] T 6852addbe1a5433cb6d87924511007bc P ebf96a6f404d48c894096defa759926a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45a404de691c41dab768eb3773ac0583" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 40231 } } peers { permanent_uuid: "ebf96a6f404d48c894096defa759926a" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 35679 } } peers { permanent_uuid: "cadc0dbf044a4e92953fb9c9bb4e1f3b" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 43347 } }
I20260811 05:07:59.862557 2317 tablet_bootstrap.cc:654] T 6852addbe1a5433cb6d87924511007bc P 45a404de691c41dab768eb3773ac0583: Neither blocks nor log segments found. Creating new log.
I20260811 05:07:59.862709 1930 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6852addbe1a5433cb6d87924511007bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:07:59.862769 2314 ts_tablet_manager.cc:1428] T 6852addbe1a5433cb6d87924511007bc P ebf96a6f404d48c894096defa759926a: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 05:07:59.862818 2285 heartbeater.cc:503] Master 127.26.191.254:37979 was elected leader, sending a full tablet report...
I20260811 05:07:59.863404 2317 log.cc:824] T 6852addbe1a5433cb6d87924511007bc P 45a404de691c41dab768eb3773ac0583: Log is configured to *not* fsync() on all Append() calls
I20260811 05:07:59.864682 2317 tablet_bootstrap.cc:492] T 6852addbe1a5433cb6d87924511007bc P 45a404de691c41dab768eb3773ac0583: No bootstrap required, opened a new log
I20260811 05:07:59.864814 2317 ts_tablet_manager.cc:1397] T 6852addbe1a5433cb6d87924511007bc P 45a404de691c41dab768eb3773ac0583: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 05:07:59.865660 2322 tablet_bootstrap.cc:492] T 6852addbe1a5433cb6d87924511007bc P cadc0dbf044a4e92953fb9c9bb4e1f3b: Bootstrap starting.
I20260811 05:07:59.866429 2322 tablet_bootstrap.cc:654] T 6852addbe1a5433cb6d87924511007bc P cadc0dbf044a4e92953fb9c9bb4e1f3b: Neither blocks nor log segments found. Creating new log.
I20260811 05:07:59.867165 2322 log.cc:824] T 6852addbe1a5433cb6d87924511007bc P cadc0dbf044a4e92953fb9c9bb4e1f3b: Log is configured to *not* fsync() on all Append() calls
I20260811 05:07:59.867035 2317 raft_consensus.cc:348] T 6852addbe1a5433cb6d87924511007bc P 45a404de691c41dab768eb3773ac0583 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45a404de691c41dab768eb3773ac0583" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 40231 } } peers { permanent_uuid: "ebf96a6f404d48c894096defa759926a" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 35679 } } peers { permanent_uuid: "cadc0dbf044a4e92953fb9c9bb4e1f3b" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 43347 } }
I20260811 05:07:59.867249 2317 raft_consensus.cc:374] T 6852addbe1a5433cb6d87924511007bc P 45a404de691c41dab768eb3773ac0583 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:07:59.867314 2317 raft_consensus.cc:729] T 6852addbe1a5433cb6d87924511007bc P 45a404de691c41dab768eb3773ac0583 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45a404de691c41dab768eb3773ac0583, State: Initialized, Role: FOLLOWER
I20260811 05:07:59.867470 2317 consensus_queue.cc:260] T 6852addbe1a5433cb6d87924511007bc P 45a404de691c41dab768eb3773ac0583 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45a404de691c41dab768eb3773ac0583" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 40231 } } peers { permanent_uuid: "ebf96a6f404d48c894096defa759926a" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 35679 } } peers { permanent_uuid: "cadc0dbf044a4e92953fb9c9bb4e1f3b" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 43347 } }
I20260811 05:07:59.867799 2317 ts_tablet_manager.cc:1428] T 6852addbe1a5433cb6d87924511007bc P 45a404de691c41dab768eb3773ac0583: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 05:07:59.867831 1815 heartbeater.cc:503] Master 127.26.191.254:37979 was elected leader, sending a full tablet report...
I20260811 05:07:59.868219 2322 tablet_bootstrap.cc:492] T 6852addbe1a5433cb6d87924511007bc P cadc0dbf044a4e92953fb9c9bb4e1f3b: No bootstrap required, opened a new log
I20260811 05:07:59.868302 2322 ts_tablet_manager.cc:1397] T 6852addbe1a5433cb6d87924511007bc P cadc0dbf044a4e92953fb9c9bb4e1f3b: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 05:07:59.870326 2322 raft_consensus.cc:348] T 6852addbe1a5433cb6d87924511007bc P cadc0dbf044a4e92953fb9c9bb4e1f3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45a404de691c41dab768eb3773ac0583" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 40231 } } peers { permanent_uuid: "ebf96a6f404d48c894096defa759926a" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 35679 } } peers { permanent_uuid: "cadc0dbf044a4e92953fb9c9bb4e1f3b" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 43347 } }
I20260811 05:07:59.870468 2322 raft_consensus.cc:374] T 6852addbe1a5433cb6d87924511007bc P cadc0dbf044a4e92953fb9c9bb4e1f3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:07:59.870493 2322 raft_consensus.cc:729] T 6852addbe1a5433cb6d87924511007bc P cadc0dbf044a4e92953fb9c9bb4e1f3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cadc0dbf044a4e92953fb9c9bb4e1f3b, State: Initialized, Role: FOLLOWER
I20260811 05:07:59.870652 2322 consensus_queue.cc:260] T 6852addbe1a5433cb6d87924511007bc P cadc0dbf044a4e92953fb9c9bb4e1f3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45a404de691c41dab768eb3773ac0583" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 40231 } } peers { permanent_uuid: "ebf96a6f404d48c894096defa759926a" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 35679 } } peers { permanent_uuid: "cadc0dbf044a4e92953fb9c9bb4e1f3b" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 43347 } }
I20260811 05:07:59.870991 2322 ts_tablet_manager.cc:1428] T 6852addbe1a5433cb6d87924511007bc P cadc0dbf044a4e92953fb9c9bb4e1f3b: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 05:07:59.871007 2043 heartbeater.cc:503] Master 127.26.191.254:37979 was elected leader, sending a full tablet report...
W20260811 05:07:59.889976 2046 tablet.cc:2369] T 6852addbe1a5433cb6d87924511007bc P cadc0dbf044a4e92953fb9c9bb4e1f3b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 05:07:59.916805 2318 raft_consensus.cc:482] T 6852addbe1a5433cb6d87924511007bc P ebf96a6f404d48c894096defa759926a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 05:07:59.916949 2318 raft_consensus.cc:504] T 6852addbe1a5433cb6d87924511007bc P ebf96a6f404d48c894096defa759926a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45a404de691c41dab768eb3773ac0583" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 40231 } } peers { permanent_uuid: "ebf96a6f404d48c894096defa759926a" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 35679 } } peers { permanent_uuid: "cadc0dbf044a4e92953fb9c9bb4e1f3b" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 43347 } }
I20260811 05:07:59.917330 2318 leader_election.cc:288] T 6852addbe1a5433cb6d87924511007bc P ebf96a6f404d48c894096defa759926a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45a404de691c41dab768eb3773ac0583 (127.26.191.193:40231), cadc0dbf044a4e92953fb9c9bb4e1f3b (127.26.191.194:43347)
I20260811 05:07:59.922008 2287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:59.917516 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.193:40231 (local address 127.26.191.195:50451)
0811 05:07:59.917602 (+ 86us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:59.917614 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:59.917665 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:59.917937 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:59.917938 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:59.917940 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:07:59.918029 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:59.918031 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:59.919141 (+ 1110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:59.919142 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:59.920758 (+ 1616us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:59.920761 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:59.921674 (+ 913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:59.921675 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:59.921770 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:59.921772 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 05:07:59.921864 (+ 92us) client_negotiation.cc:240] Negotiation successful
0811 05:07:59.921902 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":64,"mutex_wait_us":109}
I20260811 05:07:59.922008 2313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:59.917648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.195:54285 (local address 127.26.191.194:43347)
0811 05:07:59.917732 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:59.917734 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:59.917867 (+ 133us) server_negotiation.cc:407] Connection header received
0811 05:07:59.917998 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:59.917999 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:59.918010 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:59.918059 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:07:59.918247 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:59.919023 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:59.920872 (+ 1849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:59.921565 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:59.921637 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:59.921647 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:59.921877 (+ 230us) server_negotiation.cc:299] Negotiation successful
0811 05:07:59.921931 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 05:07:59.922086 2311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:59.917622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.195:50451 (local address 127.26.191.193:40231)
0811 05:07:59.917679 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:59.917681 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:59.917693 (+ 12us) server_negotiation.cc:407] Connection header received
0811 05:07:59.917731 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:59.917732 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:59.917780 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:59.917913 (+ 133us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:07:59.918153 (+ 240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:59.919022 (+ 869us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:59.920872 (+ 1850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:59.921541 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:59.921637 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:59.921647 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:59.921959 (+ 312us) server_negotiation.cc:299] Negotiation successful
0811 05:07:59.922008 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260811 05:07:59.922169 2330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:59.917567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.194:43347 (local address 127.26.191.195:54285)
0811 05:07:59.917778 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:59.917788 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:59.917897 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:59.918087 (+ 190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:59.918088 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:59.918090 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:07:59.918158 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:59.918159 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:59.919141 (+ 982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:59.919142 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:59.920758 (+ 1616us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:59.920761 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:59.921674 (+ 913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:59.921675 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:59.921766 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:59.921772 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 05:07:59.921852 (+ 80us) client_negotiation.cc:240] Negotiation successful
0811 05:07:59.921902 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":192,"mutex_wait_us":79,"thread_start_us":130,"threads_started":1}
I20260811 05:07:59.922487 1966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6852addbe1a5433cb6d87924511007bc" candidate_uuid: "ebf96a6f404d48c894096defa759926a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cadc0dbf044a4e92953fb9c9bb4e1f3b" is_pre_election: true
I20260811 05:07:59.922487 1748 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6852addbe1a5433cb6d87924511007bc" candidate_uuid: "ebf96a6f404d48c894096defa759926a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45a404de691c41dab768eb3773ac0583" is_pre_election: true
I20260811 05:07:59.922657 1966 raft_consensus.cc:2454] T 6852addbe1a5433cb6d87924511007bc P cadc0dbf044a4e92953fb9c9bb4e1f3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ebf96a6f404d48c894096defa759926a in term 0.
I20260811 05:07:59.922657 1748 raft_consensus.cc:2454] T 6852addbe1a5433cb6d87924511007bc P 45a404de691c41dab768eb3773ac0583 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ebf96a6f404d48c894096defa759926a in term 0.
I20260811 05:07:59.922936 2088 leader_election.cc:302] T 6852addbe1a5433cb6d87924511007bc P ebf96a6f404d48c894096defa759926a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45a404de691c41dab768eb3773ac0583, ebf96a6f404d48c894096defa759926a; no voters:
I20260811 05:07:59.923143 2318 raft_consensus.cc:2781] T 6852addbe1a5433cb6d87924511007bc P ebf96a6f404d48c894096defa759926a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 05:07:59.923290 2318 raft_consensus.cc:482] T 6852addbe1a5433cb6d87924511007bc P ebf96a6f404d48c894096defa759926a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 05:07:59.923336 2318 raft_consensus.cc:3037] T 6852addbe1a5433cb6d87924511007bc P ebf96a6f404d48c894096defa759926a [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:07:59.924147 2318 raft_consensus.cc:504] T 6852addbe1a5433cb6d87924511007bc P ebf96a6f404d48c894096defa759926a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45a404de691c41dab768eb3773ac0583" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 40231 } } peers { permanent_uuid: "ebf96a6f404d48c894096defa759926a" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 35679 } } peers { permanent_uuid: "cadc0dbf044a4e92953fb9c9bb4e1f3b" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 43347 } }
I20260811 05:07:59.924335 2318 leader_election.cc:288] T 6852addbe1a5433cb6d87924511007bc P ebf96a6f404d48c894096defa759926a [CANDIDATE]: Term 1 election: Requested vote from peers 45a404de691c41dab768eb3773ac0583 (127.26.191.193:40231), cadc0dbf044a4e92953fb9c9bb4e1f3b (127.26.191.194:43347)
I20260811 05:07:59.924527 1966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6852addbe1a5433cb6d87924511007bc" candidate_uuid: "ebf96a6f404d48c894096defa759926a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cadc0dbf044a4e92953fb9c9bb4e1f3b"
I20260811 05:07:59.924541 1748 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6852addbe1a5433cb6d87924511007bc" candidate_uuid: "ebf96a6f404d48c894096defa759926a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45a404de691c41dab768eb3773ac0583"
I20260811 05:07:59.924626 1966 raft_consensus.cc:3037] T 6852addbe1a5433cb6d87924511007bc P cadc0dbf044a4e92953fb9c9bb4e1f3b [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:07:59.924641 1748 raft_consensus.cc:3037] T 6852addbe1a5433cb6d87924511007bc P 45a404de691c41dab768eb3773ac0583 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:07:59.925693 1966 raft_consensus.cc:2454] T 6852addbe1a5433cb6d87924511007bc P cadc0dbf044a4e92953fb9c9bb4e1f3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ebf96a6f404d48c894096defa759926a in term 1.
I20260811 05:07:59.925704 1748 raft_consensus.cc:2454] T 6852addbe1a5433cb6d87924511007bc P 45a404de691c41dab768eb3773ac0583 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ebf96a6f404d48c894096defa759926a in term 1.
I20260811 05:07:59.925925 2088 leader_election.cc:302] T 6852addbe1a5433cb6d87924511007bc P ebf96a6f404d48c894096defa759926a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45a404de691c41dab768eb3773ac0583, ebf96a6f404d48c894096defa759926a; no voters:
I20260811 05:07:59.926033 2318 raft_consensus.cc:2781] T 6852addbe1a5433cb6d87924511007bc P ebf96a6f404d48c894096defa759926a [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:07:59.926245 2318 raft_consensus.cc:686] T 6852addbe1a5433cb6d87924511007bc P ebf96a6f404d48c894096defa759926a [term 1 LEADER]: Becoming Leader. State: Replica: ebf96a6f404d48c894096defa759926a, State: Running, Role: LEADER
I20260811 05:07:59.926337 2318 consensus_queue.cc:237] T 6852addbe1a5433cb6d87924511007bc P ebf96a6f404d48c894096defa759926a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45a404de691c41dab768eb3773ac0583" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 40231 } } peers { permanent_uuid: "ebf96a6f404d48c894096defa759926a" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 35679 } } peers { permanent_uuid: "cadc0dbf044a4e92953fb9c9bb4e1f3b" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 43347 } }
I20260811 05:07:59.927300 1505 catalog_manager.cc:5495] T 6852addbe1a5433cb6d87924511007bc P ebf96a6f404d48c894096defa759926a reported cstate change: term changed from 0 to 1, leader changed from <none> to ebf96a6f404d48c894096defa759926a (127.26.191.195). New cstate: current_term: 1 leader_uuid: "ebf96a6f404d48c894096defa759926a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45a404de691c41dab768eb3773ac0583" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 40231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ebf96a6f404d48c894096defa759926a" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 35679 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cadc0dbf044a4e92953fb9c9bb4e1f3b" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 43347 } health_report { overall_health: UNKNOWN } } }
I20260811 05:07:59.946012 2309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:59.943397 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60216 (local address 127.26.191.195:35679)
0811 05:07:59.943472 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:59.943474 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:59.943483 (+ 9us) server_negotiation.cc:407] Connection header received
0811 05:07:59.943520 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:59.943521 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:59.943540 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:59.943611 (+ 71us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:07:59.943820 (+ 209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:59.944301 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:59.945153 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:59.945387 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:59.945465 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:59.945641 (+ 176us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:07:59.945781 (+ 140us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:07:59.945856 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:59.945914 (+ 58us) server_negotiation.cc:299] Negotiation successful
0811 05:07:59.945944 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 05:07:59.948230 1966 raft_consensus.cc:1261] T 6852addbe1a5433cb6d87924511007bc P cadc0dbf044a4e92953fb9c9bb4e1f3b [term 1 FOLLOWER]: Refusing update from remote peer ebf96a6f404d48c894096defa759926a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:07:59.948230 1748 raft_consensus.cc:1261] T 6852addbe1a5433cb6d87924511007bc P 45a404de691c41dab768eb3773ac0583 [term 1 FOLLOWER]: Refusing update from remote peer ebf96a6f404d48c894096defa759926a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:07:59.948746 2318 consensus_queue.cc:1035] T 6852addbe1a5433cb6d87924511007bc P ebf96a6f404d48c894096defa759926a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cadc0dbf044a4e92953fb9c9bb4e1f3b" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 43347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:07:59.948920 2331 consensus_queue.cc:1035] T 6852addbe1a5433cb6d87924511007bc P ebf96a6f404d48c894096defa759926a [LEADER]: Connected to new peer: Peer: permanent_uuid: "45a404de691c41dab768eb3773ac0583" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 40231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:07:59.952944 2337 mvcc.cc:205] Tried to move back new op lower bound from 7317196308264988672 to 7317196308179374080. Current Snapshot: MvccSnapshot[applied={T|T < 7317196308264988672 or (T in {7317196308264988672})}]
I20260811 05:07:59.953186 2339 mvcc.cc:205] Tried to move back new op lower bound from 7317196308264988672 to 7317196308179374080. Current Snapshot: MvccSnapshot[applied={T|T < 7317196308264988672 or (T in {7317196308264988672})}]
I20260811 05:07:59.954469 1505 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44678:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:07:59.954582 1505 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44678:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:07:59.955428 1505 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f571ef974bc84b61a7d53674c8799744: Sending DeleteTablet for 3 replicas of tablet 6852addbe1a5433cb6d87924511007bc
I20260811 05:07:59.955906 1707 tablet_service.cc:1514] Processing DeleteTablet for tablet 6852addbe1a5433cb6d87924511007bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:07:59 UTC) from {username='kudu', principal='kudu/127.26.191.254@KRBTEST.COM'} at 127.0.0.1:41958
I20260811 05:07:59.956334 2348 tablet_replica.cc:330] T 6852addbe1a5433cb6d87924511007bc P 45a404de691c41dab768eb3773ac0583: stopping tablet replica
I20260811 05:07:59.956332 2169 tablet_service.cc:1514] Processing DeleteTablet for tablet 6852addbe1a5433cb6d87924511007bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:07:59 UTC) from {username='kudu', principal='kudu/127.26.191.254@KRBTEST.COM'} at 127.0.0.1:60202
I20260811 05:07:59.956583 2348 raft_consensus.cc:2229] T 6852addbe1a5433cb6d87924511007bc P 45a404de691c41dab768eb3773ac0583 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 05:07:59.956794 2348 raft_consensus.cc:2258] T 6852addbe1a5433cb6d87924511007bc P 45a404de691c41dab768eb3773ac0583 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:07:59.957461 2348 ts_tablet_manager.cc:1905] T 6852addbe1a5433cb6d87924511007bc P 45a404de691c41dab768eb3773ac0583: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:07:59.959484 2348 ts_tablet_manager.cc:1918] T 6852addbe1a5433cb6d87924511007bc P 45a404de691c41dab768eb3773ac0583: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 05:07:59.959576 2348 log.cc:1196] T 6852addbe1a5433cb6d87924511007bc P 45a404de691c41dab768eb3773ac0583: Deleting WAL directory at /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/minicluster-data/ts-0/wal/wals/6852addbe1a5433cb6d87924511007bc
I20260811 05:07:59.959887 2348 ts_tablet_manager.cc:1939] T 6852addbe1a5433cb6d87924511007bc P 45a404de691c41dab768eb3773ac0583: Deleting consensus metadata
I20260811 05:07:59.960558 1487 catalog_manager.cc:4841] TS 45a404de691c41dab768eb3773ac0583 (127.26.191.193:40231): tablet 6852addbe1a5433cb6d87924511007bc (table test-table [id=ff25ba5e39c54357abef38d6320057cd]) successfully deleted
I20260811 05:07:59.961603 1930 tablet_service.cc:1514] Processing DeleteTablet for tablet 6852addbe1a5433cb6d87924511007bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:07:59 UTC) from {username='kudu', principal='kudu/127.26.191.254@KRBTEST.COM'} at 127.0.0.1:56064
I20260811 05:07:59.961808 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 1606
I20260811 05:07:59.973448 2350 tablet_replica.cc:330] T 6852addbe1a5433cb6d87924511007bc P cadc0dbf044a4e92953fb9c9bb4e1f3b: stopping tablet replica
I20260811 05:07:59.973661 2350 raft_consensus.cc:2229] T 6852addbe1a5433cb6d87924511007bc P cadc0dbf044a4e92953fb9c9bb4e1f3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 05:07:59.973824 2350 raft_consensus.cc:2258] T 6852addbe1a5433cb6d87924511007bc P cadc0dbf044a4e92953fb9c9bb4e1f3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:07:59.975684 2350 ts_tablet_manager.cc:1905] T 6852addbe1a5433cb6d87924511007bc P cadc0dbf044a4e92953fb9c9bb4e1f3b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:07:59.977953 2350 ts_tablet_manager.cc:1918] T 6852addbe1a5433cb6d87924511007bc P cadc0dbf044a4e92953fb9c9bb4e1f3b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 05:07:59.978057 2350 log.cc:1196] T 6852addbe1a5433cb6d87924511007bc P cadc0dbf044a4e92953fb9c9bb4e1f3b: Deleting WAL directory at /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/minicluster-data/ts-1/wal/wals/6852addbe1a5433cb6d87924511007bc
I20260811 05:07:59.978376 2350 ts_tablet_manager.cc:1939] T 6852addbe1a5433cb6d87924511007bc P cadc0dbf044a4e92953fb9c9bb4e1f3b: Deleting consensus metadata
I20260811 05:07:59.978510 2349 tablet_replica.cc:330] T 6852addbe1a5433cb6d87924511007bc P ebf96a6f404d48c894096defa759926a: stopping tablet replica
I20260811 05:07:59.978688 2349 raft_consensus.cc:2229] T 6852addbe1a5433cb6d87924511007bc P ebf96a6f404d48c894096defa759926a [term 1 LEADER]: Raft consensus shutting down.
I20260811 05:07:59.978844 2349 raft_consensus.cc:2258] T 6852addbe1a5433cb6d87924511007bc P ebf96a6f404d48c894096defa759926a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:07:59.978951 1484 catalog_manager.cc:4841] TS cadc0dbf044a4e92953fb9c9bb4e1f3b (127.26.191.194:43347): tablet 6852addbe1a5433cb6d87924511007bc (table test-table [id=ff25ba5e39c54357abef38d6320057cd]) successfully deleted
I20260811 05:07:59.985194 2349 ts_tablet_manager.cc:1905] T 6852addbe1a5433cb6d87924511007bc P ebf96a6f404d48c894096defa759926a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:07:59.987432 2349 ts_tablet_manager.cc:1918] T 6852addbe1a5433cb6d87924511007bc P ebf96a6f404d48c894096defa759926a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 05:07:59.987571 2349 log.cc:1196] T 6852addbe1a5433cb6d87924511007bc P ebf96a6f404d48c894096defa759926a: Deleting WAL directory at /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424853995437-27391-0/minicluster-data/ts-2/wal/wals/6852addbe1a5433cb6d87924511007bc
I20260811 05:07:59.987874 2349 ts_tablet_manager.cc:1939] T 6852addbe1a5433cb6d87924511007bc P ebf96a6f404d48c894096defa759926a: Deleting consensus metadata
I20260811 05:07:59.988432 1486 catalog_manager.cc:4841] TS ebf96a6f404d48c894096defa759926a (127.26.191.195:35679): tablet 6852addbe1a5433cb6d87924511007bc (table test-table [id=ff25ba5e39c54357abef38d6320057cd]) successfully deleted
I20260811 05:07:59.989370 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 1826
I20260811 05:08:00.018642 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 2053
I20260811 05:08:00.031507 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 1458
2026-08-11T05:08:00Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (2360 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-11T05:08:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:08:00Z Disabled control of system clock
I20260811 05:08:00.075153 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424853995437-27391-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424853995437-27391-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424853995437-27391-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.254:46119
--webserver_interface=127.26.191.254
--webserver_port=0
--builtin_ntp_servers=127.26.191.212:34967
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.191.254:46119
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260811 05:08:00.165169 2357 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:08:00.165449 2357 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:08:00.165490 2357 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:08:00.166697 2357 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:08:00.166740 2357 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:08:00.166754 2357 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:08:00.166766 2357 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:08:00.166778 2357 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:08:00.168223 2357 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:34967
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424853995437-27391-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424853995437-27391-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.191.254:46119
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.254:46119
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.191.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2357
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424853995437-27391-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:08:00.168440 2357 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:08:00.168689 2357 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:08:00.174119 2366 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:00.174129 2368 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:00.174291 2370 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:08:00.174408 2357 server_base.cc:1034] running on GCE node
I20260811 05:08:00.174826 2357 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:08:00.175171 2357 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:08:00.176388 2357 hybrid_clock.cc:648] HybridClock initialized: now 1786424880176364 us; error 43 us; skew 500 ppm
I20260811 05:08:00.177919 2357 webserver.cc:460] Webserver started at http://127.26.191.254:36929/ using document root <none> and password file <none>
I20260811 05:08:00.178205 2357 fs_manager.cc:359] Metadata directory not provided
I20260811 05:08:00.178277 2357 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:08:00.178442 2357 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:08:00.179567 2357 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424853995437-27391-0/minicluster-data/master-0/data/instance:
uuid: "74e360032e0b40e7a6ce87b0fcd4e888"
format_stamp: "Formatted at 2026-08-11 05:08:00 on dist-test-slave-x5fp"
server_key: "206e4aa9efe57b774740c070448cb842"
server_key_iv: "0c6f33d6524bb8aa659ccf6f9a5bbe61"
server_key_version: "encryptionkey@0"
I20260811 05:08:00.179955 2357 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424853995437-27391-0/minicluster-data/master-0/wal/instance:
uuid: "74e360032e0b40e7a6ce87b0fcd4e888"
format_stamp: "Formatted at 2026-08-11 05:08:00 on dist-test-slave-x5fp"
server_key: "206e4aa9efe57b774740c070448cb842"
server_key_iv: "0c6f33d6524bb8aa659ccf6f9a5bbe61"
server_key_version: "encryptionkey@0"
I20260811 05:08:00.181442 2357 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 05:08:00.182369 2377 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:00.182601 2357 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:08:00.182704 2357 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424853995437-27391-0/minicluster-data/master-0/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424853995437-27391-0/minicluster-data/master-0/wal
uuid: "74e360032e0b40e7a6ce87b0fcd4e888"
format_stamp: "Formatted at 2026-08-11 05:08:00 on dist-test-slave-x5fp"
server_key: "206e4aa9efe57b774740c070448cb842"
server_key_iv: "0c6f33d6524bb8aa659ccf6f9a5bbe61"
server_key_version: "encryptionkey@0"
I20260811 05:08:00.182824 2357 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424853995437-27391-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424853995437-27391-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424853995437-27391-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:08:00.186403 2357 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:08:00.186692 2357 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:08:00.186846 2357 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:08:00.191185 2357 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.254:46119
I20260811 05:08:00.191222 2457 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.254:46119 every 8 connection(s)
I20260811 05:08:00.191605 2357 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
I20260811 05:08:00.192401 2458 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:08:00.195544 2458 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 74e360032e0b40e7a6ce87b0fcd4e888: Bootstrap starting.
I20260811 05:08:00.196197 2458 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 74e360032e0b40e7a6ce87b0fcd4e888: Neither blocks nor log segments found. Creating new log.
I20260811 05:08:00.196517 2458 log.cc:824] T 00000000000000000000000000000000 P 74e360032e0b40e7a6ce87b0fcd4e888: Log is configured to *not* fsync() on all Append() calls
I20260811 05:08:00.197404 2458 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 74e360032e0b40e7a6ce87b0fcd4e888: No bootstrap required, opened a new log
I20260811 05:08:00.199276 2458 raft_consensus.cc:348] T 00000000000000000000000000000000 P 74e360032e0b40e7a6ce87b0fcd4e888 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74e360032e0b40e7a6ce87b0fcd4e888" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 46119 } }
I20260811 05:08:00.199437 2458 raft_consensus.cc:374] T 00000000000000000000000000000000 P 74e360032e0b40e7a6ce87b0fcd4e888 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:08:00.199462 2458 raft_consensus.cc:729] T 00000000000000000000000000000000 P 74e360032e0b40e7a6ce87b0fcd4e888 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74e360032e0b40e7a6ce87b0fcd4e888, State: Initialized, Role: FOLLOWER
I20260811 05:08:00.199635 2458 consensus_queue.cc:260] T 00000000000000000000000000000000 P 74e360032e0b40e7a6ce87b0fcd4e888 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74e360032e0b40e7a6ce87b0fcd4e888" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 46119 } }
I20260811 05:08:00.199702 2458 raft_consensus.cc:388] T 00000000000000000000000000000000 P 74e360032e0b40e7a6ce87b0fcd4e888 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:08:00.199723 2458 raft_consensus.cc:482] T 00000000000000000000000000000000 P 74e360032e0b40e7a6ce87b0fcd4e888 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:08:00.199753 2458 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 74e360032e0b40e7a6ce87b0fcd4e888 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:08:00.200356 2458 raft_consensus.cc:504] T 00000000000000000000000000000000 P 74e360032e0b40e7a6ce87b0fcd4e888 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74e360032e0b40e7a6ce87b0fcd4e888" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 46119 } }
I20260811 05:08:00.200474 2458 leader_election.cc:302] T 00000000000000000000000000000000 P 74e360032e0b40e7a6ce87b0fcd4e888 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 74e360032e0b40e7a6ce87b0fcd4e888; no voters:
I20260811 05:08:00.200670 2458 leader_election.cc:288] T 00000000000000000000000000000000 P 74e360032e0b40e7a6ce87b0fcd4e888 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 05:08:00.200851 2461 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 74e360032e0b40e7a6ce87b0fcd4e888 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:08:00.201049 2461 raft_consensus.cc:686] T 00000000000000000000000000000000 P 74e360032e0b40e7a6ce87b0fcd4e888 [term 1 LEADER]: Becoming Leader. State: Replica: 74e360032e0b40e7a6ce87b0fcd4e888, State: Running, Role: LEADER
I20260811 05:08:00.201122 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 2357
I20260811 05:08:00.201239 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424853995437-27391-0/minicluster-data/master-0/wal/instance
I20260811 05:08:00.201234 2461 consensus_queue.cc:237] T 00000000000000000000000000000000 P 74e360032e0b40e7a6ce87b0fcd4e888 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74e360032e0b40e7a6ce87b0fcd4e888" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 46119 } }
I20260811 05:08:00.201436 27391 external_mini_cluster.cc:1428] Setting key 0a446083c5cf515d6d6aea5a6ea69268
I20260811 05:08:00.201720 2458 sys_catalog.cc:564] T 00000000000000000000000000000000 P 74e360032e0b40e7a6ce87b0fcd4e888 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:08:00.202694 2463 sys_catalog.cc:455] T 00000000000000000000000000000000 P 74e360032e0b40e7a6ce87b0fcd4e888 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 74e360032e0b40e7a6ce87b0fcd4e888. Latest consensus state: current_term: 1 leader_uuid: "74e360032e0b40e7a6ce87b0fcd4e888" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74e360032e0b40e7a6ce87b0fcd4e888" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 46119 } } }
I20260811 05:08:00.202795 2463 sys_catalog.cc:458] T 00000000000000000000000000000000 P 74e360032e0b40e7a6ce87b0fcd4e888 [sys.catalog]: This master's current role is: LEADER
I20260811 05:08:00.203020 2462 sys_catalog.cc:455] T 00000000000000000000000000000000 P 74e360032e0b40e7a6ce87b0fcd4e888 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "74e360032e0b40e7a6ce87b0fcd4e888" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74e360032e0b40e7a6ce87b0fcd4e888" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 46119 } } }
I20260811 05:08:00.203089 2462 sys_catalog.cc:458] T 00000000000000000000000000000000 P 74e360032e0b40e7a6ce87b0fcd4e888 [sys.catalog]: This master's current role is: LEADER
I20260811 05:08:00.203233 2482 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:08:00.203805 2482 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:08:00.205289 2471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:00.202251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47880 (local address 127.26.191.254:46119)
0811 05:08:00.202774 (+ 523us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:00.202784 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:00.202823 (+ 39us) server_negotiation.cc:407] Connection header received
0811 05:08:00.202966 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:00.202976 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:00.203035 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:00.203543 (+ 508us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:00.204241 (+ 698us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:00.204245 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:00.204245 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:08:00.204250 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:00.204294 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:08:00.204309 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:00.204384 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:00.204577 (+ 193us) server_negotiation.cc:299] Negotiation successful
0811 05:08:00.204639 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":429,"thread_start_us":77,"threads_started":1}
I20260811 05:08:00.208845 2482 catalog_manager.cc:1347] Generated new cluster ID: be083d0fd3b94681a470cc5ca577830c
I20260811 05:08:00.208938 2482 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:08:00.230060 2482 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:08:00.230297 2482 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:08:00.242100 2482 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 74e360032e0b40e7a6ce87b0fcd4e888: Generated new TSK 0
I20260811 05:08:00.242358 2482 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 05:08:00.246938 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424853995437-27391-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424853995437-27391-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424853995437-27391-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424853995437-27391-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.191.193:0
--local_ip_for_outbound_sockets=127.26.191.193
--webserver_interface=127.26.191.193
--webserver_port=0
--tserver_master_addrs=127.26.191.254:46119
--builtin_ntp_servers=127.26.191.212:34967
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260811 05:08:00.367448 2500 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:08:00.367684 2500 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:08:00.367709 2500 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:08:00.369052 2500 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:08:00.369098 2500 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:08:00.369128 2500 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.191.193
I20260811 05:08:00.370718 2500 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:34967
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424853995437-27391-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424853995437-27391-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.191.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424853995437-27391-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.191.193
--webserver_port=0
--tserver_master_addrs=127.26.191.254:46119
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2500
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.191.193
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424853995437-27391-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:08:00.370991 2500 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:08:00.371316 2500 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:08:00.377667 2506 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:00.377676 2507 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:00.377678 2513 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:08:00.378245 2500 server_base.cc:1034] running on GCE node
I20260811 05:08:00.378482 2500 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:08:00.378784 2500 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:08:00.379961 2500 hybrid_clock.cc:648] HybridClock initialized: now 1786424880379947 us; error 34 us; skew 500 ppm
I20260811 05:08:00.381672 2500 webserver.cc:460] Webserver started at http://127.26.191.193:35239/ using document root <none> and password file <none>
I20260811 05:08:00.381979 2500 fs_manager.cc:359] Metadata directory not provided
I20260811 05:08:00.382043 2500 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:08:00.382187 2500 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:08:00.383369 2500 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424853995437-27391-0/minicluster-data/ts-0/data/instance:
uuid: "19b177a6d9b84631870362c0b773f245"
format_stamp: "Formatted at 2026-08-11 05:08:00 on dist-test-slave-x5fp"
server_key: "9f8fb056c6379fa4ca57bc34e7ac9985"
server_key_iv: "75d71d014f22cba92355b15904375365"
server_key_version: "encryptionkey@0"
I20260811 05:08:00.383790 2500 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424853995437-27391-0/minicluster-data/ts-0/wal/instance:
uuid: "19b177a6d9b84631870362c0b773f245"
format_stamp: "Formatted at 2026-08-11 05:08:00 on dist-test-slave-x5fp"
server_key: "9f8fb056c6379fa4ca57bc34e7ac9985"
server_key_iv: "75d71d014f22cba92355b15904375365"
server_key_version: "encryptionkey@0"
I20260811 05:08:00.385660 2500 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.004s sys 0.000s
I20260811 05:08:00.386818 2521 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:00.387320 2500 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:08:00.387470 2500 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424853995437-27391-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424853995437-27391-0/minicluster-data/ts-0/wal
uuid: "19b177a6d9b84631870362c0b773f245"
format_stamp: "Formatted at 2026-08-11 05:08:00 on dist-test-slave-x5fp"
server_key: "9f8fb056c6379fa4ca57bc34e7ac9985"
server_key_iv: "75d71d014f22cba92355b15904375365"
server_key_version: "encryptionkey@0"
I20260811 05:08:00.387567 2500 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424853995437-27391-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424853995437-27391-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424853995437-27391-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:08:00.391317 2500 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:08:00.391633 2500 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:08:00.391794 2500 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:08:00.392032 2500 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:08:00.392370 2500 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:08:00.392450 2500 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:00.392494 2500 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:08:00.392522 2500 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:00.399108 2500 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.193:46743
I20260811 05:08:00.399158 2688 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.193:46743 every 8 connection(s)
I20260811 05:08:00.399523 2500 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424853995437-27391-0/minicluster-data/ts-0/data/info.pb
I20260811 05:08:00.403595 2471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:00.400397 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.193:59499 (local address 127.26.191.254:46119)
0811 05:08:00.400472 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:00.400474 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:00.400691 (+ 217us) server_negotiation.cc:407] Connection header received
0811 05:08:00.401358 (+ 667us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:00.401359 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:00.401367 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:00.401445 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:00.403293 (+ 1848us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:00.403294 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:00.403295 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:08:00.403300 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:00.403320 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:08:00.403324 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:00.403397 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:00.403511 (+ 114us) server_negotiation.cc:299] Negotiation successful
0811 05:08:00.403530 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 05:08:00.403868 2692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:00.400341 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:46119 (local address 127.26.191.193:59499)
0811 05:08:00.400548 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:00.400592 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:00.401211 (+ 619us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:00.401599 (+ 388us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:00.401605 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:00.401618 (+ 13us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:00.403084 (+ 1466us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 05:08:00.403084 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:00.403118 (+ 34us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 05:08:00.403159 (+ 41us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:08:00.403402 (+ 243us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:08:00.403407 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:08:00.403410 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 05:08:00.403478 (+ 68us) client_negotiation.cc:240] Negotiation successful
0811 05:08:00.403543 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":102,"threads_started":1}
I20260811 05:08:00.404498 2689 heartbeater.cc:347] Connected to a master server at 127.26.191.254:46119
I20260811 05:08:00.404610 2689 heartbeater.cc:464] Registering TS with master...
I20260811 05:08:00.404796 2689 heartbeater.cc:511] Master 127.26.191.254:46119 requested a full tablet report, sending...
I20260811 05:08:00.404968 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 2500
I20260811 05:08:00.405071 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424853995437-27391-0/minicluster-data/ts-0/wal/instance
I20260811 05:08:00.405282 27391 external_mini_cluster.cc:1428] Setting key b5a59a7cec1db58ee07d961ecd86b3af
I20260811 05:08:00.405540 2405 ts_manager.cc:194] Registered new tserver with Master: 19b177a6d9b84631870362c0b773f245 (127.26.191.193:46743)
I20260811 05:08:00.406534 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424853995437-27391-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424853995437-27391-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424853995437-27391-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424853995437-27391-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.191.194:0
--local_ip_for_outbound_sockets=127.26.191.194
--webserver_interface=127.26.191.194
--webserver_port=0
--tserver_master_addrs=127.26.191.254:46119
--builtin_ntp_servers=127.26.191.212:34967
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260811 05:08:00.501442 2694 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:08:00.501662 2694 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:08:00.501685 2694 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:08:00.503087 2694 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:08:00.503135 2694 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:08:00.503162 2694 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.191.194
I20260811 05:08:00.504592 2694 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:34967
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424853995437-27391-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424853995437-27391-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.191.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424853995437-27391-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.191.194
--webserver_port=0
--tserver_master_addrs=127.26.191.254:46119
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2694
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.191.194
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424853995437-27391-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:08:00.504918 2694 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:08:00.505264 2694 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:08:00.510587 2705 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:00.510583 2703 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:00.510588 2701 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:08:00.510939 2694 server_base.cc:1034] running on GCE node
I20260811 05:08:00.511186 2694 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:08:00.511494 2694 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:08:00.512666 2694 hybrid_clock.cc:648] HybridClock initialized: now 1786424880512646 us; error 38 us; skew 500 ppm
I20260811 05:08:00.514112 2694 webserver.cc:460] Webserver started at http://127.26.191.194:32867/ using document root <none> and password file <none>
I20260811 05:08:00.514421 2694 fs_manager.cc:359] Metadata directory not provided
I20260811 05:08:00.514503 2694 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:08:00.514658 2694 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:08:00.515803 2694 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424853995437-27391-0/minicluster-data/ts-1/data/instance:
uuid: "9364b047ec9b41bf9009dfee4d6001a0"
format_stamp: "Formatted at 2026-08-11 05:08:00 on dist-test-slave-x5fp"
server_key: "c9942980ca5c30987e3b6707503f5ad3"
server_key_iv: "2b08efd8b30246f7bdd9e837cfe91d83"
server_key_version: "encryptionkey@0"
I20260811 05:08:00.516193 2694 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424853995437-27391-0/minicluster-data/ts-1/wal/instance:
uuid: "9364b047ec9b41bf9009dfee4d6001a0"
format_stamp: "Formatted at 2026-08-11 05:08:00 on dist-test-slave-x5fp"
server_key: "c9942980ca5c30987e3b6707503f5ad3"
server_key_iv: "2b08efd8b30246f7bdd9e837cfe91d83"
server_key_version: "encryptionkey@0"
I20260811 05:08:00.517791 2694 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 05:08:00.518774 2717 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:00.519024 2694 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:08:00.519143 2694 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424853995437-27391-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424853995437-27391-0/minicluster-data/ts-1/wal
uuid: "9364b047ec9b41bf9009dfee4d6001a0"
format_stamp: "Formatted at 2026-08-11 05:08:00 on dist-test-slave-x5fp"
server_key: "c9942980ca5c30987e3b6707503f5ad3"
server_key_iv: "2b08efd8b30246f7bdd9e837cfe91d83"
server_key_version: "encryptionkey@0"
I20260811 05:08:00.519244 2694 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424853995437-27391-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424853995437-27391-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424853995437-27391-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:08:00.523304 2694 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:08:00.523643 2694 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:08:00.523810 2694 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:08:00.524053 2694 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:08:00.524412 2694 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:08:00.524474 2694 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:00.524519 2694 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:08:00.524549 2694 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:00.531481 2694 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.194:39743
I20260811 05:08:00.531525 2889 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.194:39743 every 8 connection(s)
I20260811 05:08:00.531949 2694 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424853995437-27391-0/minicluster-data/ts-1/data/info.pb
I20260811 05:08:00.533036 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 2694
I20260811 05:08:00.533181 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424853995437-27391-0/minicluster-data/ts-1/wal/instance
I20260811 05:08:00.533392 27391 external_mini_cluster.cc:1428] Setting key e3be03aae0761ab254114d2d7a1570f9
I20260811 05:08:00.534667 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424853995437-27391-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424853995437-27391-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424853995437-27391-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424853995437-27391-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.191.195:0
--local_ip_for_outbound_sockets=127.26.191.195
--webserver_interface=127.26.191.195
--webserver_port=0
--tserver_master_addrs=127.26.191.254:46119
--builtin_ntp_servers=127.26.191.212:34967
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260811 05:08:00.535733 2471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:00.532863 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.194:57243 (local address 127.26.191.254:46119)
0811 05:08:00.532931 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:00.532933 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:00.533181 (+ 248us) server_negotiation.cc:407] Connection header received
0811 05:08:00.533833 (+ 652us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:00.533835 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:00.533841 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:00.533917 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:00.535449 (+ 1532us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:00.535450 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:00.535451 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:08:00.535455 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:00.535475 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:08:00.535479 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:00.535544 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:00.535650 (+ 106us) server_negotiation.cc:299] Negotiation successful
0811 05:08:00.535664 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260811 05:08:00.536041 2896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:00.532799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:46119 (local address 127.26.191.194:57243)
0811 05:08:00.533019 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:00.533057 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:00.533694 (+ 637us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:00.533976 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:00.533980 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:00.533988 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:00.535242 (+ 1254us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 05:08:00.535243 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:00.535287 (+ 44us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 05:08:00.535329 (+ 42us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:08:00.535559 (+ 230us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:08:00.535565 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:08:00.535568 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 05:08:00.535649 (+ 81us) client_negotiation.cc:240] Negotiation successful
0811 05:08:00.535715 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":95,"threads_started":1}
I20260811 05:08:00.536757 2891 heartbeater.cc:347] Connected to a master server at 127.26.191.254:46119
I20260811 05:08:00.536867 2891 heartbeater.cc:464] Registering TS with master...
I20260811 05:08:00.537047 2891 heartbeater.cc:511] Master 127.26.191.254:46119 requested a full tablet report, sending...
I20260811 05:08:00.537467 2404 ts_manager.cc:194] Registered new tserver with Master: 9364b047ec9b41bf9009dfee4d6001a0 (127.26.191.194:39743)
W20260811 05:08:00.623934 2899 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:08:00.624171 2899 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:08:00.624197 2899 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:08:00.625411 2899 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:08:00.625450 2899 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:08:00.625478 2899 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.191.195
I20260811 05:08:00.626803 2899 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:34967
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424853995437-27391-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424853995437-27391-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.191.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424853995437-27391-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.191.195
--webserver_port=0
--tserver_master_addrs=127.26.191.254:46119
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2899
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.191.195
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424853995437-27391-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:08:00.627029 2899 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:08:00.627296 2899 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:08:00.632826 2906 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:00.633234 2910 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:08:00.633234 2899 server_base.cc:1034] running on GCE node
W20260811 05:08:00.633347 2905 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:08:00.633672 2899 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:08:00.633970 2899 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:08:00.635156 2899 hybrid_clock.cc:648] HybridClock initialized: now 1786424880635107 us; error 67 us; skew 500 ppm
I20260811 05:08:00.636801 2899 webserver.cc:460] Webserver started at http://127.26.191.195:45997/ using document root <none> and password file <none>
I20260811 05:08:00.637090 2899 fs_manager.cc:359] Metadata directory not provided
I20260811 05:08:00.637145 2899 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:08:00.637297 2899 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:08:00.638502 2899 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424853995437-27391-0/minicluster-data/ts-2/data/instance:
uuid: "317d39a90bce4986addd3e350f0ac3cc"
format_stamp: "Formatted at 2026-08-11 05:08:00 on dist-test-slave-x5fp"
server_key: "a22d19914cca54c587d80e3f62842979"
server_key_iv: "c9e93daa517de38fc99fa012d2e6726d"
server_key_version: "encryptionkey@0"
I20260811 05:08:00.638917 2899 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424853995437-27391-0/minicluster-data/ts-2/wal/instance:
uuid: "317d39a90bce4986addd3e350f0ac3cc"
format_stamp: "Formatted at 2026-08-11 05:08:00 on dist-test-slave-x5fp"
server_key: "a22d19914cca54c587d80e3f62842979"
server_key_iv: "c9e93daa517de38fc99fa012d2e6726d"
server_key_version: "encryptionkey@0"
I20260811 05:08:00.640427 2899 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 05:08:00.641420 2918 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:00.641616 2899 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:08:00.641717 2899 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424853995437-27391-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424853995437-27391-0/minicluster-data/ts-2/wal
uuid: "317d39a90bce4986addd3e350f0ac3cc"
format_stamp: "Formatted at 2026-08-11 05:08:00 on dist-test-slave-x5fp"
server_key: "a22d19914cca54c587d80e3f62842979"
server_key_iv: "c9e93daa517de38fc99fa012d2e6726d"
server_key_version: "encryptionkey@0"
I20260811 05:08:00.641779 2899 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424853995437-27391-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424853995437-27391-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424853995437-27391-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:08:00.645308 2899 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:08:00.645568 2899 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:08:00.645673 2899 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:08:00.645838 2899 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:08:00.646111 2899 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:08:00.646140 2899 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:00.646162 2899 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:08:00.646174 2899 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:00.652220 2899 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.195:33573
I20260811 05:08:00.652323 3105 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.195:33573 every 8 connection(s)
I20260811 05:08:00.652594 2899 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424853995437-27391-0/minicluster-data/ts-2/data/info.pb
I20260811 05:08:00.655718 2471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:00.653427 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.195:51223 (local address 127.26.191.254:46119)
0811 05:08:00.653527 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:00.653529 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:00.653728 (+ 199us) server_negotiation.cc:407] Connection header received
0811 05:08:00.654205 (+ 477us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:00.654207 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:00.654212 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:00.654269 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:00.655481 (+ 1212us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:00.655483 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:00.655483 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:08:00.655487 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:00.655502 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:08:00.655506 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:00.655563 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:00.655642 (+ 79us) server_negotiation.cc:299] Negotiation successful
0811 05:08:00.655656 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260811 05:08:00.655925 3111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:00.653389 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:46119 (local address 127.26.191.195:51223)
0811 05:08:00.653607 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:00.653642 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:00.654108 (+ 466us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:00.654331 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:00.654335 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:00.654342 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:00.655323 (+ 981us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 05:08:00.655323 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:00.655354 (+ 31us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 05:08:00.655384 (+ 30us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:08:00.655572 (+ 188us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:08:00.655574 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:08:00.655577 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 05:08:00.655631 (+ 54us) client_negotiation.cc:240] Negotiation successful
0811 05:08:00.655681 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":113,"threads_started":1}
I20260811 05:08:00.656510 3107 heartbeater.cc:347] Connected to a master server at 127.26.191.254:46119
I20260811 05:08:00.656599 3107 heartbeater.cc:464] Registering TS with master...
I20260811 05:08:00.656807 3107 heartbeater.cc:511] Master 127.26.191.254:46119 requested a full tablet report, sending...
I20260811 05:08:00.657284 2404 ts_manager.cc:194] Registered new tserver with Master: 317d39a90bce4986addd3e350f0ac3cc (127.26.191.195:33573)
I20260811 05:08:00.661850 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 2899
I20260811 05:08:00.661943 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424853995437-27391-0/minicluster-data/ts-2/wal/instance
I20260811 05:08:00.662158 27391 external_mini_cluster.cc:1428] Setting key 880733bb66e07eefadf2241548ae0353
I20260811 05:08:00.663360 27391 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 05:08:00.666046 2471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:00.664898 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59362 (local address 127.26.191.254:46119)
0811 05:08:00.664973 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:00.664975 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:00.665117 (+ 142us) server_negotiation.cc:407] Connection header received
0811 05:08:00.665177 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:00.665178 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:00.665183 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:00.665232 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:00.665827 (+ 595us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:00.665828 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:00.665829 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:08:00.665832 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:00.665849 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:08:00.665853 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:00.665892 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:00.665929 (+ 37us) server_negotiation.cc:299] Negotiation successful
0811 05:08:00.665940 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 05:08:00.667773 2404 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59362:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 05:08:00.669734 2404 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 05:08:00.674741 3122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:00.672472 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.193:46743 (local address 127.0.0.1:34134)
0811 05:08:00.673145 (+ 673us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:00.673157 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:00.673239 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:00.673788 (+ 549us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:00.673789 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:00.673791 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:00.674231 (+ 440us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 05:08:00.674232 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:00.674240 (+ 8us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 05:08:00.674255 (+ 15us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:08:00.674568 (+ 313us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:08:00.674568 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:08:00.674569 (+ 1us) client_negotiation.cc:769] Sending connection context
0811 05:08:00.674618 (+ 49us) client_negotiation.cc:240] Negotiation successful
0811 05:08:00.674637 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":654,"mutex_wait_us":24,"thread_start_us":84,"threads_started":1}
I20260811 05:08:00.674741 3121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:00.672472 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.194:39743 (local address 127.0.0.1:55846)
0811 05:08:00.672654 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:00.672704 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:00.672901 (+ 197us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:00.673373 (+ 472us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:00.673380 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:00.673388 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:00.674078 (+ 690us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 05:08:00.674078 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:00.674096 (+ 18us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 05:08:00.674124 (+ 28us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:08:00.674537 (+ 413us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:08:00.674545 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:08:00.674548 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 05:08:00.674623 (+ 75us) client_negotiation.cc:240] Negotiation successful
0811 05:08:00.674639 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"mutex_wait_us":3,"thread_start_us":90,"threads_started":1}
I20260811 05:08:00.674787 3123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:00.672630 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34134 (local address 127.26.191.193:46743)
0811 05:08:00.673048 (+ 418us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:00.673052 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:00.673215 (+ 163us) server_negotiation.cc:407] Connection header received
0811 05:08:00.673320 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:00.673332 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:00.673345 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:00.673447 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:00.674356 (+ 909us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:00.674368 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:00.674368 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:08:00.674373 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:00.674413 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:08:00.674447 (+ 34us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:00.674515 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:00.674653 (+ 138us) server_negotiation.cc:299] Negotiation successful
0811 05:08:00.674673 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":376,"thread_start_us":270,"threads_started":1}
I20260811 05:08:00.674890 3129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:00.673155 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.195:33573 (local address 127.0.0.1:40482)
0811 05:08:00.673457 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:00.673467 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:00.673544 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:00.674047 (+ 503us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:00.674048 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:00.674050 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:00.674444 (+ 394us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 05:08:00.674444 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:00.674451 (+ 7us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 05:08:00.674462 (+ 11us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:08:00.674745 (+ 283us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:08:00.674746 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:08:00.674746 (+ 0us) client_negotiation.cc:769] Sending connection context
0811 05:08:00.674805 (+ 59us) client_negotiation.cc:240] Negotiation successful
0811 05:08:00.674820 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":287,"thread_start_us":145,"threads_started":1}
I20260811 05:08:00.675060 3128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:00.672972 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40482 (local address 127.26.191.195:33573)
0811 05:08:00.673382 (+ 410us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:00.673386 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:00.673522 (+ 136us) server_negotiation.cc:407] Connection header received
0811 05:08:00.673629 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:00.673632 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:00.673643 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:00.673696 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:00.674557 (+ 861us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:00.674566 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:00.674566 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:08:00.674571 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:00.674627 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:08:00.674656 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:00.674696 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:00.674960 (+ 264us) server_negotiation.cc:299] Negotiation successful
0811 05:08:00.674977 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":370,"thread_start_us":108,"threads_started":1}
I20260811 05:08:00.675781 3126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:00.672951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55846 (local address 127.26.191.194:39743)
0811 05:08:00.673189 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:00.673193 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:00.673205 (+ 12us) server_negotiation.cc:407] Connection header received
0811 05:08:00.673235 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:00.673238 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:00.673251 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:00.673870 (+ 619us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:00.674381 (+ 511us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:00.674384 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:00.674385 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:08:00.674388 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:00.674436 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:08:00.674453 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:00.674524 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:00.675657 (+ 1133us) server_negotiation.cc:299] Negotiation successful
0811 05:08:00.675676 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":193,"thread_start_us":124,"threads_started":1}
I20260811 05:08:00.675760 3000 tablet_service.cc:1467] Processing CreateTablet for tablet 0b707924dce64e8eb48b0e838a1c7860 (DEFAULT_TABLE table=test-table [id=e2fe0c38ebf64153ae3a2912b9176dca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:08:00.675796 2589 tablet_service.cc:1467] Processing CreateTablet for tablet 0b707924dce64e8eb48b0e838a1c7860 (DEFAULT_TABLE table=test-table [id=e2fe0c38ebf64153ae3a2912b9176dca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:08:00.676195 3000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0b707924dce64e8eb48b0e838a1c7860. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:08:00.676198 2589 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0b707924dce64e8eb48b0e838a1c7860. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:08:00.676483 2781 tablet_service.cc:1467] Processing CreateTablet for tablet 0b707924dce64e8eb48b0e838a1c7860 (DEFAULT_TABLE table=test-table [id=e2fe0c38ebf64153ae3a2912b9176dca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:08:00.676915 2781 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0b707924dce64e8eb48b0e838a1c7860. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:08:00.679256 3130 tablet_bootstrap.cc:492] T 0b707924dce64e8eb48b0e838a1c7860 P 317d39a90bce4986addd3e350f0ac3cc: Bootstrap starting.
I20260811 05:08:00.679790 3131 tablet_bootstrap.cc:492] T 0b707924dce64e8eb48b0e838a1c7860 P 19b177a6d9b84631870362c0b773f245: Bootstrap starting.
I20260811 05:08:00.680068 3130 tablet_bootstrap.cc:654] T 0b707924dce64e8eb48b0e838a1c7860 P 317d39a90bce4986addd3e350f0ac3cc: Neither blocks nor log segments found. Creating new log.
I20260811 05:08:00.680506 3131 tablet_bootstrap.cc:654] T 0b707924dce64e8eb48b0e838a1c7860 P 19b177a6d9b84631870362c0b773f245: Neither blocks nor log segments found. Creating new log.
I20260811 05:08:00.680536 3130 log.cc:824] T 0b707924dce64e8eb48b0e838a1c7860 P 317d39a90bce4986addd3e350f0ac3cc: Log is configured to *not* fsync() on all Append() calls
I20260811 05:08:00.680876 3132 tablet_bootstrap.cc:492] T 0b707924dce64e8eb48b0e838a1c7860 P 9364b047ec9b41bf9009dfee4d6001a0: Bootstrap starting.
I20260811 05:08:00.680888 3131 log.cc:824] T 0b707924dce64e8eb48b0e838a1c7860 P 19b177a6d9b84631870362c0b773f245: Log is configured to *not* fsync() on all Append() calls
I20260811 05:08:00.681377 3130 tablet_bootstrap.cc:492] T 0b707924dce64e8eb48b0e838a1c7860 P 317d39a90bce4986addd3e350f0ac3cc: No bootstrap required, opened a new log
I20260811 05:08:00.681468 3130 ts_tablet_manager.cc:1397] T 0b707924dce64e8eb48b0e838a1c7860 P 317d39a90bce4986addd3e350f0ac3cc: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 05:08:00.681600 3132 tablet_bootstrap.cc:654] T 0b707924dce64e8eb48b0e838a1c7860 P 9364b047ec9b41bf9009dfee4d6001a0: Neither blocks nor log segments found. Creating new log.
I20260811 05:08:00.681790 3131 tablet_bootstrap.cc:492] T 0b707924dce64e8eb48b0e838a1c7860 P 19b177a6d9b84631870362c0b773f245: No bootstrap required, opened a new log
I20260811 05:08:00.681866 3131 ts_tablet_manager.cc:1397] T 0b707924dce64e8eb48b0e838a1c7860 P 19b177a6d9b84631870362c0b773f245: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260811 05:08:00.681938 3132 log.cc:824] T 0b707924dce64e8eb48b0e838a1c7860 P 9364b047ec9b41bf9009dfee4d6001a0: Log is configured to *not* fsync() on all Append() calls
I20260811 05:08:00.682773 3132 tablet_bootstrap.cc:492] T 0b707924dce64e8eb48b0e838a1c7860 P 9364b047ec9b41bf9009dfee4d6001a0: No bootstrap required, opened a new log
I20260811 05:08:00.682852 3132 ts_tablet_manager.cc:1397] T 0b707924dce64e8eb48b0e838a1c7860 P 9364b047ec9b41bf9009dfee4d6001a0: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 05:08:00.683779 3130 raft_consensus.cc:348] T 0b707924dce64e8eb48b0e838a1c7860 P 317d39a90bce4986addd3e350f0ac3cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9364b047ec9b41bf9009dfee4d6001a0" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 39743 } } peers { permanent_uuid: "317d39a90bce4986addd3e350f0ac3cc" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 33573 } } peers { permanent_uuid: "19b177a6d9b84631870362c0b773f245" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 46743 } }
I20260811 05:08:00.683946 3130 raft_consensus.cc:374] T 0b707924dce64e8eb48b0e838a1c7860 P 317d39a90bce4986addd3e350f0ac3cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:08:00.683991 3130 raft_consensus.cc:729] T 0b707924dce64e8eb48b0e838a1c7860 P 317d39a90bce4986addd3e350f0ac3cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 317d39a90bce4986addd3e350f0ac3cc, State: Initialized, Role: FOLLOWER
I20260811 05:08:00.684137 3130 consensus_queue.cc:260] T 0b707924dce64e8eb48b0e838a1c7860 P 317d39a90bce4986addd3e350f0ac3cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9364b047ec9b41bf9009dfee4d6001a0" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 39743 } } peers { permanent_uuid: "317d39a90bce4986addd3e350f0ac3cc" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 33573 } } peers { permanent_uuid: "19b177a6d9b84631870362c0b773f245" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 46743 } }
I20260811 05:08:00.684430 3130 ts_tablet_manager.cc:1428] T 0b707924dce64e8eb48b0e838a1c7860 P 317d39a90bce4986addd3e350f0ac3cc: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 05:08:00.684561 3107 heartbeater.cc:503] Master 127.26.191.254:46119 was elected leader, sending a full tablet report...
I20260811 05:08:00.684868 3131 raft_consensus.cc:348] T 0b707924dce64e8eb48b0e838a1c7860 P 19b177a6d9b84631870362c0b773f245 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9364b047ec9b41bf9009dfee4d6001a0" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 39743 } } peers { permanent_uuid: "317d39a90bce4986addd3e350f0ac3cc" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 33573 } } peers { permanent_uuid: "19b177a6d9b84631870362c0b773f245" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 46743 } }
I20260811 05:08:00.685127 3131 raft_consensus.cc:374] T 0b707924dce64e8eb48b0e838a1c7860 P 19b177a6d9b84631870362c0b773f245 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:08:00.685190 3131 raft_consensus.cc:729] T 0b707924dce64e8eb48b0e838a1c7860 P 19b177a6d9b84631870362c0b773f245 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19b177a6d9b84631870362c0b773f245, State: Initialized, Role: FOLLOWER
I20260811 05:08:00.685348 3131 consensus_queue.cc:260] T 0b707924dce64e8eb48b0e838a1c7860 P 19b177a6d9b84631870362c0b773f245 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9364b047ec9b41bf9009dfee4d6001a0" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 39743 } } peers { permanent_uuid: "317d39a90bce4986addd3e350f0ac3cc" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 33573 } } peers { permanent_uuid: "19b177a6d9b84631870362c0b773f245" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 46743 } }
I20260811 05:08:00.685642 3131 ts_tablet_manager.cc:1428] T 0b707924dce64e8eb48b0e838a1c7860 P 19b177a6d9b84631870362c0b773f245: Time spent starting tablet: real 0.004s user 0.003s sys 0.001s
I20260811 05:08:00.685663 2689 heartbeater.cc:503] Master 127.26.191.254:46119 was elected leader, sending a full tablet report...
I20260811 05:08:00.685672 3132 raft_consensus.cc:348] T 0b707924dce64e8eb48b0e838a1c7860 P 9364b047ec9b41bf9009dfee4d6001a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9364b047ec9b41bf9009dfee4d6001a0" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 39743 } } peers { permanent_uuid: "317d39a90bce4986addd3e350f0ac3cc" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 33573 } } peers { permanent_uuid: "19b177a6d9b84631870362c0b773f245" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 46743 } }
I20260811 05:08:00.685827 3132 raft_consensus.cc:374] T 0b707924dce64e8eb48b0e838a1c7860 P 9364b047ec9b41bf9009dfee4d6001a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:08:00.685851 3132 raft_consensus.cc:729] T 0b707924dce64e8eb48b0e838a1c7860 P 9364b047ec9b41bf9009dfee4d6001a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9364b047ec9b41bf9009dfee4d6001a0, State: Initialized, Role: FOLLOWER
I20260811 05:08:00.685994 3132 consensus_queue.cc:260] T 0b707924dce64e8eb48b0e838a1c7860 P 9364b047ec9b41bf9009dfee4d6001a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9364b047ec9b41bf9009dfee4d6001a0" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 39743 } } peers { permanent_uuid: "317d39a90bce4986addd3e350f0ac3cc" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 33573 } } peers { permanent_uuid: "19b177a6d9b84631870362c0b773f245" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 46743 } }
I20260811 05:08:00.686301 2891 heartbeater.cc:503] Master 127.26.191.254:46119 was elected leader, sending a full tablet report...
I20260811 05:08:00.686630 3132 ts_tablet_manager.cc:1428] T 0b707924dce64e8eb48b0e838a1c7860 P 9364b047ec9b41bf9009dfee4d6001a0: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260811 05:08:00.699396 3145 raft_consensus.cc:482] T 0b707924dce64e8eb48b0e838a1c7860 P 9364b047ec9b41bf9009dfee4d6001a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 05:08:00.699558 3145 raft_consensus.cc:504] T 0b707924dce64e8eb48b0e838a1c7860 P 9364b047ec9b41bf9009dfee4d6001a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9364b047ec9b41bf9009dfee4d6001a0" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 39743 } } peers { permanent_uuid: "317d39a90bce4986addd3e350f0ac3cc" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 33573 } } peers { permanent_uuid: "19b177a6d9b84631870362c0b773f245" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 46743 } }
I20260811 05:08:00.700057 3145 leader_election.cc:288] T 0b707924dce64e8eb48b0e838a1c7860 P 9364b047ec9b41bf9009dfee4d6001a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 317d39a90bce4986addd3e350f0ac3cc (127.26.191.195:33573), 19b177a6d9b84631870362c0b773f245 (127.26.191.193:46743)
I20260811 05:08:00.701844 2896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:00.700420 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.195:33573 (local address 127.26.191.194:53997)
0811 05:08:00.700498 (+ 78us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:00.700512 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:00.700557 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:00.700801 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:00.700802 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:00.700805 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:00.701393 (+ 588us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 05:08:00.701394 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:00.701402 (+ 8us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 05:08:00.701415 (+ 13us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:08:00.701675 (+ 260us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:08:00.701676 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:08:00.701677 (+ 1us) client_negotiation.cc:769] Sending connection context
0811 05:08:00.701743 (+ 66us) client_negotiation.cc:240] Negotiation successful
0811 05:08:00.701762 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":56}
I20260811 05:08:00.701845 3128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:00.700555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.194:53997 (local address 127.26.191.195:33573)
0811 05:08:00.700608 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:00.700611 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:00.700623 (+ 12us) server_negotiation.cc:407] Connection header received
0811 05:08:00.700659 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:00.700660 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:00.700666 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:00.700776 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:00.701536 (+ 760us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:00.701538 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:00.701538 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:08:00.701544 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:00.701568 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:08:00.701574 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:00.701676 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:00.701746 (+ 70us) server_negotiation.cc:299] Negotiation successful
0811 05:08:00.701762 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 05:08:00.702051 3147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:00.700443 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.193:46743 (local address 127.26.191.194:50525)
0811 05:08:00.700684 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:00.700694 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:00.700806 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:00.700992 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:00.700993 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:00.700996 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:00.701666 (+ 670us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 05:08:00.701667 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:00.701673 (+ 6us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 05:08:00.701686 (+ 13us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:08:00.701868 (+ 182us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:08:00.701869 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:08:00.701870 (+ 1us) client_negotiation.cc:769] Sending connection context
0811 05:08:00.701921 (+ 51us) client_negotiation.cc:240] Negotiation successful
0811 05:08:00.701936 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":130,"threads_started":1}
I20260811 05:08:00.702214 3123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:00.700658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.194:50525 (local address 127.26.191.193:46743)
0811 05:08:00.700851 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:00.700853 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:00.700863 (+ 10us) server_negotiation.cc:407] Connection header received
0811 05:08:00.700893 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:00.700894 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:00.700898 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:00.700965 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:00.701755 (+ 790us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:00.701756 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:00.701757 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:08:00.701762 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:00.701785 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:08:00.701789 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:00.701861 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:00.702115 (+ 254us) server_negotiation.cc:299] Negotiation successful
0811 05:08:00.702133 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":162}
I20260811 05:08:00.702237 3036 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b707924dce64e8eb48b0e838a1c7860" candidate_uuid: "9364b047ec9b41bf9009dfee4d6001a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "317d39a90bce4986addd3e350f0ac3cc" is_pre_election: true
I20260811 05:08:00.702450 3036 raft_consensus.cc:2454] T 0b707924dce64e8eb48b0e838a1c7860 P 317d39a90bce4986addd3e350f0ac3cc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9364b047ec9b41bf9009dfee4d6001a0 in term 0.
I20260811 05:08:00.702580 2614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b707924dce64e8eb48b0e838a1c7860" candidate_uuid: "9364b047ec9b41bf9009dfee4d6001a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19b177a6d9b84631870362c0b773f245" is_pre_election: true
I20260811 05:08:00.702720 2614 raft_consensus.cc:2454] T 0b707924dce64e8eb48b0e838a1c7860 P 19b177a6d9b84631870362c0b773f245 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9364b047ec9b41bf9009dfee4d6001a0 in term 0.
I20260811 05:08:00.702757 2721 leader_election.cc:302] T 0b707924dce64e8eb48b0e838a1c7860 P 9364b047ec9b41bf9009dfee4d6001a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 317d39a90bce4986addd3e350f0ac3cc, 9364b047ec9b41bf9009dfee4d6001a0; no voters:
I20260811 05:08:00.702941 3145 raft_consensus.cc:2781] T 0b707924dce64e8eb48b0e838a1c7860 P 9364b047ec9b41bf9009dfee4d6001a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 05:08:00.703037 3145 raft_consensus.cc:482] T 0b707924dce64e8eb48b0e838a1c7860 P 9364b047ec9b41bf9009dfee4d6001a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 05:08:00.703073 3145 raft_consensus.cc:3037] T 0b707924dce64e8eb48b0e838a1c7860 P 9364b047ec9b41bf9009dfee4d6001a0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:08:00.704113 3145 raft_consensus.cc:504] T 0b707924dce64e8eb48b0e838a1c7860 P 9364b047ec9b41bf9009dfee4d6001a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9364b047ec9b41bf9009dfee4d6001a0" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 39743 } } peers { permanent_uuid: "317d39a90bce4986addd3e350f0ac3cc" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 33573 } } peers { permanent_uuid: "19b177a6d9b84631870362c0b773f245" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 46743 } }
I20260811 05:08:00.704464 3145 leader_election.cc:288] T 0b707924dce64e8eb48b0e838a1c7860 P 9364b047ec9b41bf9009dfee4d6001a0 [CANDIDATE]: Term 1 election: Requested vote from peers 317d39a90bce4986addd3e350f0ac3cc (127.26.191.195:33573), 19b177a6d9b84631870362c0b773f245 (127.26.191.193:46743)
I20260811 05:08:00.704639 3036 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b707924dce64e8eb48b0e838a1c7860" candidate_uuid: "9364b047ec9b41bf9009dfee4d6001a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "317d39a90bce4986addd3e350f0ac3cc"
I20260811 05:08:00.704690 2614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b707924dce64e8eb48b0e838a1c7860" candidate_uuid: "9364b047ec9b41bf9009dfee4d6001a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19b177a6d9b84631870362c0b773f245"
I20260811 05:08:00.704770 3036 raft_consensus.cc:3037] T 0b707924dce64e8eb48b0e838a1c7860 P 317d39a90bce4986addd3e350f0ac3cc [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:08:00.704799 2614 raft_consensus.cc:3037] T 0b707924dce64e8eb48b0e838a1c7860 P 19b177a6d9b84631870362c0b773f245 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:08:00.705850 3036 raft_consensus.cc:2454] T 0b707924dce64e8eb48b0e838a1c7860 P 317d39a90bce4986addd3e350f0ac3cc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9364b047ec9b41bf9009dfee4d6001a0 in term 1.
I20260811 05:08:00.705850 2614 raft_consensus.cc:2454] T 0b707924dce64e8eb48b0e838a1c7860 P 19b177a6d9b84631870362c0b773f245 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9364b047ec9b41bf9009dfee4d6001a0 in term 1.
I20260811 05:08:00.706120 2721 leader_election.cc:302] T 0b707924dce64e8eb48b0e838a1c7860 P 9364b047ec9b41bf9009dfee4d6001a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 317d39a90bce4986addd3e350f0ac3cc, 9364b047ec9b41bf9009dfee4d6001a0; no voters:
I20260811 05:08:00.706405 3145 raft_consensus.cc:2781] T 0b707924dce64e8eb48b0e838a1c7860 P 9364b047ec9b41bf9009dfee4d6001a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:08:00.706845 3145 raft_consensus.cc:686] T 0b707924dce64e8eb48b0e838a1c7860 P 9364b047ec9b41bf9009dfee4d6001a0 [term 1 LEADER]: Becoming Leader. State: Replica: 9364b047ec9b41bf9009dfee4d6001a0, State: Running, Role: LEADER
I20260811 05:08:00.706979 3145 consensus_queue.cc:237] T 0b707924dce64e8eb48b0e838a1c7860 P 9364b047ec9b41bf9009dfee4d6001a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9364b047ec9b41bf9009dfee4d6001a0" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 39743 } } peers { permanent_uuid: "317d39a90bce4986addd3e350f0ac3cc" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 33573 } } peers { permanent_uuid: "19b177a6d9b84631870362c0b773f245" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 46743 } }
I20260811 05:08:00.708045 2404 catalog_manager.cc:5495] T 0b707924dce64e8eb48b0e838a1c7860 P 9364b047ec9b41bf9009dfee4d6001a0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9364b047ec9b41bf9009dfee4d6001a0 (127.26.191.194). New cstate: current_term: 1 leader_uuid: "9364b047ec9b41bf9009dfee4d6001a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9364b047ec9b41bf9009dfee4d6001a0" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 39743 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "317d39a90bce4986addd3e350f0ac3cc" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19b177a6d9b84631870362c0b773f245" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 46743 } health_report { overall_health: UNKNOWN } } }
I20260811 05:08:00.712996 3126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:00.711357 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55848 (local address 127.26.191.194:39743)
0811 05:08:00.711409 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:00.711411 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:00.711487 (+ 76us) server_negotiation.cc:407] Connection header received
0811 05:08:00.711564 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:00.711565 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:00.711577 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:00.711630 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:00.712613 (+ 983us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:00.712615 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:00.712615 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:08:00.712620 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:00.712643 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:08:00.712648 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:00.712712 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:00.712886 (+ 174us) server_negotiation.cc:299] Negotiation successful
0811 05:08:00.712901 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 05:08:00.715595 3036 raft_consensus.cc:1261] T 0b707924dce64e8eb48b0e838a1c7860 P 317d39a90bce4986addd3e350f0ac3cc [term 1 FOLLOWER]: Refusing update from remote peer 9364b047ec9b41bf9009dfee4d6001a0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:08:00.715638 2614 raft_consensus.cc:1261] T 0b707924dce64e8eb48b0e838a1c7860 P 19b177a6d9b84631870362c0b773f245 [term 1 FOLLOWER]: Refusing update from remote peer 9364b047ec9b41bf9009dfee4d6001a0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:08:00.716202 3149 consensus_queue.cc:1035] T 0b707924dce64e8eb48b0e838a1c7860 P 9364b047ec9b41bf9009dfee4d6001a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "317d39a90bce4986addd3e350f0ac3cc" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:08:00.716418 3145 consensus_queue.cc:1035] T 0b707924dce64e8eb48b0e838a1c7860 P 9364b047ec9b41bf9009dfee4d6001a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19b177a6d9b84631870362c0b773f245" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 46743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:08:00.719636 3152 mvcc.cc:205] Tried to move back new op lower bound from 7317196311407218688 to 7317196311376609280. Current Snapshot: MvccSnapshot[applied={T|T < 7317196311407218688}]
I20260811 05:08:00.720085 3154 mvcc.cc:205] Tried to move back new op lower bound from 7317196311407218688 to 7317196311376609280. Current Snapshot: MvccSnapshot[applied={T|T < 7317196311407218688}]
I20260811 05:08:00.720589 3153 mvcc.cc:205] Tried to move back new op lower bound from 7317196311407218688 to 7317196311376609280. Current Snapshot: MvccSnapshot[applied={T|T < 7317196311407218688 or (T in {7317196311407218688})}]
I20260811 05:08:00.724059 2404 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59362:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:08:00.724179 2404 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59362:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:08:00.725371 2404 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 74e360032e0b40e7a6ce87b0fcd4e888: Sending DeleteTablet for 3 replicas of tablet 0b707924dce64e8eb48b0e838a1c7860
I20260811 05:08:00.725998 2589 tablet_service.cc:1514] Processing DeleteTablet for tablet 0b707924dce64e8eb48b0e838a1c7860 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:08:00 UTC) from {username='slave'} at 127.0.0.1:34134
I20260811 05:08:00.726001 3000 tablet_service.cc:1514] Processing DeleteTablet for tablet 0b707924dce64e8eb48b0e838a1c7860 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:08:00 UTC) from {username='slave'} at 127.0.0.1:40482
I20260811 05:08:00.726246 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 2500
I20260811 05:08:00.726862 2781 tablet_service.cc:1514] Processing DeleteTablet for tablet 0b707924dce64e8eb48b0e838a1c7860 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:08:00 UTC) from {username='slave'} at 127.0.0.1:55846
I20260811 05:08:00.729490 3171 tablet_replica.cc:330] T 0b707924dce64e8eb48b0e838a1c7860 P 9364b047ec9b41bf9009dfee4d6001a0: stopping tablet replica
I20260811 05:08:00.729635 3171 raft_consensus.cc:2229] T 0b707924dce64e8eb48b0e838a1c7860 P 9364b047ec9b41bf9009dfee4d6001a0 [term 1 LEADER]: Raft consensus shutting down.
I20260811 05:08:00.729811 3171 raft_consensus.cc:2258] T 0b707924dce64e8eb48b0e838a1c7860 P 9364b047ec9b41bf9009dfee4d6001a0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:08:00.731202 3169 tablet_replica.cc:330] T 0b707924dce64e8eb48b0e838a1c7860 P 317d39a90bce4986addd3e350f0ac3cc: stopping tablet replica
I20260811 05:08:00.731344 3169 raft_consensus.cc:2229] T 0b707924dce64e8eb48b0e838a1c7860 P 317d39a90bce4986addd3e350f0ac3cc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 05:08:00.731467 3169 raft_consensus.cc:2258] T 0b707924dce64e8eb48b0e838a1c7860 P 317d39a90bce4986addd3e350f0ac3cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:08:00.733017 3169 ts_tablet_manager.cc:1905] T 0b707924dce64e8eb48b0e838a1c7860 P 317d39a90bce4986addd3e350f0ac3cc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:08:00.734373 3171 ts_tablet_manager.cc:1905] T 0b707924dce64e8eb48b0e838a1c7860 P 9364b047ec9b41bf9009dfee4d6001a0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:08:00.734943 3169 ts_tablet_manager.cc:1918] T 0b707924dce64e8eb48b0e838a1c7860 P 317d39a90bce4986addd3e350f0ac3cc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 05:08:00.735034 3169 log.cc:1196] T 0b707924dce64e8eb48b0e838a1c7860 P 317d39a90bce4986addd3e350f0ac3cc: Deleting WAL directory at /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424853995437-27391-0/minicluster-data/ts-2/wal/wals/0b707924dce64e8eb48b0e838a1c7860
I20260811 05:08:00.735327 3169 ts_tablet_manager.cc:1939] T 0b707924dce64e8eb48b0e838a1c7860 P 317d39a90bce4986addd3e350f0ac3cc: Deleting consensus metadata
I20260811 05:08:00.735862 2382 catalog_manager.cc:4841] TS 317d39a90bce4986addd3e350f0ac3cc (127.26.191.195:33573): tablet 0b707924dce64e8eb48b0e838a1c7860 (table test-table [id=e2fe0c38ebf64153ae3a2912b9176dca]) successfully deleted
I20260811 05:08:00.737252 3171 ts_tablet_manager.cc:1918] T 0b707924dce64e8eb48b0e838a1c7860 P 9364b047ec9b41bf9009dfee4d6001a0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 05:08:00.737432 3171 log.cc:1196] T 0b707924dce64e8eb48b0e838a1c7860 P 9364b047ec9b41bf9009dfee4d6001a0: Deleting WAL directory at /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424853995437-27391-0/minicluster-data/ts-1/wal/wals/0b707924dce64e8eb48b0e838a1c7860
I20260811 05:08:00.737854 3171 ts_tablet_manager.cc:1939] T 0b707924dce64e8eb48b0e838a1c7860 P 9364b047ec9b41bf9009dfee4d6001a0: Deleting consensus metadata
I20260811 05:08:00.738363 2382 catalog_manager.cc:4841] TS 9364b047ec9b41bf9009dfee4d6001a0 (127.26.191.194:39743): tablet 0b707924dce64e8eb48b0e838a1c7860 (table test-table [id=e2fe0c38ebf64153ae3a2912b9176dca]) successfully deleted
W20260811 05:08:00.747495 2381 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.191.193:46743 (error 108)
I20260811 05:08:00.747714 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 2694
I20260811 05:08:00.751693 3129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:00.748014 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.193:46743 (local address 127.0.0.1:34140)
0811 05:08:00.751560 (+ 3546us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:00.751637 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.193:46743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":3512}
W20260811 05:08:00.754427 2381 catalog_manager.cc:4584] TS 19b177a6d9b84631870362c0b773f245 (127.26.191.193:46743): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 0b707924dce64e8eb48b0e838a1c7860: Network error: Client connection negotiation failed: client connection to 127.26.191.193:46743: connect: Connection refused (error 111)
I20260811 05:08:00.762409 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 2899
I20260811 05:08:00.772818 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 2357
2026-08-11T05:08:00Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (734 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260811 05:08:00.800410 27391 mini_oidc.cc:152] Starting JWKS server
I20260811 05:08:00.801786 27391 webserver.cc:460] Webserver started at https://127.0.0.1:44427/ using document root <none> and password file <none>
I20260811 05:08:00.801877 27391 mini_oidc.cc:189] Starting OIDC Discovery server
I20260811 05:08:00.802066 27391 webserver.cc:460] Webserver started at http://127.0.0.1:43647/ using document root <none> and password file <none>
2026-08-11T05:08:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:08:00Z Disabled control of system clock
I20260811 05:08:00.811909 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786424853995437-27391-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786424853995437-27391-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786424853995437-27391-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.254:43741
--webserver_interface=127.26.191.254
--webserver_port=0
--builtin_ntp_servers=127.26.191.212:37803
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.191.254:43741
--enable_jwt_token_auth=true
--jwks_url=https://localhost:44427/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786424853995437-27391-0/testchainca.cert with env {}
W20260811 05:08:00.898053 3180 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:08:00.898305 3180 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:08:00.898334 3180 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:08:00.899740 3180 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:08:00.899801 3180 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:08:00.899814 3180 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:08:00.899827 3180 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:08:00.899839 3180 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 05:08:00.899852 3180 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 05:08:00.899863 3180 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:44427/jwks.json
I20260811 05:08:00.901654 3180 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:37803
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786424853995437-27391-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786424853995437-27391-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.191.254:43741
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.254:43741
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:44427/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.191.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786424853995437-27391-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3180
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786424853995437-27391-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:08:00.901948 3180 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:08:00.902202 3180 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:08:00.907642 3188 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:00.907626 3189 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:08:00.907733 3180 server_base.cc:1034] running on GCE node
W20260811 05:08:00.907626 3194 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:08:00.908234 3180 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:08:00.908582 3180 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:08:00.909801 3180 hybrid_clock.cc:648] HybridClock initialized: now 1786424880909774 us; error 49 us; skew 500 ppm
I20260811 05:08:00.911319 3180 webserver.cc:460] Webserver started at http://127.26.191.254:37725/ using document root <none> and password file <none>
I20260811 05:08:00.911616 3180 fs_manager.cc:359] Metadata directory not provided
I20260811 05:08:00.911703 3180 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:08:00.911880 3180 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:08:00.913223 3180 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786424853995437-27391-0/minicluster-data/master-0/data/instance:
uuid: "36584137f74c49b0b4de235fb8888451"
format_stamp: "Formatted at 2026-08-11 05:08:00 on dist-test-slave-x5fp"
server_key: "7c1a678bdafe039fd8b63cdff43a1e77"
server_key_iv: "659b87d5a703abcc7cf2ec2e1756654b"
server_key_version: "encryptionkey@0"
I20260811 05:08:00.913648 3180 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786424853995437-27391-0/minicluster-data/master-0/wal/instance:
uuid: "36584137f74c49b0b4de235fb8888451"
format_stamp: "Formatted at 2026-08-11 05:08:00 on dist-test-slave-x5fp"
server_key: "7c1a678bdafe039fd8b63cdff43a1e77"
server_key_iv: "659b87d5a703abcc7cf2ec2e1756654b"
server_key_version: "encryptionkey@0"
I20260811 05:08:00.915215 3180 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 05:08:00.916239 3201 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:00.916548 3180 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:08:00.916790 3180 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786424853995437-27391-0/minicluster-data/master-0/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786424853995437-27391-0/minicluster-data/master-0/wal
uuid: "36584137f74c49b0b4de235fb8888451"
format_stamp: "Formatted at 2026-08-11 05:08:00 on dist-test-slave-x5fp"
server_key: "7c1a678bdafe039fd8b63cdff43a1e77"
server_key_iv: "659b87d5a703abcc7cf2ec2e1756654b"
server_key_version: "encryptionkey@0"
I20260811 05:08:00.916947 3180 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786424853995437-27391-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786424853995437-27391-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786424853995437-27391-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:08:00.926378 3180 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:08:00.926786 3180 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:08:00.926981 3180 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:08:00.931430 3180 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.254:43741
I20260811 05:08:00.931494 3286 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.254:43741 every 8 connection(s)
I20260811 05:08:00.931911 3180 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
I20260811 05:08:00.933178 3289 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:08:00.935669 3289 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 36584137f74c49b0b4de235fb8888451: Bootstrap starting.
I20260811 05:08:00.936327 3289 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 36584137f74c49b0b4de235fb8888451: Neither blocks nor log segments found. Creating new log.
I20260811 05:08:00.936673 3289 log.cc:824] T 00000000000000000000000000000000 P 36584137f74c49b0b4de235fb8888451: Log is configured to *not* fsync() on all Append() calls
I20260811 05:08:00.937500 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 3180
I20260811 05:08:00.937608 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786424853995437-27391-0/minicluster-data/master-0/wal/instance
I20260811 05:08:00.937724 3289 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 36584137f74c49b0b4de235fb8888451: No bootstrap required, opened a new log
I20260811 05:08:00.937855 27391 external_mini_cluster.cc:1428] Setting key 56304da1f0d429b5f29c16f5de10345d
I20260811 05:08:00.940582 3289 raft_consensus.cc:348] T 00000000000000000000000000000000 P 36584137f74c49b0b4de235fb8888451 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36584137f74c49b0b4de235fb8888451" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 43741 } }
I20260811 05:08:00.940795 3289 raft_consensus.cc:374] T 00000000000000000000000000000000 P 36584137f74c49b0b4de235fb8888451 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:08:00.940840 3289 raft_consensus.cc:729] T 00000000000000000000000000000000 P 36584137f74c49b0b4de235fb8888451 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36584137f74c49b0b4de235fb8888451, State: Initialized, Role: FOLLOWER
I20260811 05:08:00.940999 3289 consensus_queue.cc:260] T 00000000000000000000000000000000 P 36584137f74c49b0b4de235fb8888451 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36584137f74c49b0b4de235fb8888451" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 43741 } }
I20260811 05:08:00.941090 3289 raft_consensus.cc:388] T 00000000000000000000000000000000 P 36584137f74c49b0b4de235fb8888451 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:08:00.941115 3289 raft_consensus.cc:482] T 00000000000000000000000000000000 P 36584137f74c49b0b4de235fb8888451 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:08:00.941185 3289 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 36584137f74c49b0b4de235fb8888451 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:08:00.941812 3289 raft_consensus.cc:504] T 00000000000000000000000000000000 P 36584137f74c49b0b4de235fb8888451 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36584137f74c49b0b4de235fb8888451" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 43741 } }
I20260811 05:08:00.941939 3289 leader_election.cc:302] T 00000000000000000000000000000000 P 36584137f74c49b0b4de235fb8888451 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 36584137f74c49b0b4de235fb8888451; no voters:
I20260811 05:08:00.942149 3289 leader_election.cc:288] T 00000000000000000000000000000000 P 36584137f74c49b0b4de235fb8888451 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 05:08:00.942185 3298 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 36584137f74c49b0b4de235fb8888451 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:08:00.942303 3298 raft_consensus.cc:686] T 00000000000000000000000000000000 P 36584137f74c49b0b4de235fb8888451 [term 1 LEADER]: Becoming Leader. State: Replica: 36584137f74c49b0b4de235fb8888451, State: Running, Role: LEADER
I20260811 05:08:00.942397 3298 consensus_queue.cc:237] T 00000000000000000000000000000000 P 36584137f74c49b0b4de235fb8888451 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36584137f74c49b0b4de235fb8888451" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 43741 } }
I20260811 05:08:00.942476 3289 sys_catalog.cc:564] T 00000000000000000000000000000000 P 36584137f74c49b0b4de235fb8888451 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:08:00.942749 3301 sys_catalog.cc:455] T 00000000000000000000000000000000 P 36584137f74c49b0b4de235fb8888451 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 36584137f74c49b0b4de235fb8888451. Latest consensus state: current_term: 1 leader_uuid: "36584137f74c49b0b4de235fb8888451" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36584137f74c49b0b4de235fb8888451" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 43741 } } }
I20260811 05:08:00.942868 3301 sys_catalog.cc:458] T 00000000000000000000000000000000 P 36584137f74c49b0b4de235fb8888451 [sys.catalog]: This master's current role is: LEADER
I20260811 05:08:00.943087 3300 sys_catalog.cc:455] T 00000000000000000000000000000000 P 36584137f74c49b0b4de235fb8888451 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "36584137f74c49b0b4de235fb8888451" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36584137f74c49b0b4de235fb8888451" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 43741 } } }
I20260811 05:08:00.943164 3300 sys_catalog.cc:458] T 00000000000000000000000000000000 P 36584137f74c49b0b4de235fb8888451 [sys.catalog]: This master's current role is: LEADER
W20260811 05:08:00.944362 3320 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 36584137f74c49b0b4de235fb8888451: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 05:08:00.944466 3320 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 05:08:00.944677 3306 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:08:00.944806 3297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:00.938505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57140 (local address 127.26.191.254:43741)
0811 05:08:00.938715 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:00.938723 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:00.938750 (+ 27us) server_negotiation.cc:407] Connection header received
0811 05:08:00.939246 (+ 496us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:00.939253 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:00.939316 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:00.939444 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:00.939726 (+ 282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:00.940778 (+ 1052us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:00.941850 (+ 1072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:00.942618 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:00.943158 (+ 540us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:00.943621 (+ 463us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:00.943625 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:00.943626 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:08:00.943830 (+ 204us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:00.943868 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:08:00.943902 (+ 34us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:00.944391 (+ 489us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:00.944431 (+ 40us) server_negotiation.cc:299] Negotiation successful
0811 05:08:00.944523 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":92,"threads_started":1}
I20260811 05:08:00.944901 3306 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:08:00.945811 27391 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 05:08:00.946571 3306 catalog_manager.cc:1347] Generated new cluster ID: 3e71e6756de9402ab32095c7388ca590
I20260811 05:08:00.946623 3306 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:08:00.961829 3306 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:08:00.962447 3306 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:08:00.971808 3306 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 36584137f74c49b0b4de235fb8888451: Generated new TSK 0
I20260811 05:08:00.972122 3306 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260811 05:08:01.004776 3334 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260811 05:08:01.004982 3334 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260811 05:08:01.005208 3297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:00.986746 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57144 (local address 127.26.191.254:43741)
0811 05:08:00.986832 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:00.986835 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:00.987060 (+ 225us) server_negotiation.cc:407] Connection header received
0811 05:08:00.987184 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:00.987185 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:00.987197 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:00.987263 (+ 66us) server_negotiation.cc:226] Negotiated authn=JWT
0811 05:08:00.987572 (+ 309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:00.988161 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:00.989384 (+ 1223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:00.989596 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:00.989663 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:00.990071 (+ 408us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 05:08:01.004873 (+ 14802us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44427/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0811 05:08:01.005112 (+ 239us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:57144: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44427/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":49}
W20260811 05:08:01.005306 3297 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:57144: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44427/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260811 05:08:01.005867 3333 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:08:00.986675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:43741 (local address 127.0.0.1:57144)
0811 05:08:00.986972 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:00.986985 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:00.987067 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:00.987298 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:00.987299 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:00.987301 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0811 05:08:00.987386 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:00.987388 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:00.988280 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:00.988281 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:00.989273 (+ 992us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:00.989277 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:00.989695 (+ 418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:00.989696 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:00.989768 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:00.989800 (+ 32us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 05:08:01.005188 (+ 15388us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44427/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0811 05:08:01.005466 (+ 278us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.26.191.254:43741: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44427/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":234,"thread_start_us":184,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.26.191.254:43741: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44427/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260811 05:08:01.006409 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 3180
2026-08-11T05:08:01Z chronyd exiting
I20260811 05:08:01.054061 27391 test_util.cc:175] -----------------------------------------------
I20260811 05:08:01.054178 27391 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786424853995437-27391-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (255 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260811 05:08:01.055035 27391 mini_oidc.cc:152] Starting JWKS server
I20260811 05:08:01.055790 27391 webserver.cc:460] Webserver started at https://127.0.0.1:41573/ using document root <none> and password file <none>
I20260811 05:08:01.055862 27391 mini_oidc.cc:189] Starting OIDC Discovery server
I20260811 05:08:01.056035 27391 webserver.cc:460] Webserver started at http://127.0.0.1:38383/ using document root <none> and password file <none>
2026-08-11T05:08:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:08:01Z Disabled control of system clock
I20260811 05:08:01.066123 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786424853995437-27391-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786424853995437-27391-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786424853995437-27391-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.254:39221
--webserver_interface=127.26.191.254
--webserver_port=0
--builtin_ntp_servers=127.26.191.212:33849
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.191.254:39221
--enable_jwt_token_auth=true
--jwks_url=https://localhost:41573/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786424853995437-27391-0/testchainca.cert with env {}
W20260811 05:08:01.160077 3345 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:08:01.160349 3345 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:08:01.160391 3345 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:08:01.161710 3345 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:08:01.161787 3345 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:08:01.161815 3345 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:08:01.161836 3345 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:08:01.161868 3345 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 05:08:01.161893 3345 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 05:08:01.161921 3345 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:41573/jwks.json
I20260811 05:08:01.163563 3345 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:33849
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786424853995437-27391-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786424853995437-27391-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.191.254:39221
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.254:39221
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:41573/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.191.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786424853995437-27391-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3345
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786424853995437-27391-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:08:01.163879 3345 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:08:01.164130 3345 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:08:01.169925 3355 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:08:01.170187 3345 server_base.cc:1034] running on GCE node
W20260811 05:08:01.170262 3360 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:01.170419 3358 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:08:01.170890 3345 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:08:01.171248 3345 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:08:01.172484 3345 hybrid_clock.cc:648] HybridClock initialized: now 1786424881172443 us; error 60 us; skew 500 ppm
I20260811 05:08:01.174430 3345 webserver.cc:460] Webserver started at http://127.26.191.254:40011/ using document root <none> and password file <none>
I20260811 05:08:01.174769 3345 fs_manager.cc:359] Metadata directory not provided
I20260811 05:08:01.174858 3345 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:08:01.175035 3345 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:08:01.176292 3345 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786424853995437-27391-0/minicluster-data/master-0/data/instance:
uuid: "b3936c4e4d09402aa67eeb350f42fbee"
format_stamp: "Formatted at 2026-08-11 05:08:01 on dist-test-slave-x5fp"
server_key: "8de892a86448607ee22f95bef9411624"
server_key_iv: "c77e5592ce5c0383ec9c749d273441c7"
server_key_version: "encryptionkey@0"
I20260811 05:08:01.176822 3345 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786424853995437-27391-0/minicluster-data/master-0/wal/instance:
uuid: "b3936c4e4d09402aa67eeb350f42fbee"
format_stamp: "Formatted at 2026-08-11 05:08:01 on dist-test-slave-x5fp"
server_key: "8de892a86448607ee22f95bef9411624"
server_key_iv: "c77e5592ce5c0383ec9c749d273441c7"
server_key_version: "encryptionkey@0"
I20260811 05:08:01.178475 3345 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:08:01.179520 3370 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:01.179879 3345 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:08:01.180039 3345 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786424853995437-27391-0/minicluster-data/master-0/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786424853995437-27391-0/minicluster-data/master-0/wal
uuid: "b3936c4e4d09402aa67eeb350f42fbee"
format_stamp: "Formatted at 2026-08-11 05:08:01 on dist-test-slave-x5fp"
server_key: "8de892a86448607ee22f95bef9411624"
server_key_iv: "c77e5592ce5c0383ec9c749d273441c7"
server_key_version: "encryptionkey@0"
I20260811 05:08:01.180141 3345 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786424853995437-27391-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786424853995437-27391-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786424853995437-27391-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:08:01.195729 3345 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:08:01.196134 3345 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:08:01.196316 3345 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:08:01.201193 3345 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.254:39221
I20260811 05:08:01.201242 3450 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.254:39221 every 8 connection(s)
I20260811 05:08:01.201614 3345 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
I20260811 05:08:01.202333 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 3345
I20260811 05:08:01.202468 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786424853995437-27391-0/minicluster-data/master-0/wal/instance
I20260811 05:08:01.202527 3451 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:08:01.202682 27391 external_mini_cluster.cc:1428] Setting key a7c2b8824e624a54c805bf94d36b3c0e
I20260811 05:08:01.206233 3451 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b3936c4e4d09402aa67eeb350f42fbee: Bootstrap starting.
I20260811 05:08:01.206868 3451 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b3936c4e4d09402aa67eeb350f42fbee: Neither blocks nor log segments found. Creating new log.
I20260811 05:08:01.207212 3451 log.cc:824] T 00000000000000000000000000000000 P b3936c4e4d09402aa67eeb350f42fbee: Log is configured to *not* fsync() on all Append() calls
I20260811 05:08:01.208011 3451 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b3936c4e4d09402aa67eeb350f42fbee: No bootstrap required, opened a new log
I20260811 05:08:01.209239 3454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:01.203403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50654 (local address 127.26.191.254:39221)
0811 05:08:01.203641 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:01.203650 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:01.203681 (+ 31us) server_negotiation.cc:407] Connection header received
0811 05:08:01.204312 (+ 631us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:01.204320 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:01.204394 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:01.204586 (+ 192us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:01.204877 (+ 291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:01.205835 (+ 958us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:01.206800 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:01.207341 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:01.207522 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:01.208436 (+ 914us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:01.208441 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:01.208441 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:08:01.208619 (+ 178us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:01.208655 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:08:01.208667 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:01.208888 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:01.208975 (+ 87us) server_negotiation.cc:299] Negotiation successful
0811 05:08:01.209067 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":160,"thread_start_us":90,"threads_started":1}
I20260811 05:08:01.210340 27391 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 05:08:01.210507 3451 raft_consensus.cc:348] T 00000000000000000000000000000000 P b3936c4e4d09402aa67eeb350f42fbee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3936c4e4d09402aa67eeb350f42fbee" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 39221 } }
I20260811 05:08:01.210680 3451 raft_consensus.cc:374] T 00000000000000000000000000000000 P b3936c4e4d09402aa67eeb350f42fbee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:08:01.210753 3451 raft_consensus.cc:729] T 00000000000000000000000000000000 P b3936c4e4d09402aa67eeb350f42fbee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3936c4e4d09402aa67eeb350f42fbee, State: Initialized, Role: FOLLOWER
I20260811 05:08:01.210929 3451 consensus_queue.cc:260] T 00000000000000000000000000000000 P b3936c4e4d09402aa67eeb350f42fbee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3936c4e4d09402aa67eeb350f42fbee" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 39221 } }
I20260811 05:08:01.211033 3451 raft_consensus.cc:388] T 00000000000000000000000000000000 P b3936c4e4d09402aa67eeb350f42fbee [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:08:01.211084 3451 raft_consensus.cc:482] T 00000000000000000000000000000000 P b3936c4e4d09402aa67eeb350f42fbee [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:08:01.211146 3451 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b3936c4e4d09402aa67eeb350f42fbee [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:08:01.211871 3451 raft_consensus.cc:504] T 00000000000000000000000000000000 P b3936c4e4d09402aa67eeb350f42fbee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3936c4e4d09402aa67eeb350f42fbee" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 39221 } }
I20260811 05:08:01.211966 3451 leader_election.cc:302] T 00000000000000000000000000000000 P b3936c4e4d09402aa67eeb350f42fbee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b3936c4e4d09402aa67eeb350f42fbee; no voters:
I20260811 05:08:01.212133 3451 leader_election.cc:288] T 00000000000000000000000000000000 P b3936c4e4d09402aa67eeb350f42fbee [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 05:08:01.212172 3458 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b3936c4e4d09402aa67eeb350f42fbee [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:08:01.212289 3458 raft_consensus.cc:686] T 00000000000000000000000000000000 P b3936c4e4d09402aa67eeb350f42fbee [term 1 LEADER]: Becoming Leader. State: Replica: b3936c4e4d09402aa67eeb350f42fbee, State: Running, Role: LEADER
I20260811 05:08:01.212379 3458 consensus_queue.cc:237] T 00000000000000000000000000000000 P b3936c4e4d09402aa67eeb350f42fbee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3936c4e4d09402aa67eeb350f42fbee" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 39221 } }
I20260811 05:08:01.212453 3451 sys_catalog.cc:564] T 00000000000000000000000000000000 P b3936c4e4d09402aa67eeb350f42fbee [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:08:01.212761 3458 sys_catalog.cc:455] T 00000000000000000000000000000000 P b3936c4e4d09402aa67eeb350f42fbee [sys.catalog]: SysCatalogTable state changed. Reason: New leader b3936c4e4d09402aa67eeb350f42fbee. Latest consensus state: current_term: 1 leader_uuid: "b3936c4e4d09402aa67eeb350f42fbee" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3936c4e4d09402aa67eeb350f42fbee" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 39221 } } }
I20260811 05:08:01.212824 3460 sys_catalog.cc:455] T 00000000000000000000000000000000 P b3936c4e4d09402aa67eeb350f42fbee [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b3936c4e4d09402aa67eeb350f42fbee" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3936c4e4d09402aa67eeb350f42fbee" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 39221 } } }
I20260811 05:08:01.212841 3458 sys_catalog.cc:458] T 00000000000000000000000000000000 P b3936c4e4d09402aa67eeb350f42fbee [sys.catalog]: This master's current role is: LEADER
I20260811 05:08:01.213002 3460 sys_catalog.cc:458] T 00000000000000000000000000000000 P b3936c4e4d09402aa67eeb350f42fbee [sys.catalog]: This master's current role is: LEADER
I20260811 05:08:01.213245 3473 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:08:01.213814 3473 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:08:01.215664 3473 catalog_manager.cc:1347] Generated new cluster ID: 567d885571d147a3a2609a882716fecd
I20260811 05:08:01.215794 3473 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:08:01.237015 3473 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:08:01.237615 3473 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:08:01.242825 3473 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b3936c4e4d09402aa67eeb350f42fbee: Generated new TSK 0
I20260811 05:08:01.243052 3473 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260811 05:08:01.266044 3499 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260811 05:08:01.266152 3499 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260811 05:08:01.266572 3454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:01.249252 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50668 (local address 127.26.191.254:39221)
0811 05:08:01.249316 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:01.249319 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:01.249419 (+ 100us) server_negotiation.cc:407] Connection header received
0811 05:08:01.249517 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:01.249518 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:01.249530 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:01.249597 (+ 67us) server_negotiation.cc:226] Negotiated authn=JWT
0811 05:08:01.249771 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:01.250316 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:01.251511 (+ 1195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:01.251740 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:01.251811 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:01.252026 (+ 215us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 05:08:01.266328 (+ 14302us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41573/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0811 05:08:01.266497 (+ 169us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:50668: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41573/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":36}
W20260811 05:08:01.266659 3454 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:50668: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41573/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260811 05:08:01.266798 3498 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:08:01.249166 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:39221 (local address 127.0.0.1:50668)
0811 05:08:01.249353 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:01.249365 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:01.249442 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:01.249622 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:01.249623 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:01.249625 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0811 05:08:01.249703 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:01.249705 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:01.250399 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:01.250400 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:01.251413 (+ 1013us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:01.251416 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:01.251838 (+ 422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:01.251839 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:01.251914 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:01.251921 (+ 7us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 05:08:01.266489 (+ 14568us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41573/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0811 05:08:01.266661 (+ 172us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.26.191.254:39221: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41573/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":110,"threads_started":1}
I20260811 05:08:01.267242 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 3345
2026-08-11T05:08:01Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (264 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260811 05:08:01.320042 27391 mini_oidc.cc:152] Starting JWKS server
I20260811 05:08:01.320930 27391 webserver.cc:460] Webserver started at https://127.0.0.1:40985/ using document root <none> and password file <none>
I20260811 05:08:01.321012 27391 mini_oidc.cc:189] Starting OIDC Discovery server
I20260811 05:08:01.321206 27391 webserver.cc:460] Webserver started at http://127.0.0.1:41929/ using document root <none> and password file <none>
2026-08-11T05:08:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:08:01Z Disabled control of system clock
I20260811 05:08:01.336377 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786424853995437-27391-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786424853995437-27391-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786424853995437-27391-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.254:44847
--webserver_interface=127.26.191.254
--webserver_port=0
--builtin_ntp_servers=127.26.191.212:39235
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.191.254:44847
--enable_jwt_token_auth=true
--jwks_url=https://localhost:40985/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260811 05:08:01.457796 3510 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:08:01.458057 3510 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:08:01.458086 3510 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:08:01.459493 3510 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:08:01.459543 3510 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:08:01.459558 3510 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:08:01.459573 3510 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:08:01.459586 3510 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 05:08:01.459645 3510 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 05:08:01.459664 3510 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:40985/jwks.json
I20260811 05:08:01.461400 3510 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:39235
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786424853995437-27391-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786424853995437-27391-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.191.254:44847
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.254:44847
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:40985/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.191.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3510
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786424853995437-27391-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:08:01.461716 3510 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:08:01.462073 3510 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:08:01.467900 3520 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:01.467900 3518 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:01.467907 3523 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:08:01.468688 3510 server_base.cc:1034] running on GCE node
I20260811 05:08:01.469139 3510 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:08:01.469511 3510 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:08:01.470713 3510 hybrid_clock.cc:648] HybridClock initialized: now 1786424881470698 us; error 37 us; skew 500 ppm
I20260811 05:08:01.472424 3510 webserver.cc:460] Webserver started at http://127.26.191.254:45491/ using document root <none> and password file <none>
I20260811 05:08:01.472815 3510 fs_manager.cc:359] Metadata directory not provided
I20260811 05:08:01.472896 3510 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:08:01.473073 3510 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:08:01.474283 3510 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786424853995437-27391-0/minicluster-data/master-0/data/instance:
uuid: "988062a746db4ab2ad20c2c76f03cf00"
format_stamp: "Formatted at 2026-08-11 05:08:01 on dist-test-slave-x5fp"
server_key: "b4639e39fb33661f4e1605f17c8dd133"
server_key_iv: "ddd5cafe94d8ec80fa285163bf1537dc"
server_key_version: "encryptionkey@0"
I20260811 05:08:01.474689 3510 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786424853995437-27391-0/minicluster-data/master-0/wal/instance:
uuid: "988062a746db4ab2ad20c2c76f03cf00"
format_stamp: "Formatted at 2026-08-11 05:08:01 on dist-test-slave-x5fp"
server_key: "b4639e39fb33661f4e1605f17c8dd133"
server_key_iv: "ddd5cafe94d8ec80fa285163bf1537dc"
server_key_version: "encryptionkey@0"
I20260811 05:08:01.476203 3510 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 05:08:01.477216 3531 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:01.477468 3510 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 05:08:01.477591 3510 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786424853995437-27391-0/minicluster-data/master-0/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786424853995437-27391-0/minicluster-data/master-0/wal
uuid: "988062a746db4ab2ad20c2c76f03cf00"
format_stamp: "Formatted at 2026-08-11 05:08:01 on dist-test-slave-x5fp"
server_key: "b4639e39fb33661f4e1605f17c8dd133"
server_key_iv: "ddd5cafe94d8ec80fa285163bf1537dc"
server_key_version: "encryptionkey@0"
I20260811 05:08:01.477681 3510 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786424853995437-27391-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786424853995437-27391-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786424853995437-27391-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:08:01.495747 3510 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:08:01.496131 3510 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:08:01.496299 3510 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:08:01.501783 3510 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.254:44847
I20260811 05:08:01.501850 3613 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.254:44847 every 8 connection(s)
I20260811 05:08:01.502236 3510 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
I20260811 05:08:01.503203 3615 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:08:01.504594 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 3510
I20260811 05:08:01.504726 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786424853995437-27391-0/minicluster-data/master-0/wal/instance
I20260811 05:08:01.504985 27391 external_mini_cluster.cc:1428] Setting key 9e49b413d1194c35643c2fdb56a7fb19
I20260811 05:08:01.508191 3615 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 988062a746db4ab2ad20c2c76f03cf00: Bootstrap starting.
I20260811 05:08:01.509260 3615 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 988062a746db4ab2ad20c2c76f03cf00: Neither blocks nor log segments found. Creating new log.
I20260811 05:08:01.509650 3615 log.cc:824] T 00000000000000000000000000000000 P 988062a746db4ab2ad20c2c76f03cf00: Log is configured to *not* fsync() on all Append() calls
I20260811 05:08:01.510816 3615 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 988062a746db4ab2ad20c2c76f03cf00: No bootstrap required, opened a new log
I20260811 05:08:01.511758 3618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:01.505627 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59064 (local address 127.26.191.254:44847)
0811 05:08:01.506077 (+ 450us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:01.506086 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:01.506114 (+ 28us) server_negotiation.cc:407] Connection header received
0811 05:08:01.506592 (+ 478us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:01.506598 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:01.506770 (+ 172us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:01.506992 (+ 222us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:01.507245 (+ 253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:01.508206 (+ 961us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:01.509233 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:01.509881 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:01.510070 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:01.510971 (+ 901us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:01.510976 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:01.510977 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:08:01.511173 (+ 196us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:01.511208 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:08:01.511220 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:01.511307 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:01.511389 (+ 82us) server_negotiation.cc:299] Negotiation successful
0811 05:08:01.511578 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":368,"thread_start_us":202,"threads_started":1}
I20260811 05:08:01.512825 27391 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 05:08:01.513983 3615 raft_consensus.cc:348] T 00000000000000000000000000000000 P 988062a746db4ab2ad20c2c76f03cf00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "988062a746db4ab2ad20c2c76f03cf00" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 44847 } }
I20260811 05:08:01.514206 3615 raft_consensus.cc:374] T 00000000000000000000000000000000 P 988062a746db4ab2ad20c2c76f03cf00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:08:01.514250 3615 raft_consensus.cc:729] T 00000000000000000000000000000000 P 988062a746db4ab2ad20c2c76f03cf00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 988062a746db4ab2ad20c2c76f03cf00, State: Initialized, Role: FOLLOWER
I20260811 05:08:01.514400 3615 consensus_queue.cc:260] T 00000000000000000000000000000000 P 988062a746db4ab2ad20c2c76f03cf00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "988062a746db4ab2ad20c2c76f03cf00" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 44847 } }
I20260811 05:08:01.514498 3615 raft_consensus.cc:388] T 00000000000000000000000000000000 P 988062a746db4ab2ad20c2c76f03cf00 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:08:01.514536 3615 raft_consensus.cc:482] T 00000000000000000000000000000000 P 988062a746db4ab2ad20c2c76f03cf00 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:08:01.514597 3615 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 988062a746db4ab2ad20c2c76f03cf00 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:08:01.515625 3615 raft_consensus.cc:504] T 00000000000000000000000000000000 P 988062a746db4ab2ad20c2c76f03cf00 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "988062a746db4ab2ad20c2c76f03cf00" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 44847 } }
I20260811 05:08:01.515908 3615 leader_election.cc:302] T 00000000000000000000000000000000 P 988062a746db4ab2ad20c2c76f03cf00 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 988062a746db4ab2ad20c2c76f03cf00; no voters:
I20260811 05:08:01.516191 3615 leader_election.cc:288] T 00000000000000000000000000000000 P 988062a746db4ab2ad20c2c76f03cf00 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 05:08:01.516247 3620 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 988062a746db4ab2ad20c2c76f03cf00 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:08:01.516469 3620 raft_consensus.cc:686] T 00000000000000000000000000000000 P 988062a746db4ab2ad20c2c76f03cf00 [term 1 LEADER]: Becoming Leader. State: Replica: 988062a746db4ab2ad20c2c76f03cf00, State: Running, Role: LEADER
I20260811 05:08:01.516546 3615 sys_catalog.cc:564] T 00000000000000000000000000000000 P 988062a746db4ab2ad20c2c76f03cf00 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:08:01.516573 3620 consensus_queue.cc:237] T 00000000000000000000000000000000 P 988062a746db4ab2ad20c2c76f03cf00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "988062a746db4ab2ad20c2c76f03cf00" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 44847 } }
I20260811 05:08:01.517004 3626 sys_catalog.cc:455] T 00000000000000000000000000000000 P 988062a746db4ab2ad20c2c76f03cf00 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "988062a746db4ab2ad20c2c76f03cf00" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "988062a746db4ab2ad20c2c76f03cf00" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 44847 } } }
I20260811 05:08:01.517014 3627 sys_catalog.cc:455] T 00000000000000000000000000000000 P 988062a746db4ab2ad20c2c76f03cf00 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 988062a746db4ab2ad20c2c76f03cf00. Latest consensus state: current_term: 1 leader_uuid: "988062a746db4ab2ad20c2c76f03cf00" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "988062a746db4ab2ad20c2c76f03cf00" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 44847 } } }
I20260811 05:08:01.517138 3626 sys_catalog.cc:458] T 00000000000000000000000000000000 P 988062a746db4ab2ad20c2c76f03cf00 [sys.catalog]: This master's current role is: LEADER
I20260811 05:08:01.517146 3627 sys_catalog.cc:458] T 00000000000000000000000000000000 P 988062a746db4ab2ad20c2c76f03cf00 [sys.catalog]: This master's current role is: LEADER
I20260811 05:08:01.517428 3635 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:08:01.518002 3635 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:08:01.519740 3635 catalog_manager.cc:1347] Generated new cluster ID: bdb20060ccd246989992294822726f7b
I20260811 05:08:01.519816 3635 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:08:01.530395 3635 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:08:01.531205 3635 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:08:01.541425 3635 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 988062a746db4ab2ad20c2c76f03cf00: Generated new TSK 0
I20260811 05:08:01.541736 3635 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 05:08:01.557488 3618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:01.552563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59074 (local address 127.26.191.254:44847)
0811 05:08:01.552613 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:01.552615 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:01.552710 (+ 95us) server_negotiation.cc:407] Connection header received
0811 05:08:01.552828 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:01.552829 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:01.552845 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:01.552933 (+ 88us) server_negotiation.cc:226] Negotiated authn=JWT
0811 05:08:01.553116 (+ 183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:01.554051 (+ 935us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:01.555259 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:01.555637 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:01.555722 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:01.555956 (+ 234us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 05:08:01.557201 (+ 1245us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40985/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0811 05:08:01.557366 (+ 165us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:59074: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40985/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":28}
W20260811 05:08:01.557577 3618 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:59074: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40985/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260811 05:08:01.560571 3660 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:08:01.552440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:44847 (local address 127.0.0.1:59074)
0811 05:08:01.552615 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:01.552627 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:01.552747 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:01.552949 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:01.552950 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:01.552952 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0811 05:08:01.553026 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:01.553029 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:01.554148 (+ 1119us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:01.554149 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:01.555154 (+ 1005us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:01.555157 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:01.555741 (+ 584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:01.555742 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:01.555820 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:01.555828 (+ 8us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 05:08:01.557758 (+ 1930us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40985/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0811 05:08:01.560429 (+ 2671us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.26.191.254:44847: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40985/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":142,"mutex_wait_us":2402,"thread_start_us":105,"threads_started":1}
I20260811 05:08:01.561184 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 3510
E20260811 05:08:01.571643 3661 webserver.cc:533] Webserver: sslize failed:
E20260811 05:08:01.571811 3661 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-11T05:08:01Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (287 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-11T05:08:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:08:01Z Disabled control of system clock
I20260811 05:08:01.617550 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786424853995437-27391-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786424853995437-27391-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786424853995437-27391-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.254:41223
--webserver_interface=127.26.191.254
--webserver_port=0
--builtin_ntp_servers=127.26.191.212:43949
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.191.254:41223
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786424853995437-27391-0/testchainca.cert with env {}
W20260811 05:08:01.706305 3671 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:08:01.706611 3671 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:08:01.706662 3671 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:08:01.708055 3671 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:08:01.708130 3671 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:08:01.708153 3671 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:08:01.708175 3671 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:08:01.708211 3671 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 05:08:01.708246 3671 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 05:08:01.708276 3671 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260811 05:08:01.710045 3671 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:43949
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786424853995437-27391-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786424853995437-27391-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.191.254:41223
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.254:41223
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.191.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786424853995437-27391-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3671
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786424853995437-27391-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:08:01.710368 3671 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:08:01.710629 3671 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:08:01.716747 3677 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:01.716697 3681 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:08:01.717048 3671 server_base.cc:1034] running on GCE node
W20260811 05:08:01.717131 3679 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:08:01.717430 3671 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:08:01.717782 3671 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:08:01.719060 3671 hybrid_clock.cc:648] HybridClock initialized: now 1786424881718957 us; error 57 us; skew 500 ppm
I20260811 05:08:01.720599 3671 webserver.cc:460] Webserver started at http://127.26.191.254:41357/ using document root <none> and password file <none>
I20260811 05:08:01.720952 3671 fs_manager.cc:359] Metadata directory not provided
I20260811 05:08:01.721045 3671 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:08:01.721207 3671 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:08:01.722443 3671 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786424853995437-27391-0/minicluster-data/master-0/data/instance:
uuid: "44d78d0d49de4c17bf8c08c8659e9404"
format_stamp: "Formatted at 2026-08-11 05:08:01 on dist-test-slave-x5fp"
server_key: "28a064af9e779a858263d450e452aac5"
server_key_iv: "af30d00ac1320eaed4a30e1c138b8bc7"
server_key_version: "encryptionkey@0"
I20260811 05:08:01.722837 3671 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786424853995437-27391-0/minicluster-data/master-0/wal/instance:
uuid: "44d78d0d49de4c17bf8c08c8659e9404"
format_stamp: "Formatted at 2026-08-11 05:08:01 on dist-test-slave-x5fp"
server_key: "28a064af9e779a858263d450e452aac5"
server_key_iv: "af30d00ac1320eaed4a30e1c138b8bc7"
server_key_version: "encryptionkey@0"
I20260811 05:08:01.724359 3671 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 05:08:01.726323 3690 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:01.726572 3671 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.000s
I20260811 05:08:01.726706 3671 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786424853995437-27391-0/minicluster-data/master-0/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786424853995437-27391-0/minicluster-data/master-0/wal
uuid: "44d78d0d49de4c17bf8c08c8659e9404"
format_stamp: "Formatted at 2026-08-11 05:08:01 on dist-test-slave-x5fp"
server_key: "28a064af9e779a858263d450e452aac5"
server_key_iv: "af30d00ac1320eaed4a30e1c138b8bc7"
server_key_version: "encryptionkey@0"
I20260811 05:08:01.726810 3671 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786424853995437-27391-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786424853995437-27391-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786424853995437-27391-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:08:01.736323 3671 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:08:01.736843 3671 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:08:01.737025 3671 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:08:01.741353 3671 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.254:41223
I20260811 05:08:01.741448 3782 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.254:41223 every 8 connection(s)
I20260811 05:08:01.741804 3671 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
I20260811 05:08:01.742838 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 3671
I20260811 05:08:01.742863 3784 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:08:01.742995 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786424853995437-27391-0/minicluster-data/master-0/wal/instance
I20260811 05:08:01.743191 27391 external_mini_cluster.cc:1428] Setting key 028a4e85b45db0afa849fe7ace7880ef
I20260811 05:08:01.746714 3784 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 44d78d0d49de4c17bf8c08c8659e9404: Bootstrap starting.
I20260811 05:08:01.747462 3784 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 44d78d0d49de4c17bf8c08c8659e9404: Neither blocks nor log segments found. Creating new log.
I20260811 05:08:01.747769 3784 log.cc:824] T 00000000000000000000000000000000 P 44d78d0d49de4c17bf8c08c8659e9404: Log is configured to *not* fsync() on all Append() calls
I20260811 05:08:01.748631 3784 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 44d78d0d49de4c17bf8c08c8659e9404: No bootstrap required, opened a new log
I20260811 05:08:01.749771 3790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:01.743854 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50482 (local address 127.26.191.254:41223)
0811 05:08:01.744092 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:01.744101 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:01.744136 (+ 35us) server_negotiation.cc:407] Connection header received
0811 05:08:01.744673 (+ 537us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:01.744684 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:01.744830 (+ 146us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:01.744989 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:01.745205 (+ 216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:01.746583 (+ 1378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:01.747426 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:01.748058 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:01.748153 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:01.749023 (+ 870us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:01.749028 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:01.749028 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:08:01.749247 (+ 219us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:01.749290 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:08:01.749306 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:01.749378 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:01.749452 (+ 74us) server_negotiation.cc:299] Negotiation successful
0811 05:08:01.749537 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":153,"thread_start_us":83,"threads_started":1}
I20260811 05:08:01.751062 27391 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 05:08:01.751327 3784 raft_consensus.cc:348] T 00000000000000000000000000000000 P 44d78d0d49de4c17bf8c08c8659e9404 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44d78d0d49de4c17bf8c08c8659e9404" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 41223 } }
I20260811 05:08:01.751497 3784 raft_consensus.cc:374] T 00000000000000000000000000000000 P 44d78d0d49de4c17bf8c08c8659e9404 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:08:01.751536 3784 raft_consensus.cc:729] T 00000000000000000000000000000000 P 44d78d0d49de4c17bf8c08c8659e9404 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44d78d0d49de4c17bf8c08c8659e9404, State: Initialized, Role: FOLLOWER
I20260811 05:08:01.751672 3784 consensus_queue.cc:260] T 00000000000000000000000000000000 P 44d78d0d49de4c17bf8c08c8659e9404 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44d78d0d49de4c17bf8c08c8659e9404" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 41223 } }
I20260811 05:08:01.751746 3784 raft_consensus.cc:388] T 00000000000000000000000000000000 P 44d78d0d49de4c17bf8c08c8659e9404 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:08:01.751788 3784 raft_consensus.cc:482] T 00000000000000000000000000000000 P 44d78d0d49de4c17bf8c08c8659e9404 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:08:01.751837 3784 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 44d78d0d49de4c17bf8c08c8659e9404 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:08:01.752431 3784 raft_consensus.cc:504] T 00000000000000000000000000000000 P 44d78d0d49de4c17bf8c08c8659e9404 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44d78d0d49de4c17bf8c08c8659e9404" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 41223 } }
I20260811 05:08:01.752527 3784 leader_election.cc:302] T 00000000000000000000000000000000 P 44d78d0d49de4c17bf8c08c8659e9404 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 44d78d0d49de4c17bf8c08c8659e9404; no voters:
I20260811 05:08:01.752710 3784 leader_election.cc:288] T 00000000000000000000000000000000 P 44d78d0d49de4c17bf8c08c8659e9404 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 05:08:01.752873 3795 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 44d78d0d49de4c17bf8c08c8659e9404 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:08:01.753043 3784 sys_catalog.cc:564] T 00000000000000000000000000000000 P 44d78d0d49de4c17bf8c08c8659e9404 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:08:01.753048 3795 raft_consensus.cc:686] T 00000000000000000000000000000000 P 44d78d0d49de4c17bf8c08c8659e9404 [term 1 LEADER]: Becoming Leader. State: Replica: 44d78d0d49de4c17bf8c08c8659e9404, State: Running, Role: LEADER
I20260811 05:08:01.753191 3795 consensus_queue.cc:237] T 00000000000000000000000000000000 P 44d78d0d49de4c17bf8c08c8659e9404 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44d78d0d49de4c17bf8c08c8659e9404" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 41223 } }
I20260811 05:08:01.753575 3798 sys_catalog.cc:455] T 00000000000000000000000000000000 P 44d78d0d49de4c17bf8c08c8659e9404 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "44d78d0d49de4c17bf8c08c8659e9404" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44d78d0d49de4c17bf8c08c8659e9404" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 41223 } } }
I20260811 05:08:01.753687 3798 sys_catalog.cc:458] T 00000000000000000000000000000000 P 44d78d0d49de4c17bf8c08c8659e9404 [sys.catalog]: This master's current role is: LEADER
I20260811 05:08:01.753574 3799 sys_catalog.cc:455] T 00000000000000000000000000000000 P 44d78d0d49de4c17bf8c08c8659e9404 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 44d78d0d49de4c17bf8c08c8659e9404. Latest consensus state: current_term: 1 leader_uuid: "44d78d0d49de4c17bf8c08c8659e9404" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44d78d0d49de4c17bf8c08c8659e9404" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 41223 } } }
I20260811 05:08:01.753871 3799 sys_catalog.cc:458] T 00000000000000000000000000000000 P 44d78d0d49de4c17bf8c08c8659e9404 [sys.catalog]: This master's current role is: LEADER
I20260811 05:08:01.753999 3807 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:08:01.754585 3807 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:08:01.756289 3807 catalog_manager.cc:1347] Generated new cluster ID: a1a673d9505a497995b1960c8aeeafb5
I20260811 05:08:01.756351 3807 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:08:01.776682 3807 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:08:01.777336 3807 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:08:01.783350 3807 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 44d78d0d49de4c17bf8c08c8659e9404: Generated new TSK 0
I20260811 05:08:01.783564 3807 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 05:08:02.685606 3790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:01.797995 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50492 (local address 127.26.191.254:41223)
0811 05:08:01.798072 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:01.798074 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:01.798184 (+ 110us) server_negotiation.cc:407] Connection header received
0811 05:08:01.798233 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:01.798234 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:01.798249 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:01.798338 (+ 89us) server_negotiation.cc:226] Negotiated authn=JWT
0811 05:08:01.798505 (+ 167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:01.799321 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:01.800199 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:01.800529 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:01.800602 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:01.801002 (+ 400us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 05:08:02.685335 (+884333us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0811 05:08:02.685532 (+ 197us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:50492: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":50}
W20260811 05:08:02.685705 3790 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:50492: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260811 05:08:02.685889 3830 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:08:01.797893 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:41223 (local address 127.0.0.1:50492)
0811 05:08:01.798106 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:01.798117 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:01.798176 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:01.798363 (+ 187us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:01.798364 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:01.798366 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0811 05:08:01.798425 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:01.798427 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:01.799455 (+ 1028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:01.799456 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:01.800091 (+ 635us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:01.800094 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:01.800817 (+ 723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:01.800818 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:01.800870 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:01.800876 (+ 6us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 05:08:02.685539 (+884663us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0811 05:08:02.685684 (+ 145us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.26.191.254:41223: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":126,"threads_started":1}
I20260811 05:08:02.686389 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 3671
2026-08-11T05:08:02Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (1109 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (98 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (96 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 05:08:02 dist-test-slave-x5fp krb5kdc[3848](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 05:08:02 dist-test-slave-x5fp krb5kdc[3848](info): set up 2 sockets
Aug 11 05:08:02 dist-test-slave-x5fp krb5kdc[3848](info): commencing operation
krb5kdc: starting...
W20260811 05:08:04.183066 27391 mini_kdc.cc:121] Time spent starting KDC: real 1.272s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/krb5kdc/test-user.keytab.
Aug 11 05:08:04 dist-test-slave-x5fp krb5kdc[3848](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424884, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T05:08:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:08:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.191.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.191.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.191.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab.
Entry for principal kudu/127.26.191.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab.
I20260811 05:08:04.328477 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.254:36903
--webserver_interface=127.26.191.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab
--principal=kudu/127.26.191.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:46265
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.191.254:36903
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:08:04.416668 3873 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:08:04.416981 3873 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:08:04.417024 3873 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:08:04.418244 3873 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:08:04.418315 3873 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:08:04.418340 3873 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:08:04.418375 3873 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:08:04.418422 3873 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:08:04.419962 3873 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:46265
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.191.254:36903
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab
--principal=kudu/127.26.191.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.254:36903
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.191.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3873
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:08:04.420279 3873 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:08:04.420526 3873 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:08:04.425751 3881 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:04.425768 3886 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:04.425763 3882 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:08:04.425940 3873 server_base.cc:1034] running on GCE node
I20260811 05:08:04.426308 3873 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:08:04.426640 3873 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:08:04.427791 3873 hybrid_clock.cc:648] HybridClock initialized: now 1786424884427764 us; error 40 us; skew 500 ppm
Aug 11 05:08:04 dist-test-slave-x5fp krb5kdc[3848](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424884, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:08:04.430464 3873 init.cc:377] Logged in from keytab as kudu/127.26.191.254@KRBTEST.COM (short username kudu)
I20260811 05:08:04.430979 3873 webserver.cc:460] Webserver started at http://127.26.191.254:42305/ using document root <none> and password file <none>
I20260811 05:08:04.431232 3873 fs_manager.cc:359] Metadata directory not provided
I20260811 05:08:04.431310 3873 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:08:04.431466 3873 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:08:04.432555 3873 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/minicluster-data/master-0/data/instance:
uuid: "18888fcaaf0543c1a28197ff3a198af6"
format_stamp: "Formatted at 2026-08-11 05:08:04 on dist-test-slave-x5fp"
server_key: "f4c76a2ab82039bf1f318bfd80148ad5"
server_key_iv: "ed89886a7acff92f64257d13b720ad51"
server_key_version: "encryptionkey@0"
I20260811 05:08:04.432966 3873 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/minicluster-data/master-0/wal/instance:
uuid: "18888fcaaf0543c1a28197ff3a198af6"
format_stamp: "Formatted at 2026-08-11 05:08:04 on dist-test-slave-x5fp"
server_key: "f4c76a2ab82039bf1f318bfd80148ad5"
server_key_iv: "ed89886a7acff92f64257d13b720ad51"
server_key_version: "encryptionkey@0"
I20260811 05:08:04.434333 3873 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:08:04.435139 3897 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:04.435393 3873 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:08:04.435509 3873 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/minicluster-data/master-0/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/minicluster-data/master-0/wal
uuid: "18888fcaaf0543c1a28197ff3a198af6"
format_stamp: "Formatted at 2026-08-11 05:08:04 on dist-test-slave-x5fp"
server_key: "f4c76a2ab82039bf1f318bfd80148ad5"
server_key_iv: "ed89886a7acff92f64257d13b720ad51"
server_key_version: "encryptionkey@0"
I20260811 05:08:04.435587 3873 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:08:04.451572 3873 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:08:04.454169 3873 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:08:04.454361 3873 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:08:04.458794 3873 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.254:36903
I20260811 05:08:04.458842 3972 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.254:36903 every 8 connection(s)
I20260811 05:08:04.459264 3873 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
I20260811 05:08:04.460282 3974 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:08:04.462761 3974 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 18888fcaaf0543c1a28197ff3a198af6: Bootstrap starting.
I20260811 05:08:04.463383 3974 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 18888fcaaf0543c1a28197ff3a198af6: Neither blocks nor log segments found. Creating new log.
I20260811 05:08:04.463645 3974 log.cc:824] T 00000000000000000000000000000000 P 18888fcaaf0543c1a28197ff3a198af6: Log is configured to *not* fsync() on all Append() calls
I20260811 05:08:04.464453 3974 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 18888fcaaf0543c1a28197ff3a198af6: No bootstrap required, opened a new log
I20260811 05:08:04.465026 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 3873
I20260811 05:08:04.465158 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/minicluster-data/master-0/wal/instance
I20260811 05:08:04.465370 27391 external_mini_cluster.cc:1428] Setting key deed4000920a1395351ba1d7aa3ea0ff
I20260811 05:08:04.466845 3974 raft_consensus.cc:348] T 00000000000000000000000000000000 P 18888fcaaf0543c1a28197ff3a198af6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18888fcaaf0543c1a28197ff3a198af6" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 36903 } }
I20260811 05:08:04.467048 3974 raft_consensus.cc:374] T 00000000000000000000000000000000 P 18888fcaaf0543c1a28197ff3a198af6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:08:04.467094 3974 raft_consensus.cc:729] T 00000000000000000000000000000000 P 18888fcaaf0543c1a28197ff3a198af6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18888fcaaf0543c1a28197ff3a198af6, State: Initialized, Role: FOLLOWER
I20260811 05:08:04.467319 3974 consensus_queue.cc:260] T 00000000000000000000000000000000 P 18888fcaaf0543c1a28197ff3a198af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18888fcaaf0543c1a28197ff3a198af6" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 36903 } }
I20260811 05:08:04.467435 3974 raft_consensus.cc:388] T 00000000000000000000000000000000 P 18888fcaaf0543c1a28197ff3a198af6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:08:04.467486 3974 raft_consensus.cc:482] T 00000000000000000000000000000000 P 18888fcaaf0543c1a28197ff3a198af6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:08:04.467547 3974 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 18888fcaaf0543c1a28197ff3a198af6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:08:04.468796 3974 raft_consensus.cc:504] T 00000000000000000000000000000000 P 18888fcaaf0543c1a28197ff3a198af6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18888fcaaf0543c1a28197ff3a198af6" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 36903 } }
I20260811 05:08:04.468940 3974 leader_election.cc:302] T 00000000000000000000000000000000 P 18888fcaaf0543c1a28197ff3a198af6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 18888fcaaf0543c1a28197ff3a198af6; no voters:
I20260811 05:08:04.469172 3974 leader_election.cc:288] T 00000000000000000000000000000000 P 18888fcaaf0543c1a28197ff3a198af6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 05:08:04.469205 3983 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 18888fcaaf0543c1a28197ff3a198af6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:08:04.469398 3983 raft_consensus.cc:686] T 00000000000000000000000000000000 P 18888fcaaf0543c1a28197ff3a198af6 [term 1 LEADER]: Becoming Leader. State: Replica: 18888fcaaf0543c1a28197ff3a198af6, State: Running, Role: LEADER
I20260811 05:08:04.469559 3974 sys_catalog.cc:564] T 00000000000000000000000000000000 P 18888fcaaf0543c1a28197ff3a198af6 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:08:04.469553 3983 consensus_queue.cc:237] T 00000000000000000000000000000000 P 18888fcaaf0543c1a28197ff3a198af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18888fcaaf0543c1a28197ff3a198af6" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 36903 } }
I20260811 05:08:04.470067 3984 sys_catalog.cc:455] T 00000000000000000000000000000000 P 18888fcaaf0543c1a28197ff3a198af6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 18888fcaaf0543c1a28197ff3a198af6. Latest consensus state: current_term: 1 leader_uuid: "18888fcaaf0543c1a28197ff3a198af6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18888fcaaf0543c1a28197ff3a198af6" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 36903 } } }
I20260811 05:08:04.470172 3984 sys_catalog.cc:458] T 00000000000000000000000000000000 P 18888fcaaf0543c1a28197ff3a198af6 [sys.catalog]: This master's current role is: LEADER
I20260811 05:08:04.470449 3985 sys_catalog.cc:455] T 00000000000000000000000000000000 P 18888fcaaf0543c1a28197ff3a198af6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "18888fcaaf0543c1a28197ff3a198af6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18888fcaaf0543c1a28197ff3a198af6" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 36903 } } }
I20260811 05:08:04.470810 3985 sys_catalog.cc:458] T 00000000000000000000000000000000 P 18888fcaaf0543c1a28197ff3a198af6 [sys.catalog]: This master's current role is: LEADER
I20260811 05:08:04.470990 3993 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:08:04.471572 3993 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:08:04.473402 3993 catalog_manager.cc:1347] Generated new cluster ID: f3716f04d0ad4f48a5ff0abd19f1814a
I20260811 05:08:04.473457 3993 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 05:08:04 dist-test-slave-x5fp krb5kdc[3848](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424884, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
I20260811 05:08:04.478484 3981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:04.465978 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46356 (local address 127.26.191.254:36903)
0811 05:08:04.466188 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:04.466197 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:04.466223 (+ 26us) server_negotiation.cc:407] Connection header received
0811 05:08:04.466830 (+ 607us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:04.466839 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:04.466900 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:04.467067 (+ 167us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:04.468014 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:04.469149 (+ 1135us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:04.470150 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:04.470783 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:04.470890 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:04.474037 (+ 3147us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:04.474042 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:04.474042 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:08:04.474056 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:04.476318 (+ 2262us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:04.476760 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:04.476764 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:04.476765 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:04.476914 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:04.477143 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:04.477144 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:04.477145 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:04.477528 (+ 383us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:04.477722 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:04.477804 (+ 82us) server_negotiation.cc:299] Negotiation successful
0811 05:08:04.477970 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":105,"threads_started":1}
I20260811 05:08:04.483254 3993 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:08:04.484144 3993 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:08:04.490903 3993 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 18888fcaaf0543c1a28197ff3a198af6: Generated new TSK 0
I20260811 05:08:04.491139 3993 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.191.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.191.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.191.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.193.keytab.
Entry for principal kudu/127.26.191.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.193.keytab.
I20260811 05:08:04.528203 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.191.193:0
--local_ip_for_outbound_sockets=127.26.191.193
--webserver_interface=127.26.191.193
--webserver_port=0
--tserver_master_addrs=127.26.191.254:36903
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.193.keytab
--principal=kudu/127.26.191.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:46265
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:08:04.616215 4013 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:08:04.616449 4013 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:08:04.616475 4013 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:08:04.617728 4013 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:08:04.617780 4013 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:08:04.617810 4013 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.191.193
I20260811 05:08:04.619388 4013 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:46265
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.193.keytab
--principal=kudu/127.26.191.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.191.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.191.193
--webserver_port=0
--tserver_master_addrs=127.26.191.254:36903
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4013
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.191.193
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:08:04.619660 4013 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:08:04.619940 4013 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:08:04.625613 4020 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:08:04.625658 4013 server_base.cc:1034] running on GCE node
W20260811 05:08:04.625613 4024 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:04.625680 4022 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:08:04.626111 4013 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:08:04.626408 4013 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:08:04.627601 4013 hybrid_clock.cc:648] HybridClock initialized: now 1786424884627592 us; error 35 us; skew 500 ppm
Aug 11 05:08:04 dist-test-slave-x5fp krb5kdc[3848](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424884, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:08:04.630518 4013 init.cc:377] Logged in from keytab as kudu/127.26.191.193@KRBTEST.COM (short username kudu)
I20260811 05:08:04.631058 4013 webserver.cc:460] Webserver started at http://127.26.191.193:39287/ using document root <none> and password file <none>
I20260811 05:08:04.631336 4013 fs_manager.cc:359] Metadata directory not provided
I20260811 05:08:04.631413 4013 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:08:04.631583 4013 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:08:04.632788 4013 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/minicluster-data/ts-0/data/instance:
uuid: "46ddefba4f96441faf4d1befdb5fd388"
format_stamp: "Formatted at 2026-08-11 05:08:04 on dist-test-slave-x5fp"
server_key: "c8073e21ebf6dc82963249837c24d2ef"
server_key_iv: "565c80e07816b0ac29f7bc181e4ea102"
server_key_version: "encryptionkey@0"
I20260811 05:08:04.633203 4013 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/minicluster-data/ts-0/wal/instance:
uuid: "46ddefba4f96441faf4d1befdb5fd388"
format_stamp: "Formatted at 2026-08-11 05:08:04 on dist-test-slave-x5fp"
server_key: "c8073e21ebf6dc82963249837c24d2ef"
server_key_iv: "565c80e07816b0ac29f7bc181e4ea102"
server_key_version: "encryptionkey@0"
I20260811 05:08:04.634724 4013 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 05:08:04.635586 4034 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:04.635859 4013 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:08:04.635999 4013 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/minicluster-data/ts-0/wal
uuid: "46ddefba4f96441faf4d1befdb5fd388"
format_stamp: "Formatted at 2026-08-11 05:08:04 on dist-test-slave-x5fp"
server_key: "c8073e21ebf6dc82963249837c24d2ef"
server_key_iv: "565c80e07816b0ac29f7bc181e4ea102"
server_key_version: "encryptionkey@0"
I20260811 05:08:04.636091 4013 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:08:04.657460 4013 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:08:04.660337 4013 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:08:04.660547 4013 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:08:04.660934 4013 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:08:04.661334 4013 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:08:04.661397 4013 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:04.661450 4013 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:08:04.661489 4013 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:04.668704 4013 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.193:39041
I20260811 05:08:04.668809 4220 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.193:39041 every 8 connection(s)
I20260811 05:08:04.669176 4013 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/minicluster-data/ts-0/data/info.pb
I20260811 05:08:04.675050 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 4013
I20260811 05:08:04.675158 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/minicluster-data/ts-0/wal/instance
I20260811 05:08:04.675398 27391 external_mini_cluster.cc:1428] Setting key e22d140bc1dcf6a8bc1863a9560ef8c5
Aug 11 05:08:04 dist-test-slave-x5fp krb5kdc[3848](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424884, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.193@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
I20260811 05:08:04.680763 3981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:04.670040 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.193:45365 (local address 127.26.191.254:36903)
0811 05:08:04.670110 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:04.670113 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:04.670333 (+ 220us) server_negotiation.cc:407] Connection header received
0811 05:08:04.671410 (+ 1077us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:04.671411 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:04.671426 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:04.671483 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:04.672167 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:04.672761 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:04.673793 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:04.674016 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:04.674082 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:04.677143 (+ 3061us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:04.677144 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:04.677145 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:08:04.677157 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:04.679079 (+ 1922us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:04.679555 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:04.679556 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:04.679556 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:04.679622 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:04.679897 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:04.679898 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:04.679899 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:04.680068 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:04.680144 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:04.680474 (+ 330us) server_negotiation.cc:299] Negotiation successful
0811 05:08:04.680589 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 05:08:04.680886 4223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:04.670029 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:36903 (local address 127.26.191.193:45365)
0811 05:08:04.670202 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:04.670241 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:04.671310 (+ 1069us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:04.671578 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:04.671581 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:04.671850 (+ 269us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:04.672055 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:04.672059 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:04.672840 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:04.672841 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:04.673683 (+ 842us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:04.673686 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:04.674140 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:04.674142 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:04.674486 (+ 344us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:04.675208 (+ 722us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:04.675220 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:04.677027 (+ 1807us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:08:04.679199 (+ 2172us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:04.679208 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:04.679210 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:04.679472 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:04.679691 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:04.679691 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:04.679692 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:04.679816 (+ 124us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:04.680165 (+ 349us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:08:04.680173 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:08:04.680321 (+ 148us) client_negotiation.cc:769] Sending connection context
0811 05:08:04.680427 (+ 106us) client_negotiation.cc:240] Negotiation successful
0811 05:08:04.680573 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":103,"threads_started":1}
I20260811 05:08:04.681452 4221 heartbeater.cc:347] Connected to a master server at 127.26.191.254:36903
I20260811 05:08:04.681578 4221 heartbeater.cc:464] Registering TS with master...
I20260811 05:08:04.681823 4221 heartbeater.cc:511] Master 127.26.191.254:36903 requested a full tablet report, sending...
I20260811 05:08:04.682406 3919 ts_manager.cc:194] Registered new tserver with Master: 46ddefba4f96441faf4d1befdb5fd388 (127.26.191.193:39041)
I20260811 05:08:04.683089 3919 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.191.193@KRBTEST.COM'} at 127.26.191.193:45365
WARNING: no policy specified for kudu/127.26.191.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.191.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.191.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.194.keytab.
Entry for principal kudu/127.26.191.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.194.keytab.
I20260811 05:08:04.711730 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.191.194:0
--local_ip_for_outbound_sockets=127.26.191.194
--webserver_interface=127.26.191.194
--webserver_port=0
--tserver_master_addrs=127.26.191.254:36903
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.194.keytab
--principal=kudu/127.26.191.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:46265
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:08:04.796989 4227 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:08:04.797214 4227 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:08:04.797237 4227 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:08:04.798347 4227 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:08:04.798386 4227 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:08:04.798413 4227 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.191.194
I20260811 05:08:04.799872 4227 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:46265
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.194.keytab
--principal=kudu/127.26.191.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.191.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.191.194
--webserver_port=0
--tserver_master_addrs=127.26.191.254:36903
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4227
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.191.194
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:08:04.800082 4227 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:08:04.800282 4227 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:08:04.805675 4244 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:04.805751 4253 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:04.805675 4242 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:08:04.806087 4227 server_base.cc:1034] running on GCE node
I20260811 05:08:04.806340 4227 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:08:04.806646 4227 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:08:04.807845 4227 hybrid_clock.cc:648] HybridClock initialized: now 1786424884807813 us; error 68 us; skew 500 ppm
Aug 11 05:08:04 dist-test-slave-x5fp krb5kdc[3848](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424884, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:08:04.810683 4227 init.cc:377] Logged in from keytab as kudu/127.26.191.194@KRBTEST.COM (short username kudu)
I20260811 05:08:04.811137 4227 webserver.cc:460] Webserver started at http://127.26.191.194:39759/ using document root <none> and password file <none>
I20260811 05:08:04.811406 4227 fs_manager.cc:359] Metadata directory not provided
I20260811 05:08:04.811480 4227 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:08:04.811655 4227 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:08:04.812847 4227 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/minicluster-data/ts-1/data/instance:
uuid: "a796fcdea35e4b88ab9206c52c6e96ba"
format_stamp: "Formatted at 2026-08-11 05:08:04 on dist-test-slave-x5fp"
server_key: "1d3c7e1732552e830b2784a3f9853792"
server_key_iv: "4f554f2ce117edd045031c143e03359f"
server_key_version: "encryptionkey@0"
I20260811 05:08:04.813232 4227 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/minicluster-data/ts-1/wal/instance:
uuid: "a796fcdea35e4b88ab9206c52c6e96ba"
format_stamp: "Formatted at 2026-08-11 05:08:04 on dist-test-slave-x5fp"
server_key: "1d3c7e1732552e830b2784a3f9853792"
server_key_iv: "4f554f2ce117edd045031c143e03359f"
server_key_version: "encryptionkey@0"
I20260811 05:08:04.814631 4227 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 05:08:04.815459 4261 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:04.815641 4227 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:08:04.815755 4227 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/minicluster-data/ts-1/wal
uuid: "a796fcdea35e4b88ab9206c52c6e96ba"
format_stamp: "Formatted at 2026-08-11 05:08:04 on dist-test-slave-x5fp"
server_key: "1d3c7e1732552e830b2784a3f9853792"
server_key_iv: "4f554f2ce117edd045031c143e03359f"
server_key_version: "encryptionkey@0"
I20260811 05:08:04.815834 4227 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:08:04.823378 4227 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:08:04.825696 4227 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:08:04.825863 4227 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:08:04.826097 4227 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:08:04.826417 4227 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:08:04.826473 4227 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:04.826516 4227 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:08:04.826545 4227 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:04.832945 4227 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.194:36757
I20260811 05:08:04.833039 4446 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.194:36757 every 8 connection(s)
I20260811 05:08:04.833390 4227 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/minicluster-data/ts-1/data/info.pb
I20260811 05:08:04.838296 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 4227
I20260811 05:08:04.838425 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/minicluster-data/ts-1/wal/instance
I20260811 05:08:04.838631 27391 external_mini_cluster.cc:1428] Setting key 3716543d187f04a9210dae89d3af1db8
Aug 11 05:08:04 dist-test-slave-x5fp krb5kdc[3848](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424884, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.194@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
I20260811 05:08:04.844875 3981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:04.834359 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.194:48723 (local address 127.26.191.254:36903)
0811 05:08:04.834436 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:04.834438 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:04.834653 (+ 215us) server_negotiation.cc:407] Connection header received
0811 05:08:04.835718 (+ 1065us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:04.835719 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:04.835733 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:04.835787 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:04.836458 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:04.837059 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:04.838213 (+ 1154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:04.838541 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:04.838619 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:04.841466 (+ 2847us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:04.841467 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:04.841467 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:08:04.841475 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:04.843029 (+ 1554us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:04.843588 (+ 559us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:04.843589 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:04.843590 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:04.843664 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:04.844047 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:04.844049 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:04.844049 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:04.844186 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:04.844255 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:04.844626 (+ 371us) server_negotiation.cc:299] Negotiation successful
0811 05:08:04.844771 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 05:08:04.845157 4449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:04.834319 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:36903 (local address 127.26.191.194:48723)
0811 05:08:04.834522 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:04.834566 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:04.835590 (+ 1024us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:04.835861 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:04.835866 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:04.836147 (+ 281us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:04.836349 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:04.836353 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:04.837160 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:04.837161 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:04.838127 (+ 966us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:04.838130 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:04.838626 (+ 496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:04.838627 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:04.838822 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:04.839501 (+ 679us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:04.839510 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:04.841357 (+ 1847us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:08:04.843136 (+ 1779us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:04.843145 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:04.843149 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:04.843487 (+ 338us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:04.843744 (+ 257us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:04.843744 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:04.843745 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:04.843915 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:04.844266 (+ 351us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:08:04.844273 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:08:04.844459 (+ 186us) client_negotiation.cc:769] Sending connection context
0811 05:08:04.844579 (+ 120us) client_negotiation.cc:240] Negotiation successful
0811 05:08:04.844829 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":113,"threads_started":1}
I20260811 05:08:04.845709 4447 heartbeater.cc:347] Connected to a master server at 127.26.191.254:36903
I20260811 05:08:04.845840 4447 heartbeater.cc:464] Registering TS with master...
I20260811 05:08:04.846053 4447 heartbeater.cc:511] Master 127.26.191.254:36903 requested a full tablet report, sending...
I20260811 05:08:04.846529 3919 ts_manager.cc:194] Registered new tserver with Master: a796fcdea35e4b88ab9206c52c6e96ba (127.26.191.194:36757)
I20260811 05:08:04.846920 3919 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.191.194@KRBTEST.COM'} at 127.26.191.194:48723
WARNING: no policy specified for kudu/127.26.191.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.191.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.191.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.195.keytab.
Entry for principal kudu/127.26.191.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.195.keytab.
I20260811 05:08:04.873195 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.191.195:0
--local_ip_for_outbound_sockets=127.26.191.195
--webserver_interface=127.26.191.195
--webserver_port=0
--tserver_master_addrs=127.26.191.254:36903
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.195.keytab
--principal=kudu/127.26.191.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:46265
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:08:04.959839 4453 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:08:04.960058 4453 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:08:04.960083 4453 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:08:04.961288 4453 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:08:04.961333 4453 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:08:04.961359 4453 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.191.195
I20260811 05:08:04.962868 4453 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:46265
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.195.keytab
--principal=kudu/127.26.191.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.191.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.191.195
--webserver_port=0
--tserver_master_addrs=127.26.191.254:36903
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4453
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.191.195
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:08:04.963133 4453 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:08:04.963389 4453 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 05:08:04.968910 4453 server_base.cc:1034] running on GCE node
W20260811 05:08:04.968900 4462 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:04.968873 4466 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:04.968874 4468 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:08:04.969379 4453 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:08:04.969659 4453 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:08:04.970852 4453 hybrid_clock.cc:648] HybridClock initialized: now 1786424884970841 us; error 39 us; skew 500 ppm
Aug 11 05:08:04 dist-test-slave-x5fp krb5kdc[3848](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424884, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:08:04.973934 4453 init.cc:377] Logged in from keytab as kudu/127.26.191.195@KRBTEST.COM (short username kudu)
I20260811 05:08:04.974486 4453 webserver.cc:460] Webserver started at http://127.26.191.195:34167/ using document root <none> and password file <none>
I20260811 05:08:04.974736 4453 fs_manager.cc:359] Metadata directory not provided
I20260811 05:08:04.974808 4453 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:08:04.974969 4453 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:08:04.976111 4453 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/minicluster-data/ts-2/data/instance:
uuid: "388d45ac22994b6d97210132baaadba7"
format_stamp: "Formatted at 2026-08-11 05:08:04 on dist-test-slave-x5fp"
server_key: "6b7fadfec1e6fc509a59cad65eebfdb0"
server_key_iv: "1d80ac490f0e0fe64a9661a23a676bf8"
server_key_version: "encryptionkey@0"
I20260811 05:08:04.976524 4453 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/minicluster-data/ts-2/wal/instance:
uuid: "388d45ac22994b6d97210132baaadba7"
format_stamp: "Formatted at 2026-08-11 05:08:04 on dist-test-slave-x5fp"
server_key: "6b7fadfec1e6fc509a59cad65eebfdb0"
server_key_iv: "1d80ac490f0e0fe64a9661a23a676bf8"
server_key_version: "encryptionkey@0"
I20260811 05:08:04.978145 4453 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 05:08:04.979305 4478 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:04.979571 4453 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 05:08:04.979694 4453 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/minicluster-data/ts-2/wal
uuid: "388d45ac22994b6d97210132baaadba7"
format_stamp: "Formatted at 2026-08-11 05:08:04 on dist-test-slave-x5fp"
server_key: "6b7fadfec1e6fc509a59cad65eebfdb0"
server_key_iv: "1d80ac490f0e0fe64a9661a23a676bf8"
server_key_version: "encryptionkey@0"
I20260811 05:08:04.979775 4453 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:08:04.990795 4453 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:08:04.993875 4453 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:08:04.994081 4453 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:08:04.994379 4453 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:08:04.994755 4453 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:08:04.994797 4453 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:04.994853 4453 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:08:04.994887 4453 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:05.002255 4453 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.195:43173
I20260811 05:08:05.002297 4663 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.195:43173 every 8 connection(s)
I20260811 05:08:05.002697 4453 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/minicluster-data/ts-2/data/info.pb
Aug 11 05:08:05 dist-test-slave-x5fp krb5kdc[3848](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424884, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.195@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
I20260811 05:08:05.009871 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 4453
I20260811 05:08:05.010000 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/minicluster-data/ts-2/wal/instance
I20260811 05:08:05.010200 27391 external_mini_cluster.cc:1428] Setting key 415587d4ebccd67ab073e0fc74c1d79a
I20260811 05:08:05.013561 3981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:05.003633 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.195:49323 (local address 127.26.191.254:36903)
0811 05:08:05.003687 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:05.003688 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:05.003843 (+ 155us) server_negotiation.cc:407] Connection header received
0811 05:08:05.004848 (+ 1005us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:05.004849 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:05.004859 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:05.004925 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:05.005586 (+ 661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:05.006144 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:05.007300 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:05.007492 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:05.007553 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:05.010385 (+ 2832us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:05.010386 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:05.010387 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:08:05.010395 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:05.012047 (+ 1652us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:05.012518 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:05.012519 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:05.012519 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:05.012578 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:05.012925 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:05.012926 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:05.012927 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:05.013043 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:05.013101 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:05.013416 (+ 315us) server_negotiation.cc:299] Negotiation successful
0811 05:08:05.013491 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 05:08:05.013741 4666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:05.003519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:36903 (local address 127.26.191.195:49323)
0811 05:08:05.003696 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:05.003742 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:05.004700 (+ 958us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:05.005019 (+ 319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:05.005023 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:05.005300 (+ 277us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:05.005506 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:05.005510 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:05.006259 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:05.006260 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:05.007195 (+ 935us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:05.007199 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:05.007595 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:05.007596 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:05.007717 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:05.008315 (+ 598us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:05.008324 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:05.010230 (+ 1906us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:08:05.012135 (+ 1905us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:05.012142 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:05.012144 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:05.012442 (+ 298us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:05.012643 (+ 201us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:05.012644 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:05.012644 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:05.012829 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:05.013115 (+ 286us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:08:05.013121 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:08:05.013257 (+ 136us) client_negotiation.cc:769] Sending connection context
0811 05:08:05.013371 (+ 114us) client_negotiation.cc:240] Negotiation successful
0811 05:08:05.013510 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":99,"threads_started":1}
I20260811 05:08:05.014292 4664 heartbeater.cc:347] Connected to a master server at 127.26.191.254:36903
I20260811 05:08:05.014421 4664 heartbeater.cc:464] Registering TS with master...
I20260811 05:08:05.014626 4664 heartbeater.cc:511] Master 127.26.191.254:36903 requested a full tablet report, sending...
I20260811 05:08:05.015149 3919 ts_manager.cc:194] Registered new tserver with Master: 388d45ac22994b6d97210132baaadba7 (127.26.191.195:43173)
I20260811 05:08:05.015631 3919 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.191.195@KRBTEST.COM'} at 127.26.191.195:49323
I20260811 05:08:05.021981 27391 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/krb5kdc/test-admin.keytab.
Aug 11 05:08:05 dist-test-slave-x5fp krb5kdc[3848](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424885, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:08:05.043637 27391 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260811 05:08:05.046020 4677 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:08:05.044873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40534 (local address 127.26.191.193:39041)
0811 05:08:05.045105 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:05.045110 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:05.045122 (+ 12us) server_negotiation.cc:407] Connection header received
0811 05:08:05.045151 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:05.045153 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:05.045168 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:05.045288 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:05.045897 (+ 609us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40534: BlockingRecv error: recv got EOF from 127.0.0.1:40534 (error 108)
Metrics: {"server-negotiator.queue_time_us":184,"thread_start_us":105,"threads_started":1}
W20260811 05:08:05.046108 27391 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/krb5kdc/krb5cc' of type FILE
Aug 11 05:08:05 dist-test-slave-x5fp krb5kdc[3848](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424885, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:08:05.047152 27391 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 11 05:08:05 dist-test-slave-x5fp krb5kdc[3848](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424885, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:08:05.048061 27391 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 11 05:08:05 dist-test-slave-x5fp krb5kdc[3848](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424885, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.191.193@KRBTEST.COM
I20260811 05:08:05.057299 4677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:05.048637 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40550 (local address 127.26.191.193:39041)
0811 05:08:05.048690 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:05.048692 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:05.048768 (+ 76us) server_negotiation.cc:407] Connection header received
0811 05:08:05.048911 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:05.048912 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:05.048926 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:05.048983 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:05.049494 (+ 511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:05.050237 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:05.051143 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:05.051496 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:05.051557 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:05.054299 (+ 2742us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:05.054310 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:05.054310 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:08:05.054318 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:05.056103 (+ 1785us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:05.056485 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:05.056487 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:05.056488 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:05.056546 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:05.056765 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:05.056766 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:05.056766 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:05.056938 (+ 172us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:05.057062 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:05.057149 (+ 87us) server_negotiation.cc:299] Negotiation successful
0811 05:08:05.057217 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
W20260811 05:08:05.059361 4677 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:08:05.058732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40556 (local address 127.26.191.193:39041)
0811 05:08:05.058780 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:05.058782 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:05.058796 (+ 14us) server_negotiation.cc:407] Connection header received
0811 05:08:05.058892 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:05.058893 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:05.058903 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:05.058961 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:05.059297 (+ 336us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40556: BlockingRecv error: recv got EOF from 127.0.0.1:40556 (error 108)
Metrics: {"server-negotiator.queue_time_us":27}
W20260811 05:08:05.059479 27391 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/krb5kdc/krb5cc' of type FILE
Aug 11 05:08:05 dist-test-slave-x5fp krb5kdc[3848](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424885, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:08:05.060627 27391 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 11 05:08:05 dist-test-slave-x5fp krb5kdc[3848](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424885, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:08:05.061657 27391 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 11 05:08:05 dist-test-slave-x5fp krb5kdc[3848](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424885, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.191.193@KRBTEST.COM
I20260811 05:08:05.070003 4677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:05.062274 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40572 (local address 127.26.191.193:39041)
0811 05:08:05.062364 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:05.062367 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:05.062427 (+ 60us) server_negotiation.cc:407] Connection header received
0811 05:08:05.062513 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:05.062514 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:05.062527 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:05.062603 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:05.063075 (+ 472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:05.063640 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:05.064423 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:05.064652 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:05.064748 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:05.067033 (+ 2285us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:05.067034 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:05.067035 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:08:05.067044 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:05.068493 (+ 1449us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:05.069059 (+ 566us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:05.069060 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:05.069061 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:05.069126 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:05.069335 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:05.069336 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:05.069336 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:05.069464 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:05.069597 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:05.069754 (+ 157us) server_negotiation.cc:299] Negotiation successful
0811 05:08:05.069887 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
W20260811 05:08:05.071867 4677 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:08:05.071251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40576 (local address 127.26.191.193:39041)
0811 05:08:05.071304 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:05.071306 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:05.071319 (+ 13us) server_negotiation.cc:407] Connection header received
0811 05:08:05.071401 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:05.071402 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:05.071417 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:05.071496 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:05.071825 (+ 329us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40576: BlockingRecv error: recv got EOF from 127.0.0.1:40576 (error 108)
Metrics: {"server-negotiator.queue_time_us":27}
W20260811 05:08:05.072063 27391 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424853995437-27391-0/krb5kdc/krb5cc' of type FILE
Aug 11 05:08:05 dist-test-slave-x5fp krb5kdc[3848](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424885, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:08:05.073194 27391 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 11 05:08:05 dist-test-slave-x5fp krb5kdc[3848](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424885, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:08:05.074151 27391 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 11 05:08:05 dist-test-slave-x5fp krb5kdc[3848](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424885, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.191.193@KRBTEST.COM
I20260811 05:08:05.082588 4677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:05.074830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40586 (local address 127.26.191.193:39041)
0811 05:08:05.074911 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:05.074913 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:05.074931 (+ 18us) server_negotiation.cc:407] Connection header received
0811 05:08:05.074952 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:05.074953 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:05.074962 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:05.075021 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:05.075453 (+ 432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:05.076016 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:05.076802 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:05.077005 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:05.077070 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:05.079461 (+ 2391us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:05.079463 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:05.079463 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:08:05.079471 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:05.081136 (+ 1665us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:05.081591 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:05.081593 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:05.081593 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:05.081663 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:05.081982 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:05.081984 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:05.081984 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:05.082105 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:05.082194 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:05.082358 (+ 164us) server_negotiation.cc:299] Negotiation successful
0811 05:08:05.082434 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 05:08:05.083467 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 4013
I20260811 05:08:05.098017 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 4227
I20260811 05:08:05.109362 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 4453
I20260811 05:08:05.124866 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 3873
2026-08-11T05:08:05Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (2242 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 05:08:05 dist-test-slave-x5fp krb5kdc[4698](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 05:08:05 dist-test-slave-x5fp krb5kdc[4698](info): set up 2 sockets
Aug 11 05:08:05 dist-test-slave-x5fp krb5kdc[4698](info): commencing operation
krb5kdc: starting...
W20260811 05:08:06.438408 27391 mini_kdc.cc:121] Time spent starting KDC: real 1.284s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/krb5kdc/test-user.keytab.
Aug 11 05:08:06 dist-test-slave-x5fp krb5kdc[4698](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424886, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T05:08:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:08:06Z Disabled control of system clock
WARNING: no policy specified for oryx/127.26.191.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.191.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.191.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/krb5kdc/oryx_127.26.191.254.keytab.
Entry for principal oryx/127.26.191.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/krb5kdc/oryx_127.26.191.254.keytab.
I20260811 05:08:06.589397 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.254:43813
--webserver_interface=127.26.191.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/krb5kdc/oryx_127.26.191.254.keytab
--principal=oryx/127.26.191.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:36473
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.191.254:43813
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:08:06.680261 4715 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:08:06.680572 4715 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:08:06.680622 4715 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:08:06.682026 4715 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:08:06.682111 4715 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:08:06.682137 4715 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:08:06.682156 4715 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:08:06.682188 4715 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:08:06.683782 4715 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:36473
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.191.254:43813
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/krb5kdc/oryx_127.26.191.254.keytab
--principal=oryx/127.26.191.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.254:43813
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.191.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4715
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:08:06.684322 4715 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:08:06.684623 4715 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:08:06.690558 4725 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:08:06.690610 4715 server_base.cc:1034] running on GCE node
W20260811 05:08:06.690578 4728 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:06.690574 4723 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:08:06.691105 4715 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:08:06.691481 4715 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:08:06.692782 4715 hybrid_clock.cc:648] HybridClock initialized: now 1786424886692736 us; error 118 us; skew 500 ppm
Aug 11 05:08:06 dist-test-slave-x5fp krb5kdc[4698](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424886, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.191.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:08:06.695736 4715 init.cc:377] Logged in from keytab as oryx/127.26.191.254@KRBTEST.COM (short username oryx)
I20260811 05:08:06.696238 4715 webserver.cc:460] Webserver started at http://127.26.191.254:42855/ using document root <none> and password file <none>
I20260811 05:08:06.696484 4715 fs_manager.cc:359] Metadata directory not provided
I20260811 05:08:06.696532 4715 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:08:06.696668 4715 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:08:06.697798 4715 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/master-0/data/instance:
uuid: "b8fed5a210a94d26b6993a9d4e186564"
format_stamp: "Formatted at 2026-08-11 05:08:06 on dist-test-slave-x5fp"
server_key: "ce7fc38a91dc52f3673ab78bd246e875"
server_key_iv: "751d25e6d4f9345563669c8e5f178ad4"
server_key_version: "encryptionkey@0"
I20260811 05:08:06.698189 4715 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/master-0/wal/instance:
uuid: "b8fed5a210a94d26b6993a9d4e186564"
format_stamp: "Formatted at 2026-08-11 05:08:06 on dist-test-slave-x5fp"
server_key: "ce7fc38a91dc52f3673ab78bd246e875"
server_key_iv: "751d25e6d4f9345563669c8e5f178ad4"
server_key_version: "encryptionkey@0"
I20260811 05:08:06.699693 4715 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 05:08:06.700627 4739 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:06.700881 4715 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:08:06.701000 4715 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/master-0/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/master-0/wal
uuid: "b8fed5a210a94d26b6993a9d4e186564"
format_stamp: "Formatted at 2026-08-11 05:08:06 on dist-test-slave-x5fp"
server_key: "ce7fc38a91dc52f3673ab78bd246e875"
server_key_iv: "751d25e6d4f9345563669c8e5f178ad4"
server_key_version: "encryptionkey@0"
I20260811 05:08:06.701097 4715 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:08:06.716094 4715 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:08:06.718890 4715 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:08:06.719110 4715 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:08:06.723805 4715 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.254:43813
I20260811 05:08:06.723855 4827 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.254:43813 every 8 connection(s)
I20260811 05:08:06.724251 4715 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
I20260811 05:08:06.725265 4829 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:08:06.726151 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 4715
I20260811 05:08:06.726291 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/master-0/wal/instance
I20260811 05:08:06.726537 27391 external_mini_cluster.cc:1428] Setting key e455e9a0bbf678d94d109da1f86cc25f
I20260811 05:08:06.729655 4829 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b8fed5a210a94d26b6993a9d4e186564: Bootstrap starting.
I20260811 05:08:06.730374 4829 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b8fed5a210a94d26b6993a9d4e186564: Neither blocks nor log segments found. Creating new log.
I20260811 05:08:06.730785 4829 log.cc:824] T 00000000000000000000000000000000 P b8fed5a210a94d26b6993a9d4e186564: Log is configured to *not* fsync() on all Append() calls
I20260811 05:08:06.731660 4829 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b8fed5a210a94d26b6993a9d4e186564: No bootstrap required, opened a new log
I20260811 05:08:06.734630 4829 raft_consensus.cc:348] T 00000000000000000000000000000000 P b8fed5a210a94d26b6993a9d4e186564 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8fed5a210a94d26b6993a9d4e186564" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 43813 } }
I20260811 05:08:06.734793 4829 raft_consensus.cc:374] T 00000000000000000000000000000000 P b8fed5a210a94d26b6993a9d4e186564 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:08:06.734819 4829 raft_consensus.cc:729] T 00000000000000000000000000000000 P b8fed5a210a94d26b6993a9d4e186564 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8fed5a210a94d26b6993a9d4e186564, State: Initialized, Role: FOLLOWER
I20260811 05:08:06.734978 4829 consensus_queue.cc:260] T 00000000000000000000000000000000 P b8fed5a210a94d26b6993a9d4e186564 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8fed5a210a94d26b6993a9d4e186564" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 43813 } }
I20260811 05:08:06.735090 4829 raft_consensus.cc:388] T 00000000000000000000000000000000 P b8fed5a210a94d26b6993a9d4e186564 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:08:06.735141 4829 raft_consensus.cc:482] T 00000000000000000000000000000000 P b8fed5a210a94d26b6993a9d4e186564 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:08:06.735198 4829 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b8fed5a210a94d26b6993a9d4e186564 [term 0 FOLLOWER]: Advancing to term 1
Aug 11 05:08:06 dist-test-slave-x5fp krb5kdc[4698](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424886, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM
I20260811 05:08:06.735853 4829 raft_consensus.cc:504] T 00000000000000000000000000000000 P b8fed5a210a94d26b6993a9d4e186564 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8fed5a210a94d26b6993a9d4e186564" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 43813 } }
I20260811 05:08:06.735953 4829 leader_election.cc:302] T 00000000000000000000000000000000 P b8fed5a210a94d26b6993a9d4e186564 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b8fed5a210a94d26b6993a9d4e186564; no voters:
I20260811 05:08:06.736182 4829 leader_election.cc:288] T 00000000000000000000000000000000 P b8fed5a210a94d26b6993a9d4e186564 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 05:08:06.736246 4842 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b8fed5a210a94d26b6993a9d4e186564 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:08:06.736538 4829 sys_catalog.cc:564] T 00000000000000000000000000000000 P b8fed5a210a94d26b6993a9d4e186564 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:08:06.736850 4842 raft_consensus.cc:686] T 00000000000000000000000000000000 P b8fed5a210a94d26b6993a9d4e186564 [term 1 LEADER]: Becoming Leader. State: Replica: b8fed5a210a94d26b6993a9d4e186564, State: Running, Role: LEADER
I20260811 05:08:06.736984 4842 consensus_queue.cc:237] T 00000000000000000000000000000000 P b8fed5a210a94d26b6993a9d4e186564 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8fed5a210a94d26b6993a9d4e186564" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 43813 } }
I20260811 05:08:06.738492 4844 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8fed5a210a94d26b6993a9d4e186564 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b8fed5a210a94d26b6993a9d4e186564" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8fed5a210a94d26b6993a9d4e186564" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 43813 } } }
I20260811 05:08:06.738684 4844 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8fed5a210a94d26b6993a9d4e186564 [sys.catalog]: This master's current role is: LEADER
I20260811 05:08:06.738652 4843 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8fed5a210a94d26b6993a9d4e186564 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b8fed5a210a94d26b6993a9d4e186564. Latest consensus state: current_term: 1 leader_uuid: "b8fed5a210a94d26b6993a9d4e186564" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8fed5a210a94d26b6993a9d4e186564" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 43813 } } }
I20260811 05:08:06.739095 4843 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8fed5a210a94d26b6993a9d4e186564 [sys.catalog]: This master's current role is: LEADER
W20260811 05:08:06.739537 4867 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b8fed5a210a94d26b6993a9d4e186564: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 05:08:06.739615 4867 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 05:08:06.739676 4868 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:08:06.739881 4868 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:08:06.740069 4836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:06.727228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40664 (local address 127.26.191.254:43813)
0811 05:08:06.727526 (+ 298us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:06.727537 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:06.727577 (+ 40us) server_negotiation.cc:407] Connection header received
0811 05:08:06.728407 (+ 830us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:06.728417 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:06.728488 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:06.728638 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:06.729596 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:06.730686 (+ 1090us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:06.731838 (+ 1152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:06.732270 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:06.732357 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:06.735747 (+ 3390us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:06.735752 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:06.735752 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:08:06.735774 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:06.737824 (+ 2050us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:06.738306 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:06.738310 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:06.738311 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:06.738441 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:06.738717 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:06.738718 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:06.738719 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:06.739065 (+ 346us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:06.739228 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:06.739552 (+ 324us) server_negotiation.cc:299] Negotiation successful
0811 05:08:06.739807 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":244,"thread_start_us":142,"threads_started":1}
I20260811 05:08:06.741571 4868 catalog_manager.cc:1347] Generated new cluster ID: 3ed6af74e2204dc5a8aa5a0144170ddf
I20260811 05:08:06.741628 4868 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:08:06.760632 4868 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:08:06.761473 4868 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:08:06.771824 4868 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b8fed5a210a94d26b6993a9d4e186564: Generated new TSK 0
I20260811 05:08:06.772064 4868 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.26.191.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.191.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.191.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/krb5kdc/oryx_127.26.191.193.keytab.
Entry for principal oryx/127.26.191.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/krb5kdc/oryx_127.26.191.193.keytab.
I20260811 05:08:06.805918 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.191.193:0
--local_ip_for_outbound_sockets=127.26.191.193
--webserver_interface=127.26.191.193
--webserver_port=0
--tserver_master_addrs=127.26.191.254:43813
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/krb5kdc/oryx_127.26.191.193.keytab
--principal=oryx/127.26.191.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:36473
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:08:06.899608 4875 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:08:06.899859 4875 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:08:06.899889 4875 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:08:06.901242 4875 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:08:06.901301 4875 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:08:06.901333 4875 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.191.193
I20260811 05:08:06.903127 4875 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:36473
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/krb5kdc/oryx_127.26.191.193.keytab
--principal=oryx/127.26.191.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.191.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.191.193
--webserver_port=0
--tserver_master_addrs=127.26.191.254:43813
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4875
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.191.193
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:08:06.903438 4875 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:08:06.903673 4875 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:08:06.911072 4882 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:06.911280 4886 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:08:06.911372 4875 server_base.cc:1034] running on GCE node
W20260811 05:08:06.911286 4883 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:08:06.912015 4875 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:08:06.912338 4875 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:08:06.913555 4875 hybrid_clock.cc:648] HybridClock initialized: now 1786424886913386 us; error 186 us; skew 500 ppm
Aug 11 05:08:06 dist-test-slave-x5fp krb5kdc[4698](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424886, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.191.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:08:06.916631 4875 init.cc:377] Logged in from keytab as oryx/127.26.191.193@KRBTEST.COM (short username oryx)
I20260811 05:08:06.917196 4875 webserver.cc:460] Webserver started at http://127.26.191.193:46389/ using document root <none> and password file <none>
I20260811 05:08:06.917454 4875 fs_manager.cc:359] Metadata directory not provided
I20260811 05:08:06.917528 4875 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:08:06.917687 4875 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:08:06.919031 4875 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/ts-0/data/instance:
uuid: "db794d15babb45b6a10aeb091d4472fe"
format_stamp: "Formatted at 2026-08-11 05:08:06 on dist-test-slave-x5fp"
server_key: "833ff7796df14c6c7a2173ba5b4fb149"
server_key_iv: "26d86ec101011b5cade5aa81b15bd602"
server_key_version: "encryptionkey@0"
I20260811 05:08:06.919479 4875 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/ts-0/wal/instance:
uuid: "db794d15babb45b6a10aeb091d4472fe"
format_stamp: "Formatted at 2026-08-11 05:08:06 on dist-test-slave-x5fp"
server_key: "833ff7796df14c6c7a2173ba5b4fb149"
server_key_iv: "26d86ec101011b5cade5aa81b15bd602"
server_key_version: "encryptionkey@0"
I20260811 05:08:06.921105 4875 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 05:08:06.922192 4901 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:06.922489 4875 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:08:06.922629 4875 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/ts-0/wal
uuid: "db794d15babb45b6a10aeb091d4472fe"
format_stamp: "Formatted at 2026-08-11 05:08:06 on dist-test-slave-x5fp"
server_key: "833ff7796df14c6c7a2173ba5b4fb149"
server_key_iv: "26d86ec101011b5cade5aa81b15bd602"
server_key_version: "encryptionkey@0"
I20260811 05:08:06.922756 4875 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:08:06.943602 4875 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:08:06.946302 4875 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:08:06.946487 4875 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:08:06.946768 4875 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:08:06.947114 4875 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:08:06.947173 4875 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:06.947220 4875 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:08:06.947244 4875 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:06.953639 4875 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.193:39383
I20260811 05:08:06.953727 5082 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.193:39383 every 8 connection(s)
I20260811 05:08:06.954087 4875 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/ts-0/data/info.pb
Aug 11 05:08:06 dist-test-slave-x5fp krb5kdc[4698](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424886, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.191.193@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM
I20260811 05:08:06.963233 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 4875
I20260811 05:08:06.963377 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/ts-0/wal/instance
I20260811 05:08:06.963608 27391 external_mini_cluster.cc:1428] Setting key a915dd5347db6646500b599071659b63
I20260811 05:08:06.965245 4836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:06.954969 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.193:53093 (local address 127.26.191.254:43813)
0811 05:08:06.955021 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:06.955024 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:06.955258 (+ 234us) server_negotiation.cc:407] Connection header received
0811 05:08:06.955887 (+ 629us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:06.955889 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:06.955903 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:06.955957 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:06.957114 (+ 1157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:06.957651 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:06.958730 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:06.958961 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:06.959054 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:06.961811 (+ 2757us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:06.961813 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:06.961813 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:08:06.961821 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:06.963316 (+ 1495us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:06.963866 (+ 550us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:06.963867 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:06.963867 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:06.963958 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:06.964362 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:06.964363 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:06.964363 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:06.964509 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:06.964600 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:06.965071 (+ 471us) server_negotiation.cc:299] Negotiation successful
0811 05:08:06.965172 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 05:08:06.965545 5088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:06.954919 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:43813 (local address 127.26.191.193:53093)
0811 05:08:06.955113 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:06.955155 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:06.955748 (+ 593us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:06.956035 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:06.956039 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:06.956673 (+ 634us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:06.957000 (+ 327us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:06.957006 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:06.957763 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:06.957764 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:06.958625 (+ 861us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:06.958627 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:06.959071 (+ 444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:06.959072 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:06.959212 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:06.959852 (+ 640us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:06.959862 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:06.961579 (+ 1717us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:08:06.963446 (+ 1867us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:06.963458 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:06.963461 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:06.963768 (+ 307us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:06.964038 (+ 270us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:06.964039 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:06.964039 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:06.964189 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:06.964590 (+ 401us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:08:06.964599 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:08:06.964850 (+ 251us) client_negotiation.cc:769] Sending connection context
0811 05:08:06.965014 (+ 164us) client_negotiation.cc:240] Negotiation successful
0811 05:08:06.965234 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":88,"threads_started":1}
I20260811 05:08:06.966385 5084 heartbeater.cc:347] Connected to a master server at 127.26.191.254:43813
I20260811 05:08:06.966531 5084 heartbeater.cc:464] Registering TS with master...
I20260811 05:08:06.966799 5084 heartbeater.cc:511] Master 127.26.191.254:43813 requested a full tablet report, sending...
I20260811 05:08:06.967520 4769 ts_manager.cc:194] Registered new tserver with Master: db794d15babb45b6a10aeb091d4472fe (127.26.191.193:39383)
I20260811 05:08:06.968186 4769 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.26.191.193@KRBTEST.COM'} at 127.26.191.193:53093
WARNING: no policy specified for oryx/127.26.191.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.191.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.191.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/krb5kdc/oryx_127.26.191.194.keytab.
Entry for principal oryx/127.26.191.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/krb5kdc/oryx_127.26.191.194.keytab.
I20260811 05:08:06.997623 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.191.194:0
--local_ip_for_outbound_sockets=127.26.191.194
--webserver_interface=127.26.191.194
--webserver_port=0
--tserver_master_addrs=127.26.191.254:43813
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/krb5kdc/oryx_127.26.191.194.keytab
--principal=oryx/127.26.191.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:36473
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:08:07.096046 5093 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:08:07.096297 5093 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:08:07.096326 5093 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:08:07.097647 5093 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:08:07.097698 5093 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:08:07.097728 5093 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.191.194
I20260811 05:08:07.099844 5093 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:36473
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/krb5kdc/oryx_127.26.191.194.keytab
--principal=oryx/127.26.191.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.191.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.191.194
--webserver_port=0
--tserver_master_addrs=127.26.191.254:43813
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5093
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.191.194
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:08:07.100131 5093 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:08:07.100416 5093 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:08:07.106405 5101 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:07.106391 5099 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:07.106389 5107 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:08:07.106596 5093 server_base.cc:1034] running on GCE node
I20260811 05:08:07.106954 5093 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:08:07.107250 5093 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:08:07.108489 5093 hybrid_clock.cc:648] HybridClock initialized: now 1786424887108469 us; error 31 us; skew 500 ppm
Aug 11 05:08:07 dist-test-slave-x5fp krb5kdc[4698](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424887, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.191.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:08:07.111449 5093 init.cc:377] Logged in from keytab as oryx/127.26.191.194@KRBTEST.COM (short username oryx)
I20260811 05:08:07.112006 5093 webserver.cc:460] Webserver started at http://127.26.191.194:39775/ using document root <none> and password file <none>
I20260811 05:08:07.112267 5093 fs_manager.cc:359] Metadata directory not provided
I20260811 05:08:07.112349 5093 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:08:07.112525 5093 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:08:07.113736 5093 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/ts-1/data/instance:
uuid: "95c53350afaf4f799751127bdd8f40fb"
format_stamp: "Formatted at 2026-08-11 05:08:07 on dist-test-slave-x5fp"
server_key: "aeff6bb04148f067f1f2bc590b1ae794"
server_key_iv: "e02b6000c8cde2259c936420553c5450"
server_key_version: "encryptionkey@0"
I20260811 05:08:07.114141 5093 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/ts-1/wal/instance:
uuid: "95c53350afaf4f799751127bdd8f40fb"
format_stamp: "Formatted at 2026-08-11 05:08:07 on dist-test-slave-x5fp"
server_key: "aeff6bb04148f067f1f2bc590b1ae794"
server_key_iv: "e02b6000c8cde2259c936420553c5450"
server_key_version: "encryptionkey@0"
I20260811 05:08:07.115904 5093 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.001s
I20260811 05:08:07.117022 5120 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:07.117326 5093 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:08:07.117504 5093 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/ts-1/wal
uuid: "95c53350afaf4f799751127bdd8f40fb"
format_stamp: "Formatted at 2026-08-11 05:08:07 on dist-test-slave-x5fp"
server_key: "aeff6bb04148f067f1f2bc590b1ae794"
server_key_iv: "e02b6000c8cde2259c936420553c5450"
server_key_version: "encryptionkey@0"
I20260811 05:08:07.117601 5093 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:08:07.128381 5093 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:08:07.130931 5093 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:08:07.131127 5093 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:08:07.131415 5093 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:08:07.131788 5093 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:08:07.131882 5093 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:07.131937 5093 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:08:07.131965 5093 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:07.139014 5093 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.194:39395
I20260811 05:08:07.139065 5305 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.194:39395 every 8 connection(s)
I20260811 05:08:07.139432 5093 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/ts-1/data/info.pb
I20260811 05:08:07.144630 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 5093
I20260811 05:08:07.144790 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/ts-1/wal/instance
I20260811 05:08:07.145037 27391 external_mini_cluster.cc:1428] Setting key 84d5419a6b62da4ddbd896732130cdbe
Aug 11 05:08:07 dist-test-slave-x5fp krb5kdc[4698](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424887, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.191.194@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM
I20260811 05:08:07.150446 4836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:07.140236 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.194:39733 (local address 127.26.191.254:43813)
0811 05:08:07.140359 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:07.140362 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:07.140547 (+ 185us) server_negotiation.cc:407] Connection header received
0811 05:08:07.141192 (+ 645us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:07.141195 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:07.141208 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:07.141260 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:07.142311 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:07.142839 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:07.143862 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:07.144084 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:07.144173 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:07.147039 (+ 2866us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:07.147041 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:07.147042 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:08:07.147051 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:07.148645 (+ 1594us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:07.149263 (+ 618us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:07.149265 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:07.149265 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:07.149326 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:07.149657 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:07.149658 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:07.149659 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:07.149823 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:07.149936 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:07.150211 (+ 275us) server_negotiation.cc:299] Negotiation successful
0811 05:08:07.150307 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260811 05:08:07.150488 5310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:07.140146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:43813 (local address 127.26.191.194:39733)
0811 05:08:07.140399 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:07.140454 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:07.141067 (+ 613us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:07.141343 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:07.141348 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:07.141993 (+ 645us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:07.142204 (+ 211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:07.142210 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:07.142945 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:07.142946 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:07.143763 (+ 817us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:07.143765 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:07.144187 (+ 422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:07.144189 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:07.144324 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:07.145076 (+ 752us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:07.145088 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:07.146938 (+ 1850us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:08:07.148774 (+ 1836us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:07.148783 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:07.148786 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:07.149164 (+ 378us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:07.149393 (+ 229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:07.149394 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:07.149394 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:07.149560 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:07.149905 (+ 345us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:08:07.149912 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:08:07.150052 (+ 140us) client_negotiation.cc:769] Sending connection context
0811 05:08:07.150144 (+ 92us) client_negotiation.cc:240] Negotiation successful
0811 05:08:07.150284 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":125,"threads_started":1}
I20260811 05:08:07.151316 5306 heartbeater.cc:347] Connected to a master server at 127.26.191.254:43813
I20260811 05:08:07.151444 5306 heartbeater.cc:464] Registering TS with master...
I20260811 05:08:07.151677 5306 heartbeater.cc:511] Master 127.26.191.254:43813 requested a full tablet report, sending...
I20260811 05:08:07.152117 4769 ts_manager.cc:194] Registered new tserver with Master: 95c53350afaf4f799751127bdd8f40fb (127.26.191.194:39395)
I20260811 05:08:07.152556 4769 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.26.191.194@KRBTEST.COM'} at 127.26.191.194:39733
WARNING: no policy specified for oryx/127.26.191.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.191.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.191.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/krb5kdc/oryx_127.26.191.195.keytab.
Entry for principal oryx/127.26.191.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/krb5kdc/oryx_127.26.191.195.keytab.
I20260811 05:08:07.176961 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.191.195:0
--local_ip_for_outbound_sockets=127.26.191.195
--webserver_interface=127.26.191.195
--webserver_port=0
--tserver_master_addrs=127.26.191.254:43813
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/krb5kdc/oryx_127.26.191.195.keytab
--principal=oryx/127.26.191.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:36473
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:08:07.264211 5313 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:08:07.264442 5313 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:08:07.264467 5313 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:08:07.265645 5313 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:08:07.265688 5313 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:08:07.265715 5313 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.191.195
I20260811 05:08:07.267179 5313 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:36473
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/krb5kdc/oryx_127.26.191.195.keytab
--principal=oryx/127.26.191.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.191.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.191.195
--webserver_port=0
--tserver_master_addrs=127.26.191.254:43813
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5313
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.191.195
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:08:07.267400 5313 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:08:07.267591 5313 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 05:08:07.273352 5313 server_base.cc:1034] running on GCE node
W20260811 05:08:07.273279 5328 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:07.273317 5323 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:07.273317 5321 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:08:07.273739 5313 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:08:07.273983 5313 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:08:07.275156 5313 hybrid_clock.cc:648] HybridClock initialized: now 1786424887275121 us; error 51 us; skew 500 ppm
Aug 11 05:08:07 dist-test-slave-x5fp krb5kdc[4698](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424887, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.191.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:08:07.277910 5313 init.cc:377] Logged in from keytab as oryx/127.26.191.195@KRBTEST.COM (short username oryx)
I20260811 05:08:07.278347 5313 webserver.cc:460] Webserver started at http://127.26.191.195:41573/ using document root <none> and password file <none>
I20260811 05:08:07.278628 5313 fs_manager.cc:359] Metadata directory not provided
I20260811 05:08:07.278705 5313 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:08:07.278873 5313 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:08:07.280009 5313 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/ts-2/data/instance:
uuid: "4b1e476d7e6241fbac41768184552018"
format_stamp: "Formatted at 2026-08-11 05:08:07 on dist-test-slave-x5fp"
server_key: "a3a5fd8e29eba33acf9682a0584449f7"
server_key_iv: "af3b5cccf672b2faa8b90f8865eb27c5"
server_key_version: "encryptionkey@0"
I20260811 05:08:07.280405 5313 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/ts-2/wal/instance:
uuid: "4b1e476d7e6241fbac41768184552018"
format_stamp: "Formatted at 2026-08-11 05:08:07 on dist-test-slave-x5fp"
server_key: "a3a5fd8e29eba33acf9682a0584449f7"
server_key_iv: "af3b5cccf672b2faa8b90f8865eb27c5"
server_key_version: "encryptionkey@0"
I20260811 05:08:07.281981 5313 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 05:08:07.282919 5338 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:07.283150 5313 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:08:07.283288 5313 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/ts-2/wal
uuid: "4b1e476d7e6241fbac41768184552018"
format_stamp: "Formatted at 2026-08-11 05:08:07 on dist-test-slave-x5fp"
server_key: "a3a5fd8e29eba33acf9682a0584449f7"
server_key_iv: "af3b5cccf672b2faa8b90f8865eb27c5"
server_key_version: "encryptionkey@0"
I20260811 05:08:07.283388 5313 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:08:07.297328 5313 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:08:07.299633 5313 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:08:07.299824 5313 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:08:07.300096 5313 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:08:07.300434 5313 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:08:07.300491 5313 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:07.300539 5313 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:08:07.300570 5313 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:07.307103 5313 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.195:34541
I20260811 05:08:07.307178 5529 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.195:34541 every 8 connection(s)
I20260811 05:08:07.307526 5313 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/ts-2/data/info.pb
I20260811 05:08:07.313683 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 5313
I20260811 05:08:07.313819 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/ts-2/wal/instance
Aug 11 05:08:07 dist-test-slave-x5fp krb5kdc[4698](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424887, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.191.195@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM
I20260811 05:08:07.314014 27391 external_mini_cluster.cc:1428] Setting key 898fd7a403c18910e5bca88a726e63dd
I20260811 05:08:07.317706 4836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:07.308428 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.195:37497 (local address 127.26.191.254:43813)
0811 05:08:07.308481 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:07.308483 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:07.308670 (+ 187us) server_negotiation.cc:407] Connection header received
0811 05:08:07.309184 (+ 514us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:07.309185 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:07.309196 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:07.309259 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:07.310282 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:07.310801 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:07.311809 (+ 1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:07.312005 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:07.312063 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:07.314608 (+ 2545us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:07.314610 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:07.314610 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:08:07.314619 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:07.316221 (+ 1602us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:07.316656 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:07.316657 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:07.316658 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:07.316742 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:07.317023 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:07.317024 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:07.317024 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:07.317154 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:07.317234 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:07.317522 (+ 288us) server_negotiation.cc:299] Negotiation successful
0811 05:08:07.317610 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 05:08:07.317987 5534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:07.308361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:43813 (local address 127.26.191.195:37497)
0811 05:08:07.308539 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:07.308582 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:07.309095 (+ 513us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:07.309342 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:07.309346 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:07.309951 (+ 605us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:07.310155 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:07.310160 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:07.310899 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:07.310900 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:07.311720 (+ 820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:07.311723 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:07.312087 (+ 364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:07.312088 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:07.312209 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:07.312846 (+ 637us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:07.312854 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:07.314515 (+ 1661us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:08:07.316329 (+ 1814us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:07.316336 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:07.316338 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:07.316575 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:07.316812 (+ 237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:07.316813 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:07.316814 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:07.316945 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:07.317224 (+ 279us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:08:07.317231 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:08:07.317386 (+ 155us) client_negotiation.cc:769] Sending connection context
0811 05:08:07.317499 (+ 113us) client_negotiation.cc:240] Negotiation successful
0811 05:08:07.317671 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":97,"threads_started":1}
I20260811 05:08:07.318555 5530 heartbeater.cc:347] Connected to a master server at 127.26.191.254:43813
I20260811 05:08:07.318645 5530 heartbeater.cc:464] Registering TS with master...
I20260811 05:08:07.318853 5530 heartbeater.cc:511] Master 127.26.191.254:43813 requested a full tablet report, sending...
I20260811 05:08:07.319296 4769 ts_manager.cc:194] Registered new tserver with Master: 4b1e476d7e6241fbac41768184552018 (127.26.191.195:34541)
I20260811 05:08:07.319706 4769 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.26.191.195@KRBTEST.COM'} at 127.26.191.195:37497
I20260811 05:08:07.326382 27391 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.26.191.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.191.253@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.191.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/krb5kdc/oryx_127.26.191.253.keytab.
Entry for principal oryx/127.26.191.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/krb5kdc/oryx_127.26.191.253.keytab.
I20260811 05:08:07.357620 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.253:41643
--webserver_interface=127.26.191.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/krb5kdc/oryx_127.26.191.253.keytab
--principal=oryx/127.26.191.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:36473
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.191.254:43813,127.26.191.253:41643
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:08:07.444496 5543 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:08:07.444783 5543 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:08:07.444820 5543 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:08:07.446055 5543 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:08:07.446100 5543 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:08:07.446115 5543 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:08:07.446128 5543 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:08:07.446141 5543 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:08:07.447724 5543 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:36473
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.26.191.254:43813,127.26.191.253:41643
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/krb5kdc/oryx_127.26.191.253.keytab
--principal=oryx/127.26.191.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.253:41643
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.26.191.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5543
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
W20260811 05:08:07.447850 5543 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.26.191.254:43813,127.26.191.253:41643'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260811 05:08:07.448032 5543 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:08:07.448277 5543 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:08:07.453646 5553 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:07.453584 5551 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:07.453591 5549 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:08:07.453953 5543 server_base.cc:1034] running on GCE node
I20260811 05:08:07.454242 5543 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:08:07.454522 5543 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:08:07.455694 5543 hybrid_clock.cc:648] HybridClock initialized: now 1786424887455660 us; error 46 us; skew 500 ppm
Aug 11 05:08:07 dist-test-slave-x5fp krb5kdc[4698](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424887, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.191.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:08:07.458648 5543 init.cc:377] Logged in from keytab as oryx/127.26.191.253@KRBTEST.COM (short username oryx)
I20260811 05:08:07.459265 5543 webserver.cc:460] Webserver started at http://127.26.191.253:44753/ using document root <none> and password file <none>
I20260811 05:08:07.459544 5543 fs_manager.cc:359] Metadata directory not provided
I20260811 05:08:07.459625 5543 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:08:07.459796 5543 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:08:07.461176 5543 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/master-1/data/instance:
uuid: "25cb19e8f2c245629b828de638b93da3"
format_stamp: "Formatted at 2026-08-11 05:08:07 on dist-test-slave-x5fp"
server_key: "898e12b408f04dd46f241dbc6b0c08a6"
server_key_iv: "3b2d826289cface078b2e575605ef17b"
server_key_version: "encryptionkey@0"
I20260811 05:08:07.461616 5543 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/master-1/wal/instance:
uuid: "25cb19e8f2c245629b828de638b93da3"
format_stamp: "Formatted at 2026-08-11 05:08:07 on dist-test-slave-x5fp"
server_key: "898e12b408f04dd46f241dbc6b0c08a6"
server_key_iv: "3b2d826289cface078b2e575605ef17b"
server_key_version: "encryptionkey@0"
I20260811 05:08:07.463269 5543 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 05:08:07.464254 5566 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:07.464484 5543 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:08:07.464620 5543 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/master-1/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/master-1/wal
uuid: "25cb19e8f2c245629b828de638b93da3"
format_stamp: "Formatted at 2026-08-11 05:08:07 on dist-test-slave-x5fp"
server_key: "898e12b408f04dd46f241dbc6b0c08a6"
server_key_iv: "3b2d826289cface078b2e575605ef17b"
server_key_version: "encryptionkey@0"
I20260811 05:08:07.464715 5543 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:08:07.477912 5543 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:08:07.480602 5543 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:08:07.480829 5543 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:08:07.485085 5543 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.253:41643
I20260811 05:08:07.485139 5647 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.253:41643 every 8 connection(s)
I20260811 05:08:07.485533 5543 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/master-1/data/info.pb
I20260811 05:08:07.486804 5649 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:08:07.488525 5649 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.191.254" port: 43813 } has no permanent_uuid. Determining permanent_uuid...
I20260811 05:08:07.494330 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 5543
Aug 11 05:08:07 dist-test-slave-x5fp krb5kdc[4698](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424887, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.191.253@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM
I20260811 05:08:07.498781 4836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:07.489414 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40680 (local address 127.26.191.254:43813)
0811 05:08:07.489482 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:07.489484 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:07.489710 (+ 226us) server_negotiation.cc:407] Connection header received
0811 05:08:07.490180 (+ 470us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:07.490181 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:07.490193 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:07.490262 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:07.490930 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:07.491490 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:07.492475 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:07.492694 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:07.492825 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:07.495459 (+ 2634us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:07.495460 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:07.495460 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:08:07.495470 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:07.497100 (+ 1630us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:07.497574 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:07.497575 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:07.497575 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:07.497643 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:07.497960 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:07.497961 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:07.497962 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:07.498137 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:07.498194 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:07.498554 (+ 360us) server_negotiation.cc:299] Negotiation successful
0811 05:08:07.498650 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 05:08:07.498924 5652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:07.489393 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:43813 (local address 127.0.0.1:40680)
0811 05:08:07.489581 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:07.489618 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:07.490078 (+ 460us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:07.490337 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:07.490340 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:07.490636 (+ 296us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:07.490833 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:07.490837 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:07.491575 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:07.491576 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:07.492371 (+ 795us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:07.492373 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:07.492843 (+ 470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:07.492844 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:07.492974 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:07.493490 (+ 516us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:07.493498 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:07.495329 (+ 1831us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:08:07.497178 (+ 1849us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:07.497185 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:07.497187 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:07.497496 (+ 309us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:07.497745 (+ 249us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:07.497746 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:07.497746 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:07.497877 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:07.498216 (+ 339us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:08:07.498221 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:08:07.498396 (+ 175us) client_negotiation.cc:769] Sending connection context
0811 05:08:07.498514 (+ 118us) client_negotiation.cc:240] Negotiation successful
0811 05:08:07.498677 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":100,"threads_started":1}
I20260811 05:08:07.499687 5649 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.191.253" port: 41643 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 05:08:07 dist-test-slave-x5fp krb5kdc[4698](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424886, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.26.191.253@KRBTEST.COM
Aug 11 05:08:07 dist-test-slave-x5fp krb5kdc[4698](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424887, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.191.253@KRBTEST.COM for oryx/127.26.191.253@KRBTEST.COM
I20260811 05:08:07.505635 5655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:07.495044 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54722 (local address 127.26.191.253:41643)
0811 05:08:07.495201 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:07.495206 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:07.495313 (+ 107us) server_negotiation.cc:407] Connection header received
0811 05:08:07.495339 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:07.495341 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:07.495356 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:07.495439 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:07.496187 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:07.497099 (+ 912us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:07.498025 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:07.498434 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:07.498517 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:07.501695 (+ 3178us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:07.501704 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:07.501704 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:08:07.501712 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:07.503830 (+ 2118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:07.504262 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:07.504265 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:07.504265 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:07.504327 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:07.504603 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:07.504604 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:07.504604 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:07.504898 (+ 294us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:07.505079 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:07.505176 (+ 97us) server_negotiation.cc:299] Negotiation successful
0811 05:08:07.505542 (+ 366us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":125,"thread_start_us":76,"threads_started":1}
I20260811 05:08:07.508193 5652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:07.500014 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.253:41643 (local address 127.0.0.1:54728)
0811 05:08:07.500090 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:07.500102 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:07.500150 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:07.500471 (+ 321us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:07.500472 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:07.500583 (+ 111us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:07.500633 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:07.500634 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:07.501690 (+ 1056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:07.501691 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:07.502410 (+ 719us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:07.502413 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:07.502971 (+ 558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:07.502972 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:07.503054 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:07.503512 (+ 458us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:07.503517 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:07.504945 (+ 1428us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:08:07.507203 (+ 2258us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:07.507204 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:07.507204 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:07.507370 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:07.507573 (+ 203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:07.507573 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:07.507574 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:07.507629 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:07.507878 (+ 249us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:08:07.507879 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:08:07.507917 (+ 38us) client_negotiation.cc:769] Sending connection context
0811 05:08:07.507985 (+ 68us) client_negotiation.cc:240] Negotiation successful
0811 05:08:07.508084 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":54}
I20260811 05:08:07.508281 5659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:07.500114 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54728 (local address 127.26.191.253:41643)
0811 05:08:07.500312 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:07.500314 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:07.500320 (+ 6us) server_negotiation.cc:407] Connection header received
0811 05:08:07.500357 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:07.500358 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:07.500369 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:07.500454 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:07.500760 (+ 306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:07.501606 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:07.502613 (+ 1007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:07.502888 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:07.502952 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:07.505039 (+ 2087us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:07.505040 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:07.505041 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:08:07.505047 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:07.507109 (+ 2062us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:07.507441 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:07.507442 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:07.507442 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:07.507505 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:07.507701 (+ 196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:07.507702 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:07.507702 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:07.507808 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:07.507885 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:07.508009 (+ 124us) server_negotiation.cc:299] Negotiation successful
0811 05:08:07.508137 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":62,"server-negotiator.queue_time_us":180,"thread_start_us":128,"threads_started":1}
I20260811 05:08:07.509649 5649 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 25cb19e8f2c245629b828de638b93da3: Bootstrap starting.
I20260811 05:08:07.510313 5649 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 25cb19e8f2c245629b828de638b93da3: Neither blocks nor log segments found. Creating new log.
I20260811 05:08:07.510624 5649 log.cc:824] T 00000000000000000000000000000000 P 25cb19e8f2c245629b828de638b93da3: Log is configured to *not* fsync() on all Append() calls
I20260811 05:08:07.511454 5649 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 25cb19e8f2c245629b828de638b93da3: No bootstrap required, opened a new log
I20260811 05:08:07.512957 5649 raft_consensus.cc:348] T 00000000000000000000000000000000 P 25cb19e8f2c245629b828de638b93da3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8fed5a210a94d26b6993a9d4e186564" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 43813 } } peers { permanent_uuid: "25cb19e8f2c245629b828de638b93da3" member_type: VOTER last_known_addr { host: "127.26.191.253" port: 41643 } }
I20260811 05:08:07.513088 5649 raft_consensus.cc:374] T 00000000000000000000000000000000 P 25cb19e8f2c245629b828de638b93da3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:08:07.513111 5649 raft_consensus.cc:729] T 00000000000000000000000000000000 P 25cb19e8f2c245629b828de638b93da3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25cb19e8f2c245629b828de638b93da3, State: Initialized, Role: FOLLOWER
I20260811 05:08:07.513245 5649 consensus_queue.cc:260] T 00000000000000000000000000000000 P 25cb19e8f2c245629b828de638b93da3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8fed5a210a94d26b6993a9d4e186564" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 43813 } } peers { permanent_uuid: "25cb19e8f2c245629b828de638b93da3" member_type: VOTER last_known_addr { host: "127.26.191.253" port: 41643 } }
I20260811 05:08:07.513599 5649 sys_catalog.cc:564] T 00000000000000000000000000000000 P 25cb19e8f2c245629b828de638b93da3 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:08:07.513590 5663 sys_catalog.cc:455] T 00000000000000000000000000000000 P 25cb19e8f2c245629b828de638b93da3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8fed5a210a94d26b6993a9d4e186564" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 43813 } } peers { permanent_uuid: "25cb19e8f2c245629b828de638b93da3" member_type: VOTER last_known_addr { host: "127.26.191.253" port: 41643 } } }
I20260811 05:08:07.513722 5663 sys_catalog.cc:458] T 00000000000000000000000000000000 P 25cb19e8f2c245629b828de638b93da3 [sys.catalog]: This master's current role is: FOLLOWER
W20260811 05:08:07.515455 5678 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 25cb19e8f2c245629b828de638b93da3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 05:08:07.515519 5678 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 05:08:07.517506 5543 master_runner.cc:428] Detected that this master 25cb19e8f2c245629b828de638b93da3 is joining an existing cluster
I20260811 05:08:07.517571 5543 master_runner.cc:432] Initiating AddMaster RPC to add 127.26.191.253:41643
I20260811 05:08:07.526687 5687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:07.518635 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.253:41643 (local address 127.0.0.1:54740)
0811 05:08:07.518883 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:07.518891 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:07.518981 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:07.519133 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:07.519134 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:07.519340 (+ 206us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:07.519404 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:07.519406 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:07.520322 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:07.520323 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:07.521386 (+ 1063us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:07.521389 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:07.521852 (+ 463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:07.521853 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:07.521911 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:07.522395 (+ 484us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:07.522399 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:07.522786 (+ 387us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:08:07.525239 (+ 2453us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:07.525240 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:07.525241 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:07.525552 (+ 311us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:07.525823 (+ 271us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:07.525824 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:07.525824 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:07.525908 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:07.526268 (+ 360us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:08:07.526269 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:08:07.526320 (+ 51us) client_negotiation.cc:769] Sending connection context
0811 05:08:07.526427 (+ 107us) client_negotiation.cc:240] Negotiation successful
0811 05:08:07.526564 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":237,"mutex_wait_us":29,"thread_start_us":103,"threads_started":1}
I20260811 05:08:07.526767 4836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:07.518713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40688 (local address 127.26.191.254:43813)
0811 05:08:07.518800 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:07.518802 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:07.518927 (+ 125us) server_negotiation.cc:407] Connection header received
0811 05:08:07.518981 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:07.518983 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:07.518995 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:07.519055 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:07.519532 (+ 477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:07.520291 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:07.521252 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:07.521515 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:07.521583 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:07.522914 (+ 1331us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:07.522915 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:07.522916 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:08:07.522924 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:07.525110 (+ 2186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:07.525655 (+ 545us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:07.525657 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:07.525657 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:07.525737 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:07.526072 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:07.526074 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:07.526074 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:07.526270 (+ 196us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:07.526360 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:07.526543 (+ 183us) server_negotiation.cc:299] Negotiation successful
0811 05:08:07.526645 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 05:08:07.526799 5659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:07.518754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54740 (local address 127.26.191.253:41643)
0811 05:08:07.518839 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:07.518841 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:07.518958 (+ 117us) server_negotiation.cc:407] Connection header received
0811 05:08:07.519047 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:07.519047 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:07.519056 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:07.519084 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:07.519482 (+ 398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:07.520236 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:07.521492 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:07.521748 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:07.521832 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:07.522880 (+ 1048us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:07.522882 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:07.522882 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:08:07.522889 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:07.525064 (+ 2175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:07.525661 (+ 597us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:07.525662 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:07.525662 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:07.525732 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:07.525985 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:07.525987 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:07.525987 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:07.526175 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:07.526263 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:07.526467 (+ 204us) server_negotiation.cc:299] Negotiation successful
0811 05:08:07.526647 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":71,"server-negotiator.queue_time_us":70}
I20260811 05:08:07.527519 5688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:07.518632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:43813 (local address 127.0.0.1:40688)
0811 05:08:07.518841 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:07.518852 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:07.518920 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:07.519088 (+ 168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:07.519089 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:07.519383 (+ 294us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:07.519457 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:07.519459 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:07.520399 (+ 940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:07.520400 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:07.521111 (+ 711us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:07.521113 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:07.521611 (+ 498us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:07.521612 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:07.521679 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:07.522215 (+ 536us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:07.522221 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:07.522790 (+ 569us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:08:07.525218 (+ 2428us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:07.525219 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:07.525220 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:07.525553 (+ 333us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:07.525829 (+ 276us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:07.525831 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:07.525831 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:07.525974 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:07.526349 (+ 375us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:08:07.526350 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:08:07.526396 (+ 46us) client_negotiation.cc:769] Sending connection context
0811 05:08:07.527249 (+ 853us) client_negotiation.cc:240] Negotiation successful
0811 05:08:07.527388 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":178,"mutex_wait_us":30,"thread_start_us":109,"threads_started":1}
Aug 11 05:08:07 dist-test-slave-x5fp krb5kdc[4698](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424886, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.191.254@KRBTEST.COM for oryx/127.26.191.253@KRBTEST.COM
I20260811 05:08:07.539119 5689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:07.530108 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.253:41643 (local address 127.0.0.1:54752)
0811 05:08:07.530285 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:07.530337 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:07.530427 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:07.530582 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:07.530585 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:07.530989 (+ 404us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:07.531067 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:07.531069 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:07.531791 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:07.531792 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:07.532799 (+ 1007us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:07.532802 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:07.533235 (+ 433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:07.533237 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:07.533325 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:07.533846 (+ 521us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:07.533852 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:07.535559 (+ 1707us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:08:07.537727 (+ 2168us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:07.537774 (+ 47us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:07.537779 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:07.538058 (+ 279us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:07.538340 (+ 282us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:07.538341 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:07.538342 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:07.538413 (+ 71us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:07.538736 (+ 323us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:08:07.538744 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:08:07.538817 (+ 73us) client_negotiation.cc:769] Sending connection context
0811 05:08:07.538911 (+ 94us) client_negotiation.cc:240] Negotiation successful
0811 05:08:07.539025 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":119,"threads_started":1}
I20260811 05:08:07.539160 5659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:07.530167 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54752 (local address 127.26.191.253:41643)
0811 05:08:07.530229 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:07.530231 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:07.530432 (+ 201us) server_negotiation.cc:407] Connection header received
0811 05:08:07.530508 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:07.530508 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:07.530519 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:07.530576 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:07.531177 (+ 601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:07.531693 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:07.532949 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:07.533148 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:07.533220 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:07.535662 (+ 2442us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:07.535664 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:07.535665 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:08:07.535672 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:07.537574 (+ 1902us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:07.538144 (+ 570us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:07.538145 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:07.538146 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:07.538214 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:07.538490 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:07.538491 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:07.538491 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:07.538642 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:07.538719 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:07.538969 (+ 250us) server_negotiation.cc:299] Negotiation successful
0811 05:08:07.539057 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 05:08:07.540102 4769 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.26.191.253:41643: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "25cb19e8f2c245629b828de638b93da3"
member_type: NON_VOTER
last_known_addr {
host: "127.26.191.253"
port: 41643
}
attrs {
promote: true
}
}
dest_uuid: "b8fed5a210a94d26b6993a9d4e186564"
cas_config_opid_index: -1
I20260811 05:08:07.540555 4769 consensus_queue.cc:237] T 00000000000000000000000000000000 P b8fed5a210a94d26b6993a9d4e186564 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "b8fed5a210a94d26b6993a9d4e186564" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 43813 } } peers { permanent_uuid: "25cb19e8f2c245629b828de638b93da3" member_type: NON_VOTER last_known_addr { host: "127.26.191.253" port: 41643 } attrs { promote: true } }
I20260811 05:08:07.541188 5690 raft_consensus.cc:2932] T 00000000000000000000000000000000 P b8fed5a210a94d26b6993a9d4e186564 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 25cb19e8f2c245629b828de638b93da3 (127.26.191.253) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "b8fed5a210a94d26b6993a9d4e186564" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 43813 } } peers { permanent_uuid: "25cb19e8f2c245629b828de638b93da3" member_type: NON_VOTER last_known_addr { host: "127.26.191.253" port: 41643 } attrs { promote: true } } }
I20260811 05:08:07.541527 5606 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 25cb19e8f2c245629b828de638b93da3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:08:07.542225 5690 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.26.191.253:41643
I20260811 05:08:07.542419 5690 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8fed5a210a94d26b6993a9d4e186564 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "b8fed5a210a94d26b6993a9d4e186564" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "b8fed5a210a94d26b6993a9d4e186564" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 43813 } } peers { permanent_uuid: "25cb19e8f2c245629b828de638b93da3" member_type: NON_VOTER last_known_addr { host: "127.26.191.253" port: 41643 } attrs { promote: true } } }
I20260811 05:08:07.542537 5690 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8fed5a210a94d26b6993a9d4e186564 [sys.catalog]: This master's current role is: LEADER
I20260811 05:08:07.542531 5606 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 25cb19e8f2c245629b828de638b93da3 [term 1 FOLLOWER]: Refusing update from remote peer b8fed5a210a94d26b6993a9d4e186564: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260811 05:08:07.542609 5543 master.cc:537] Master@127.26.191.253:41643 shutting down...
I20260811 05:08:07.544387 5690 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b8fed5a210a94d26b6993a9d4e186564 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25cb19e8f2c245629b828de638b93da3" member_type: NON_VOTER last_known_addr { host: "127.26.191.253" port: 41643 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 05:08:07.545264 4745 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
I20260811 05:08:07.545812 5543 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 25cb19e8f2c245629b828de638b93da3 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260811 05:08:07.545897 4745 consensus_peers.cc:487] T 00000000000000000000000000000000 P b8fed5a210a94d26b6993a9d4e186564 -> Peer 25cb19e8f2c245629b828de638b93da3 (127.26.191.253:41643): Couldn't send request to peer 25cb19e8f2c245629b828de638b93da3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260811 05:08:07.545920 5543 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 25cb19e8f2c245629b828de638b93da3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:08:07.545975 5543 tablet_replica.cc:330] T 00000000000000000000000000000000 P 25cb19e8f2c245629b828de638b93da3: stopping tablet replica
I20260811 05:08:07.558672 5543 master.cc:552] Master@127.26.191.253:41643 shutdown complete.
I20260811 05:08:07.558758 5543 master_runner.cc:305] Clearing existing system tablet
I20260811 05:08:07.558897 5543 fs_manager.cc:359] Metadata directory not provided
I20260811 05:08:07.558962 5543 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:08:07.559710 5543 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.001s sys 0.000s
I20260811 05:08:07.560227 5699 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:07.560401 5543 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:08:07.560461 5543 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:07.560508 5543 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/master-1/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/master-1/wal
uuid: "25cb19e8f2c245629b828de638b93da3"
format_stamp: "Formatted at 2026-08-11 05:08:07 on dist-test-slave-x5fp"
server_key: "898e12b408f04dd46f241dbc6b0c08a6"
server_key_iv: "3b2d826289cface078b2e575605ef17b"
server_key_version: "encryptionkey@0"
I20260811 05:08:07.561794 5543 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 25cb19e8f2c245629b828de638b93da3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:08:07.563246 5543 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 25cb19e8f2c245629b828de638b93da3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260811 05:08:07.563308 5543 log.cc:1196] T 00000000000000000000000000000000 P 25cb19e8f2c245629b828de638b93da3: Deleting WAL directory at /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260811 05:08:07.563535 5543 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 25cb19e8f2c245629b828de638b93da3: Deleting consensus metadata
I20260811 05:08:07.563674 5543 master_runner.cc:315] Copying system tablet from 127.26.191.254:43813
I20260811 05:08:07.564333 5543 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 25cb19e8f2c245629b828de638b93da3: tablet copy: Beginning tablet copy session from remote peer at address 127.26.191.254:43813
I20260811 05:08:07.570839 5705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:07.564775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:43813 (local address 127.0.0.1:40694)
0811 05:08:07.564898 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:07.564909 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:07.564975 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:07.565117 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:07.565118 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:07.565306 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:07.565370 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:07.565372 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:07.566114 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:07.566115 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:07.566684 (+ 569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:07.566685 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:07.567091 (+ 406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:07.567092 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:07.567161 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:07.567688 (+ 527us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:07.567694 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:07.568015 (+ 321us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:08:07.569733 (+ 1718us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:07.569734 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:07.569734 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:07.569927 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:07.570142 (+ 215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:07.570143 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:07.570143 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:07.570206 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:07.570476 (+ 270us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:08:07.570477 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:08:07.570524 (+ 47us) client_negotiation.cc:769] Sending connection context
0811 05:08:07.570613 (+ 89us) client_negotiation.cc:240] Negotiation successful
0811 05:08:07.570724 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":87,"threads_started":1}
I20260811 05:08:07.570823 4836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:07.564894 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40694 (local address 127.26.191.254:43813)
0811 05:08:07.564956 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:07.564958 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:07.564971 (+ 13us) server_negotiation.cc:407] Connection header received
0811 05:08:07.565043 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:07.565044 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:07.565054 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:07.565112 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:07.565481 (+ 369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:07.566016 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:07.566772 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:07.566997 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:07.567089 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:07.568113 (+ 1024us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:07.568115 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:07.568115 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:08:07.568123 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:07.569632 (+ 1509us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:07.570004 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:07.570005 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:07.570006 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:07.570072 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:07.570288 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:07.570288 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:07.570289 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:07.570409 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:07.570486 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:07.570645 (+ 159us) server_negotiation.cc:299] Negotiation successful
0811 05:08:07.570722 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260811 05:08:07.571272 4802 tablet_copy_service.cc:140] P b8fed5a210a94d26b6993a9d4e186564: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 25cb19e8f2c245629b828de638b93da3 ({username='oryx', principal='oryx/127.26.191.253@KRBTEST.COM'} at 127.0.0.1:40694)
I20260811 05:08:07.571393 4802 tablet_copy_service.cc:161] P b8fed5a210a94d26b6993a9d4e186564: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 25cb19e8f2c245629b828de638b93da3 at {username='oryx', principal='oryx/127.26.191.253@KRBTEST.COM'} at 127.0.0.1:40694: session id = 25cb19e8f2c245629b828de638b93da3-00000000000000000000000000000000
I20260811 05:08:07.572191 4802 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P b8fed5a210a94d26b6993a9d4e186564: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 05:08:07.572927 5543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260811 05:08:07.573922 5543 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 25cb19e8f2c245629b828de638b93da3: tablet copy: Starting download of 0 data blocks...
I20260811 05:08:07.574085 5543 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 25cb19e8f2c245629b828de638b93da3: tablet copy: Starting download of 1 WAL segments...
I20260811 05:08:07.575120 5543 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 25cb19e8f2c245629b828de638b93da3: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 05:08:07.575989 4802 tablet_copy_service.cc:342] P b8fed5a210a94d26b6993a9d4e186564: Request end of tablet copy session 25cb19e8f2c245629b828de638b93da3-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.26.191.253@KRBTEST.COM'} at 127.0.0.1:40694
I20260811 05:08:07.576041 4802 tablet_copy_service.cc:433] P b8fed5a210a94d26b6993a9d4e186564: ending tablet copy session 25cb19e8f2c245629b828de638b93da3-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 25cb19e8f2c245629b828de638b93da3
I20260811 05:08:07.578678 5543 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:08:07.580204 5707 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:07.580255 5708 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:08:07.580416 5543 server_base.cc:1034] running on GCE node
W20260811 05:08:07.581712 5712 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:08:07.581913 5543 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:08:07.582078 5543 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:08:07.583226 5543 hybrid_clock.cc:648] HybridClock initialized: now 1786424887583218 us; error 30 us; skew 500 ppm
Aug 11 05:08:07 dist-test-slave-x5fp krb5kdc[4698](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424887, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.191.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:08:07.584867 5543 init.cc:377] Logged in from keytab as oryx/127.26.191.253@KRBTEST.COM (short username oryx)
I20260811 05:08:07.585208 5543 webserver.cc:460] Webserver started at http://127.26.191.253:45663/ using document root <none> and password file <none>
I20260811 05:08:07.585348 5543 fs_manager.cc:359] Metadata directory not provided
I20260811 05:08:07.585395 5543 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:08:07.586205 5543 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 05:08:07.586845 5724 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:07.586995 5543 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 05:08:07.587049 5543 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/master-1/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/master-1/wal
uuid: "25cb19e8f2c245629b828de638b93da3"
format_stamp: "Formatted at 2026-08-11 05:08:07 on dist-test-slave-x5fp"
server_key: "898e12b408f04dd46f241dbc6b0c08a6"
server_key_iv: "3b2d826289cface078b2e575605ef17b"
server_key_version: "encryptionkey@0"
I20260811 05:08:07.587118 5543 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:08:07.595551 5543 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:08:07.597519 5543 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:08:07.600993 5543 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.253:41643
I20260811 05:08:07.601435 5807 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.253:41643 every 8 connection(s)
I20260811 05:08:07.601488 5543 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/master-1/data/info.pb
I20260811 05:08:07.602370 5808 sys_catalog.cc:263] Verifying existing consensus state
I20260811 05:08:07.602854 5808 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 25cb19e8f2c245629b828de638b93da3: Bootstrap starting.
I20260811 05:08:07.605919 5808 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 25cb19e8f2c245629b828de638b93da3: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 05:08:07.606185 5808 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 25cb19e8f2c245629b828de638b93da3: Bootstrap complete.
I20260811 05:08:07.606417 5808 raft_consensus.cc:348] T 00000000000000000000000000000000 P 25cb19e8f2c245629b828de638b93da3 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "b8fed5a210a94d26b6993a9d4e186564" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 43813 } } peers { permanent_uuid: "25cb19e8f2c245629b828de638b93da3" member_type: NON_VOTER last_known_addr { host: "127.26.191.253" port: 41643 } attrs { promote: true } }
I20260811 05:08:07.606518 5808 raft_consensus.cc:729] T 00000000000000000000000000000000 P 25cb19e8f2c245629b828de638b93da3 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 25cb19e8f2c245629b828de638b93da3, State: Initialized, Role: LEARNER
I20260811 05:08:07.606576 5808 consensus_queue.cc:260] T 00000000000000000000000000000000 P 25cb19e8f2c245629b828de638b93da3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "b8fed5a210a94d26b6993a9d4e186564" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 43813 } } peers { permanent_uuid: "25cb19e8f2c245629b828de638b93da3" member_type: NON_VOTER last_known_addr { host: "127.26.191.253" port: 41643 } attrs { promote: true } }
I20260811 05:08:07.606799 5808 sys_catalog.cc:564] T 00000000000000000000000000000000 P 25cb19e8f2c245629b828de638b93da3 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:08:07.606796 5812 sys_catalog.cc:455] T 00000000000000000000000000000000 P 25cb19e8f2c245629b828de638b93da3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "b8fed5a210a94d26b6993a9d4e186564" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 43813 } } peers { permanent_uuid: "25cb19e8f2c245629b828de638b93da3" member_type: NON_VOTER last_known_addr { host: "127.26.191.253" port: 41643 } attrs { promote: true } } }
I20260811 05:08:07.606925 5812 sys_catalog.cc:458] T 00000000000000000000000000000000 P 25cb19e8f2c245629b828de638b93da3 [sys.catalog]: This master's current role is: LEARNER
I20260811 05:08:07.608963 5842 catalog_manager.cc:1259] Loaded cluster ID: 3ed6af74e2204dc5a8aa5a0144170ddf
I20260811 05:08:07.609665 5842 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 25cb19e8f2c245629b828de638b93da3: loading cluster ID for follower catalog manager: success
I20260811 05:08:07.611291 5842 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 25cb19e8f2c245629b828de638b93da3: acquiring CA information for follower catalog manager: success
I20260811 05:08:07.611617 5842 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 25cb19e8f2c245629b828de638b93da3: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 05:08:07.616577 5816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:07.607563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54758 (local address 127.26.191.253:41643)
0811 05:08:07.608646 (+ 1083us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:07.608648 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:07.608660 (+ 12us) server_negotiation.cc:407] Connection header received
0811 05:08:07.608688 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:07.608689 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:07.608701 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:07.608807 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:07.609519 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:07.610657 (+ 1138us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:07.611743 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:07.611970 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:07.612033 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:07.613589 (+ 1556us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:07.613591 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:07.613591 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:08:07.613598 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:07.615166 (+ 1568us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:07.615579 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:07.615580 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:07.615580 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:07.615639 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:07.615859 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:07.615859 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:07.615860 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:07.615965 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:07.616041 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:07.616259 (+ 218us) server_negotiation.cc:299] Negotiation successful
0811 05:08:07.616351 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1055,"thread_start_us":82,"threads_started":1}
WARNING: no policy specified for oryx/127.26.191.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.191.252@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.191.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/krb5kdc/oryx_127.26.191.252.keytab.
Entry for principal oryx/127.26.191.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/krb5kdc/oryx_127.26.191.252.keytab.
I20260811 05:08:07.645987 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.252:36269
--webserver_interface=127.26.191.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/krb5kdc/oryx_127.26.191.252.keytab
--principal=oryx/127.26.191.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:36473
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.191.254:43813,127.26.191.253:41643,127.26.191.252:36269
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:08:07.735169 5849 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:08:07.735409 5849 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:08:07.735433 5849 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:08:07.736734 5849 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:08:07.736794 5849 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:08:07.736811 5849 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:08:07.736826 5849 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:08:07.736840 5849 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:08:07.738683 5849 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:36473
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.26.191.254:43813,127.26.191.253:41643,127.26.191.252:36269
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/krb5kdc/oryx_127.26.191.252.keytab
--principal=oryx/127.26.191.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.252:36269
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.26.191.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5849
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:08:07.738981 5849 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:08:07.739231 5849 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:08:07.745076 5861 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:07.745083 5858 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:07.745129 5857 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:08:07.745389 5849 server_base.cc:1034] running on GCE node
I20260811 05:08:07.745674 5849 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:08:07.745949 5849 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:08:07.747129 5849 hybrid_clock.cc:648] HybridClock initialized: now 1786424887747115 us; error 33 us; skew 500 ppm
Aug 11 05:08:07 dist-test-slave-x5fp krb5kdc[4698](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424887, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.191.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:08:07.749890 5849 init.cc:377] Logged in from keytab as oryx/127.26.191.252@KRBTEST.COM (short username oryx)
I20260811 05:08:07.750387 5849 webserver.cc:460] Webserver started at http://127.26.191.252:46711/ using document root <none> and password file <none>
I20260811 05:08:07.750602 5849 fs_manager.cc:359] Metadata directory not provided
I20260811 05:08:07.750646 5849 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:08:07.750742 5849 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:08:07.751806 5849 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/master-2/data/instance:
uuid: "44992f39b96c43dba1e367c8788a8eb7"
format_stamp: "Formatted at 2026-08-11 05:08:07 on dist-test-slave-x5fp"
server_key: "2c87abda29c2166c27d2a6377b9dc9db"
server_key_iv: "48bcae58fb79b582963cca0e3a258fae"
server_key_version: "encryptionkey@0"
I20260811 05:08:07.752178 5849 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/master-2/wal/instance:
uuid: "44992f39b96c43dba1e367c8788a8eb7"
format_stamp: "Formatted at 2026-08-11 05:08:07 on dist-test-slave-x5fp"
server_key: "2c87abda29c2166c27d2a6377b9dc9db"
server_key_iv: "48bcae58fb79b582963cca0e3a258fae"
server_key_version: "encryptionkey@0"
I20260811 05:08:07.753813 5849 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 05:08:07.754786 5875 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:07.755170 5849 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 05:08:07.755291 5849 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/master-2/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/master-2/wal
uuid: "44992f39b96c43dba1e367c8788a8eb7"
format_stamp: "Formatted at 2026-08-11 05:08:07 on dist-test-slave-x5fp"
server_key: "2c87abda29c2166c27d2a6377b9dc9db"
server_key_iv: "48bcae58fb79b582963cca0e3a258fae"
server_key_version: "encryptionkey@0"
I20260811 05:08:07.755378 5849 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:08:07.762584 5849 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:08:07.765108 5849 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:08:07.765286 5849 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:08:07.770202 5849 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.252:36269
I20260811 05:08:07.770298 5961 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.252:36269 every 8 connection(s)
I20260811 05:08:07.770641 5849 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/master-2/data/info.pb
I20260811 05:08:07.771754 5963 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:08:07.772576 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 5849
I20260811 05:08:07.774051 5963 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.191.254" port: 43813 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 05:08:07 dist-test-slave-x5fp krb5kdc[4698](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424887, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.191.252@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM
Aug 11 05:08:07 dist-test-slave-x5fp krb5kdc[4698](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424886, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.26.191.252@KRBTEST.COM
I20260811 05:08:07.784009 4836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:07.774951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40700 (local address 127.26.191.254:43813)
0811 05:08:07.775015 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:07.775018 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:07.775113 (+ 95us) server_negotiation.cc:407] Connection header received
0811 05:08:07.775188 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:07.775189 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:07.775202 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:07.775258 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:07.775880 (+ 622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:07.776481 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:07.777520 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:07.777754 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:07.777831 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:07.780443 (+ 2612us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:07.780445 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:07.780446 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:08:07.780456 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:07.782269 (+ 1813us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:07.782808 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:07.782810 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:07.782810 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:07.782883 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:07.783143 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:07.783144 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:07.783145 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:07.783330 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:07.783395 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:07.783793 (+ 398us) server_negotiation.cc:299] Negotiation successful
0811 05:08:07.783882 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 05:08:07.784158 5967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:07.774807 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:43813 (local address 127.0.0.1:40700)
0811 05:08:07.774996 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:07.775036 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:07.775111 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:07.775291 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:07.775294 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:07.775636 (+ 342us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:07.775755 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:07.775761 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:07.776587 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:07.776588 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:07.777433 (+ 845us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:07.777435 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:07.777886 (+ 451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:07.777887 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:07.777960 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:07.778678 (+ 718us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:07.778687 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:07.780341 (+ 1654us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:08:07.782404 (+ 2063us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:07.782413 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:07.782416 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:07.782695 (+ 279us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:07.782961 (+ 266us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:07.782962 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:07.782962 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:07.783071 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:07.783407 (+ 336us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:08:07.783414 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:08:07.783595 (+ 181us) client_negotiation.cc:769] Sending connection context
0811 05:08:07.783698 (+ 103us) client_negotiation.cc:240] Negotiation successful
0811 05:08:07.783891 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":136,"threads_started":1}
I20260811 05:08:07.784849 5965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:07.773350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34830 (local address 127.26.191.252:36269)
0811 05:08:07.773575 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:07.773585 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:07.773620 (+ 35us) server_negotiation.cc:407] Connection header received
0811 05:08:07.774140 (+ 520us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:07.774149 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:07.774202 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:07.774341 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:07.775206 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:07.776338 (+ 1132us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:07.777252 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:07.777683 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:07.777774 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:07.781190 (+ 3416us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:07.781197 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:07.781197 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:08:07.781204 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:07.783202 (+ 1998us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:07.783616 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:07.783619 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:07.783619 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:07.783674 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:07.783959 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:07.783960 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:07.783960 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:07.784144 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:07.784580 (+ 436us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:07.784632 (+ 52us) server_negotiation.cc:299] Negotiation successful
0811 05:08:07.784742 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":171,"thread_start_us":102,"threads_started":1}
I20260811 05:08:07.784847 5963 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.191.253" port: 41643 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 05:08:07 dist-test-slave-x5fp krb5kdc[4698](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424887, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.191.252@KRBTEST.COM for oryx/127.26.191.253@KRBTEST.COM
I20260811 05:08:07.792186 5967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:07.785163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.253:41643 (local address 127.0.0.1:54764)
0811 05:08:07.785261 (+ 98us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:07.785272 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:07.785322 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:07.785504 (+ 182us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:07.785504 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:07.785663 (+ 159us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:07.785722 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:07.785724 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:07.786439 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:07.786440 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:07.786961 (+ 521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:07.786963 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:07.787487 (+ 524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:07.787488 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:07.787544 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:07.787938 (+ 394us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:07.787942 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:07.789292 (+ 1350us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:08:07.791084 (+ 1792us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:07.791085 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:07.791086 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:07.791249 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:07.791488 (+ 239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:07.791489 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:07.791489 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:07.791555 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:07.791918 (+ 363us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:08:07.791919 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:08:07.791960 (+ 41us) client_negotiation.cc:769] Sending connection context
0811 05:08:07.792032 (+ 72us) client_negotiation.cc:240] Negotiation successful
0811 05:08:07.792114 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":79}
I20260811 05:08:07.792217 5816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:07.785295 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54764 (local address 127.26.191.253:41643)
0811 05:08:07.785365 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:07.785367 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:07.785374 (+ 7us) server_negotiation.cc:407] Connection header received
0811 05:08:07.785397 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:07.785397 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:07.785425 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:07.785502 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:07.785802 (+ 300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:07.786360 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:07.787125 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:07.787413 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:07.787509 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:07.789383 (+ 1874us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:07.789384 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:07.789384 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:08:07.789391 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:07.790996 (+ 1605us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:07.791333 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:07.791333 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:07.791334 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:07.791398 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:07.791674 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:07.791676 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:07.791676 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:07.791820 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:07.791897 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:07.792051 (+ 154us) server_negotiation.cc:299] Negotiation successful
0811 05:08:07.792145 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 05:08:07.792842 5963 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.191.252" port: 36269 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 05:08:07 dist-test-slave-x5fp krb5kdc[4698](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424887, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.191.252@KRBTEST.COM for oryx/127.26.191.252@KRBTEST.COM
I20260811 05:08:07.799782 5967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:07.793169 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.252:36269 (local address 127.0.0.1:34842)
0811 05:08:07.793224 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:07.793242 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:07.793284 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:07.793390 (+ 106us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:07.793391 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:07.793512 (+ 121us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:07.793545 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:07.793546 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:07.794270 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:07.794270 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:07.794746 (+ 476us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:07.794748 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:07.795114 (+ 366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:07.795114 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:07.795300 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:07.795728 (+ 428us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:07.795732 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:07.797088 (+ 1356us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:08:07.798943 (+ 1855us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:07.798944 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:07.798944 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:07.799111 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:07.799289 (+ 178us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:07.799290 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:07.799290 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:07.799343 (+ 53us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:07.799531 (+ 188us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:08:07.799532 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:08:07.799567 (+ 35us) client_negotiation.cc:769] Sending connection context
0811 05:08:07.799623 (+ 56us) client_negotiation.cc:240] Negotiation successful
0811 05:08:07.799704 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37}
I20260811 05:08:07.799845 5965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:07.793198 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34842 (local address 127.26.191.252:36269)
0811 05:08:07.793272 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:07.793273 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:07.793282 (+ 9us) server_negotiation.cc:407] Connection header received
0811 05:08:07.793324 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:07.793325 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:07.793332 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:07.793386 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:07.793632 (+ 246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:07.794186 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:07.794827 (+ 641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:07.795038 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:07.795102 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:07.797175 (+ 2073us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:07.797176 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:07.797177 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:08:07.797183 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:07.798861 (+ 1678us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:07.799181 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:07.799181 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:07.799182 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:07.799230 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:07.799383 (+ 153us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:07.799383 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:07.799383 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:07.799480 (+ 97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:07.799529 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:07.799640 (+ 111us) server_negotiation.cc:299] Negotiation successful
0811 05:08:07.799752 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":48,"server-negotiator.queue_time_us":55}
I20260811 05:08:07.801436 5963 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 44992f39b96c43dba1e367c8788a8eb7: Bootstrap starting.
I20260811 05:08:07.802330 5963 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 44992f39b96c43dba1e367c8788a8eb7: Neither blocks nor log segments found. Creating new log.
I20260811 05:08:07.802645 5963 log.cc:824] T 00000000000000000000000000000000 P 44992f39b96c43dba1e367c8788a8eb7: Log is configured to *not* fsync() on all Append() calls
I20260811 05:08:07.803448 5963 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 44992f39b96c43dba1e367c8788a8eb7: No bootstrap required, opened a new log
I20260811 05:08:07.805135 5963 raft_consensus.cc:348] T 00000000000000000000000000000000 P 44992f39b96c43dba1e367c8788a8eb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8fed5a210a94d26b6993a9d4e186564" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 43813 } } peers { permanent_uuid: "25cb19e8f2c245629b828de638b93da3" member_type: VOTER last_known_addr { host: "127.26.191.253" port: 41643 } } peers { permanent_uuid: "44992f39b96c43dba1e367c8788a8eb7" member_type: VOTER last_known_addr { host: "127.26.191.252" port: 36269 } }
I20260811 05:08:07.805299 5963 raft_consensus.cc:374] T 00000000000000000000000000000000 P 44992f39b96c43dba1e367c8788a8eb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:08:07.805352 5963 raft_consensus.cc:729] T 00000000000000000000000000000000 P 44992f39b96c43dba1e367c8788a8eb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44992f39b96c43dba1e367c8788a8eb7, State: Initialized, Role: FOLLOWER
I20260811 05:08:07.805505 5963 consensus_queue.cc:260] T 00000000000000000000000000000000 P 44992f39b96c43dba1e367c8788a8eb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8fed5a210a94d26b6993a9d4e186564" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 43813 } } peers { permanent_uuid: "25cb19e8f2c245629b828de638b93da3" member_type: VOTER last_known_addr { host: "127.26.191.253" port: 41643 } } peers { permanent_uuid: "44992f39b96c43dba1e367c8788a8eb7" member_type: VOTER last_known_addr { host: "127.26.191.252" port: 36269 } }
I20260811 05:08:07.805816 5970 sys_catalog.cc:455] T 00000000000000000000000000000000 P 44992f39b96c43dba1e367c8788a8eb7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8fed5a210a94d26b6993a9d4e186564" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 43813 } } peers { permanent_uuid: "25cb19e8f2c245629b828de638b93da3" member_type: VOTER last_known_addr { host: "127.26.191.253" port: 41643 } } peers { permanent_uuid: "44992f39b96c43dba1e367c8788a8eb7" member_type: VOTER last_known_addr { host: "127.26.191.252" port: 36269 } } }
I20260811 05:08:07.805891 5963 sys_catalog.cc:564] T 00000000000000000000000000000000 P 44992f39b96c43dba1e367c8788a8eb7 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:08:07.805940 5970 sys_catalog.cc:458] T 00000000000000000000000000000000 P 44992f39b96c43dba1e367c8788a8eb7 [sys.catalog]: This master's current role is: FOLLOWER
W20260811 05:08:07.808032 5986 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 44992f39b96c43dba1e367c8788a8eb7: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 05:08:07.808092 5986 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 05:08:07.810673 5849 master_runner.cc:428] Detected that this master 44992f39b96c43dba1e367c8788a8eb7 is joining an existing cluster
I20260811 05:08:07.810815 5849 master_runner.cc:432] Initiating AddMaster RPC to add 127.26.191.252:36269
I20260811 05:08:07.819962 4836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:07.812126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40710 (local address 127.26.191.254:43813)
0811 05:08:07.812209 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:07.812211 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:07.812352 (+ 141us) server_negotiation.cc:407] Connection header received
0811 05:08:07.812539 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:07.812540 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:07.812554 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:07.812611 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:07.813241 (+ 630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:07.813983 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:07.815202 (+ 1219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:07.815560 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:07.815606 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:07.817072 (+ 1466us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:07.817074 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:07.817074 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:08:07.817083 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:07.818594 (+ 1511us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:07.819018 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:07.819020 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:07.819021 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:07.819098 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:07.819344 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:07.819345 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:07.819346 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:07.819483 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:07.819571 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:07.819751 (+ 180us) server_negotiation.cc:299] Negotiation successful
0811 05:08:07.819847 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260811 05:08:07.819977 6004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:07.811992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:43813 (local address 127.0.0.1:40710)
0811 05:08:07.812288 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:07.812299 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:07.812380 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:07.812662 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:07.812663 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:07.813031 (+ 368us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:07.813141 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:07.813143 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:07.814079 (+ 936us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:07.814079 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:07.815030 (+ 951us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:07.815033 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:07.815687 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:07.815687 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:07.815752 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:07.816399 (+ 647us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:07.816413 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:07.816896 (+ 483us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:08:07.818716 (+ 1820us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:07.818717 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:07.818718 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:07.818930 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:07.819173 (+ 243us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:07.819174 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:07.819174 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:07.819245 (+ 71us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:07.819560 (+ 315us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:08:07.819561 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:08:07.819613 (+ 52us) client_negotiation.cc:769] Sending connection context
0811 05:08:07.819715 (+ 102us) client_negotiation.cc:240] Negotiation successful
0811 05:08:07.819845 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":267,"mutex_wait_us":29,"thread_start_us":78,"threads_started":1}
Aug 11 05:08:07 dist-test-slave-x5fp krb5kdc[4698](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424886, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.191.254@KRBTEST.COM for oryx/127.26.191.252@KRBTEST.COM
I20260811 05:08:07.833748 5816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:07.812072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54766 (local address 127.26.191.253:41643)
0811 05:08:07.812172 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:07.812175 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:07.812274 (+ 99us) server_negotiation.cc:407] Connection header received
0811 05:08:07.812384 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:07.812385 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:07.812396 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:07.812444 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:07.813015 (+ 571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:07.813940 (+ 925us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:07.815251 (+ 1311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:07.815579 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:07.815629 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:07.830266 (+ 14637us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:07.830268 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:07.830269 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:08:07.830279 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:07.832352 (+ 2073us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:07.832937 (+ 585us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:07.832939 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:07.832939 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:07.832996 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:07.833202 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:07.833203 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:07.833216 (+ 13us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:07.833349 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:07.833399 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:07.833587 (+ 188us) server_negotiation.cc:299] Negotiation successful
0811 05:08:07.833662 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260811 05:08:07.833752 6005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:07.812229 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.252:36269 (local address 127.0.0.1:34856)
0811 05:08:07.812570 (+ 341us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:07.812579 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:07.812635 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:07.812837 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:07.812838 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:07.813069 (+ 231us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:07.813141 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:07.813143 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:07.814054 (+ 911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:07.814055 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:07.815096 (+ 1041us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:07.815099 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:07.815677 (+ 578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:07.815678 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:07.815760 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:07.829536 (+ 13776us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:07.829541 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:07.830108 (+ 567us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:08:07.832450 (+ 2342us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:07.832451 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:07.832452 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:07.832841 (+ 389us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:07.833039 (+ 198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:07.833039 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:07.833040 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:07.833095 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:07.833383 (+ 288us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:08:07.833384 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:08:07.833424 (+ 40us) client_negotiation.cc:769] Sending connection context
0811 05:08:07.833476 (+ 52us) client_negotiation.cc:240] Negotiation successful
0811 05:08:07.833600 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":326,"mutex_wait_us":71,"thread_start_us":73,"threads_started":1}
I20260811 05:08:07.834046 5689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:07.822907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.252:36269 (local address 127.0.0.1:34864)
0811 05:08:07.822948 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:07.822959 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:07.823001 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:07.823293 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:07.823294 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:07.823485 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:07.823529 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:07.823531 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:07.824236 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:07.824238 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:07.824852 (+ 614us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:07.824854 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:07.825268 (+ 414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:07.825269 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:07.825344 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:07.825901 (+ 557us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:07.825906 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:07.827268 (+ 1362us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:08:07.832752 (+ 5484us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:07.832753 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:07.832754 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:07.833025 (+ 271us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:07.833268 (+ 243us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:07.833269 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:07.833269 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:07.833336 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:07.833674 (+ 338us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:08:07.833676 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:08:07.833729 (+ 53us) client_negotiation.cc:769] Sending connection context
0811 05:08:07.833781 (+ 52us) client_negotiation.cc:240] Negotiation successful
0811 05:08:07.833925 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":20}
I20260811 05:08:07.834227 5965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:07.812368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34856 (local address 127.26.191.252:36269)
0811 05:08:07.812443 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:07.812444 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:07.812616 (+ 172us) server_negotiation.cc:407] Connection header received
0811 05:08:07.812693 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:07.812694 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:07.812703 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:07.812774 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:07.813228 (+ 454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:07.813949 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:07.815194 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:07.815510 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:07.815555 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:07.830225 (+ 14670us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:07.830227 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:07.830227 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:08:07.830234 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:07.832335 (+ 2101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:07.832915 (+ 580us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:07.832916 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:07.832917 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:07.832973 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:07.833156 (+ 183us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:07.833157 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:07.833157 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:07.833296 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:07.833360 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:07.834033 (+ 673us) server_negotiation.cc:299] Negotiation successful
0811 05:08:07.834127 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 05:08:07.834564 6003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:07.811979 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.253:41643 (local address 127.0.0.1:54766)
0811 05:08:07.812172 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:07.812184 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:07.812306 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:07.812514 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:07.812515 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:07.812808 (+ 293us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:07.812913 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:07.812916 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:07.814071 (+ 1155us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:07.814072 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:07.815129 (+ 1057us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:07.815132 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:07.815723 (+ 591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:07.815724 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:07.815918 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:07.829445 (+ 13527us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:07.829450 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:07.830135 (+ 685us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:08:07.832451 (+ 2316us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:07.832451 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:07.832452 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:07.832835 (+ 383us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:07.833075 (+ 240us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:07.833075 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:07.833075 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:07.833129 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:07.833432 (+ 303us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:08:07.833433 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:08:07.833468 (+ 35us) client_negotiation.cc:769] Sending connection context
0811 05:08:07.834065 (+ 597us) client_negotiation.cc:240] Negotiation successful
0811 05:08:07.834496 (+ 431us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"spinlock_wait_cycles":9984,"thread_start_us":126,"threads_started":1}
I20260811 05:08:07.835315 6006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:07.822946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34864 (local address 127.26.191.252:36269)
0811 05:08:07.823158 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:07.823160 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:07.823166 (+ 6us) server_negotiation.cc:407] Connection header received
0811 05:08:07.823201 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:07.823202 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:07.823210 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:07.823287 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:07.823619 (+ 332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:07.824150 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:07.824937 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:07.825187 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:07.825268 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:07.827399 (+ 2131us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:07.827401 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:07.827402 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:08:07.827411 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:07.832606 (+ 5195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:07.833122 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:07.833123 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:07.833124 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:07.833185 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:07.833415 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:07.833416 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:07.833416 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:07.833588 (+ 172us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:07.835055 (+ 1467us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:07.835099 (+ 44us) server_negotiation.cc:299] Negotiation successful
0811 05:08:07.835189 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":189,"thread_start_us":123,"threads_started":1}
I20260811 05:08:07.836040 4769 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.26.191.252:36269: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "44992f39b96c43dba1e367c8788a8eb7"
member_type: NON_VOTER
last_known_addr {
host: "127.26.191.252"
port: 36269
}
attrs {
promote: true
}
}
dest_uuid: "b8fed5a210a94d26b6993a9d4e186564"
cas_config_opid_index: 5
I20260811 05:08:07.836328 4769 consensus_queue.cc:237] T 00000000000000000000000000000000 P b8fed5a210a94d26b6993a9d4e186564 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "b8fed5a210a94d26b6993a9d4e186564" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 43813 } } peers { permanent_uuid: "25cb19e8f2c245629b828de638b93da3" member_type: NON_VOTER last_known_addr { host: "127.26.191.253" port: 41643 } attrs { promote: true } } peers { permanent_uuid: "44992f39b96c43dba1e367c8788a8eb7" member_type: NON_VOTER last_known_addr { host: "127.26.191.252" port: 36269 } attrs { promote: true } }
I20260811 05:08:07.836889 5693 raft_consensus.cc:2932] T 00000000000000000000000000000000 P b8fed5a210a94d26b6993a9d4e186564 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 44992f39b96c43dba1e367c8788a8eb7 (127.26.191.252) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "b8fed5a210a94d26b6993a9d4e186564" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 43813 } } peers { permanent_uuid: "25cb19e8f2c245629b828de638b93da3" member_type: NON_VOTER last_known_addr { host: "127.26.191.253" port: 41643 } attrs { promote: true } } peers { permanent_uuid: "44992f39b96c43dba1e367c8788a8eb7" member_type: NON_VOTER last_known_addr { host: "127.26.191.252" port: 36269 } attrs { promote: true } } }
I20260811 05:08:07.837085 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 4875
I20260811 05:08:07.837298 5915 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 44992f39b96c43dba1e367c8788a8eb7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:08:07.838241 5693 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.26.191.252:36269
I20260811 05:08:07.838341 5693 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8fed5a210a94d26b6993a9d4e186564 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "b8fed5a210a94d26b6993a9d4e186564" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "b8fed5a210a94d26b6993a9d4e186564" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 43813 } } peers { permanent_uuid: "25cb19e8f2c245629b828de638b93da3" member_type: NON_VOTER last_known_addr { host: "127.26.191.253" port: 41643 } attrs { promote: true } } peers { permanent_uuid: "44992f39b96c43dba1e367c8788a8eb7" member_type: NON_VOTER last_known_addr { host: "127.26.191.252" port: 36269 } attrs { promote: true } } }
I20260811 05:08:07.838420 5693 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8fed5a210a94d26b6993a9d4e186564 [sys.catalog]: This master's current role is: LEADER
I20260811 05:08:07.839118 5915 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 44992f39b96c43dba1e367c8788a8eb7 [term 1 FOLLOWER]: Refusing update from remote peer b8fed5a210a94d26b6993a9d4e186564: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260811 05:08:07.839171 5849 master.cc:537] Master@127.26.191.252:36269 shutting down...
I20260811 05:08:07.841878 5690 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b8fed5a210a94d26b6993a9d4e186564 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44992f39b96c43dba1e367c8788a8eb7" member_type: NON_VOTER last_known_addr { host: "127.26.191.252" port: 36269 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 05:08:07.842742 4745 consensus_peers.cc:487] T 00000000000000000000000000000000 P b8fed5a210a94d26b6993a9d4e186564 -> Peer 44992f39b96c43dba1e367c8788a8eb7 (127.26.191.252:36269): Couldn't send request to peer 44992f39b96c43dba1e367c8788a8eb7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260811 05:08:07.846375 5849 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 44992f39b96c43dba1e367c8788a8eb7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 05:08:07.846494 5849 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 44992f39b96c43dba1e367c8788a8eb7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:08:07.846544 5849 tablet_replica.cc:330] T 00000000000000000000000000000000 P 44992f39b96c43dba1e367c8788a8eb7: stopping tablet replica
I20260811 05:08:07.848001 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.191.193:39383
--local_ip_for_outbound_sockets=127.26.191.193
--tserver_master_addrs=127.26.191.254:43813
--webserver_port=46389
--webserver_interface=127.26.191.193
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/krb5kdc/oryx_127.26.191.193.keytab
--principal=oryx/127.26.191.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:36473
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.26.191.254:43813,127.26.191.253:41643
--tserver_master_addrs=127.26.191.254:43813,127.26.191.253:41643,127.26.191.252:36269 with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 05:08:07.849047 5689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:07.836895 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.253:41643 (local address 127.0.0.1:54782)
0811 05:08:07.839155 (+ 2260us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:07.839169 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:07.839215 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:07.845245 (+ 6030us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:07.845247 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:07.845249 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:08:07.845304 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:07.845307 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:07.846311 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:07.846313 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:07.847669 (+ 1356us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:07.847673 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:07.848665 (+ 992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:07.848667 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:07.848798 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:07.848844 (+ 46us) client_negotiation.cc:769] Sending connection context
0811 05:08:07.848906 (+ 62us) client_negotiation.cc:240] Negotiation successful
0811 05:08:07.848958 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2234}
I20260811 05:08:07.849346 5816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:07.836995 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54782 (local address 127.26.191.253:41643)
0811 05:08:07.844988 (+ 7993us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:07.844991 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:07.845003 (+ 12us) server_negotiation.cc:407] Connection header received
0811 05:08:07.845033 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:07.845035 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:07.845063 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:07.845139 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:08:07.845417 (+ 278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:07.846206 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:07.847776 (+ 1570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:07.848468 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:07.848553 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:07.848625 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:07.849223 (+ 598us) server_negotiation.cc:299] Negotiation successful
0811 05:08:07.849273 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7958}
I20260811 05:08:07.850118 5770 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 25cb19e8f2c245629b828de638b93da3 [term 1 LEARNER]: Refusing update from remote peer b8fed5a210a94d26b6993a9d4e186564: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260811 05:08:07.850392 5690 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b8fed5a210a94d26b6993a9d4e186564 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25cb19e8f2c245629b828de638b93da3" member_type: NON_VOTER last_known_addr { host: "127.26.191.253" port: 41643 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260811 05:08:07.851016 5770 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 25cb19e8f2c245629b828de638b93da3 [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 44992f39b96c43dba1e367c8788a8eb7 (127.26.191.252) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "b8fed5a210a94d26b6993a9d4e186564" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 43813 } } peers { permanent_uuid: "25cb19e8f2c245629b828de638b93da3" member_type: NON_VOTER last_known_addr { host: "127.26.191.253" port: 41643 } attrs { promote: true } } peers { permanent_uuid: "44992f39b96c43dba1e367c8788a8eb7" member_type: NON_VOTER last_known_addr { host: "127.26.191.252" port: 36269 } attrs { promote: true } } }
I20260811 05:08:07.852258 6010 sys_catalog.cc:455] T 00000000000000000000000000000000 P 25cb19e8f2c245629b828de638b93da3 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b8fed5a210a94d26b6993a9d4e186564" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "b8fed5a210a94d26b6993a9d4e186564" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 43813 } } peers { permanent_uuid: "25cb19e8f2c245629b828de638b93da3" member_type: NON_VOTER last_known_addr { host: "127.26.191.253" port: 41643 } attrs { promote: true } } peers { permanent_uuid: "44992f39b96c43dba1e367c8788a8eb7" member_type: NON_VOTER last_known_addr { host: "127.26.191.252" port: 36269 } attrs { promote: true } } }
I20260811 05:08:07.852382 6010 sys_catalog.cc:458] T 00000000000000000000000000000000 P 25cb19e8f2c245629b828de638b93da3 [sys.catalog]: This master's current role is: LEARNER
I20260811 05:08:07.852708 5812 sys_catalog.cc:455] T 00000000000000000000000000000000 P 25cb19e8f2c245629b828de638b93da3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b8fed5a210a94d26b6993a9d4e186564. Latest consensus state: current_term: 1 leader_uuid: "b8fed5a210a94d26b6993a9d4e186564" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "b8fed5a210a94d26b6993a9d4e186564" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 43813 } } peers { permanent_uuid: "25cb19e8f2c245629b828de638b93da3" member_type: NON_VOTER last_known_addr { host: "127.26.191.253" port: 41643 } attrs { promote: true } } peers { permanent_uuid: "44992f39b96c43dba1e367c8788a8eb7" member_type: NON_VOTER last_known_addr { host: "127.26.191.252" port: 36269 } attrs { promote: true } } }
I20260811 05:08:07.852881 5812 sys_catalog.cc:458] T 00000000000000000000000000000000 P 25cb19e8f2c245629b828de638b93da3 [sys.catalog]: This master's current role is: LEARNER
I20260811 05:08:07.863498 5690 raft_consensus.cc:1050] T 00000000000000000000000000000000 P b8fed5a210a94d26b6993a9d4e186564: attempting to promote NON_VOTER 25cb19e8f2c245629b828de638b93da3 to VOTER
I20260811 05:08:07.863785 5849 master.cc:552] Master@127.26.191.252:36269 shutdown complete.
I20260811 05:08:07.863845 5849 master_runner.cc:305] Clearing existing system tablet
I20260811 05:08:07.863782 5690 consensus_queue.cc:237] T 00000000000000000000000000000000 P b8fed5a210a94d26b6993a9d4e186564 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b8fed5a210a94d26b6993a9d4e186564" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 43813 } } peers { permanent_uuid: "25cb19e8f2c245629b828de638b93da3" member_type: VOTER last_known_addr { host: "127.26.191.253" port: 41643 } attrs { promote: false } } peers { permanent_uuid: "44992f39b96c43dba1e367c8788a8eb7" member_type: NON_VOTER last_known_addr { host: "127.26.191.252" port: 36269 } attrs { promote: true } }
I20260811 05:08:07.863997 5849 fs_manager.cc:359] Metadata directory not provided
I20260811 05:08:07.864045 5849 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:08:07.864900 5770 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 25cb19e8f2c245629b828de638b93da3 [term 1 LEARNER]: Refusing update from remote peer b8fed5a210a94d26b6993a9d4e186564: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260811 05:08:07.864977 5849 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.001s
I20260811 05:08:07.865252 5693 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b8fed5a210a94d26b6993a9d4e186564 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25cb19e8f2c245629b828de638b93da3" member_type: VOTER last_known_addr { host: "127.26.191.253" port: 41643 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260811 05:08:07.865495 6017 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:07.865598 5849 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:08:07.865644 5849 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:07.865667 5849 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/master-2/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/master-2/wal
uuid: "44992f39b96c43dba1e367c8788a8eb7"
format_stamp: "Formatted at 2026-08-11 05:08:07 on dist-test-slave-x5fp"
server_key: "2c87abda29c2166c27d2a6377b9dc9db"
server_key_iv: "48bcae58fb79b582963cca0e3a258fae"
server_key_version: "encryptionkey@0"
I20260811 05:08:07.866016 5689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:07.864367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.252:36269 (local address 127.0.0.1:34868)
0811 05:08:07.865912 (+ 1545us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:07.865980 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.252:36269: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1522}
I20260811 05:08:07.866475 5689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:07.866316 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.252:36269 (local address 127.0.0.1:34884)
0811 05:08:07.866425 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:07.866448 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.252:36269: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":70,"threads_started":1}
W20260811 05:08:07.866607 4745 consensus_peers.cc:487] T 00000000000000000000000000000000 P b8fed5a210a94d26b6993a9d4e186564 -> Peer 44992f39b96c43dba1e367c8788a8eb7 (127.26.191.252:36269): Couldn't send request to peer 44992f39b96c43dba1e367c8788a8eb7. Status: Network error: Client connection negotiation failed: client connection to 127.26.191.252:36269: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 05:08:07.866578 5849 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 44992f39b96c43dba1e367c8788a8eb7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:08:07.867046 5693 raft_consensus.cc:2932] T 00000000000000000000000000000000 P b8fed5a210a94d26b6993a9d4e186564 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 25cb19e8f2c245629b828de638b93da3 (127.26.191.253) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b8fed5a210a94d26b6993a9d4e186564" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 43813 } } peers { permanent_uuid: "25cb19e8f2c245629b828de638b93da3" member_type: VOTER last_known_addr { host: "127.26.191.253" port: 41643 } attrs { promote: false } } peers { permanent_uuid: "44992f39b96c43dba1e367c8788a8eb7" member_type: NON_VOTER last_known_addr { host: "127.26.191.252" port: 36269 } attrs { promote: true } } }
I20260811 05:08:07.867964 5693 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8fed5a210a94d26b6993a9d4e186564 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "b8fed5a210a94d26b6993a9d4e186564" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b8fed5a210a94d26b6993a9d4e186564" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 43813 } } peers { permanent_uuid: "25cb19e8f2c245629b828de638b93da3" member_type: VOTER last_known_addr { host: "127.26.191.253" port: 41643 } attrs { promote: false } } peers { permanent_uuid: "44992f39b96c43dba1e367c8788a8eb7" member_type: NON_VOTER last_known_addr { host: "127.26.191.252" port: 36269 } attrs { promote: true } } }
I20260811 05:08:07.868037 5693 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8fed5a210a94d26b6993a9d4e186564 [sys.catalog]: This master's current role is: LEADER
I20260811 05:08:07.868084 5693 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8fed5a210a94d26b6993a9d4e186564 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b8fed5a210a94d26b6993a9d4e186564" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b8fed5a210a94d26b6993a9d4e186564" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 43813 } } peers { permanent_uuid: "25cb19e8f2c245629b828de638b93da3" member_type: VOTER last_known_addr { host: "127.26.191.253" port: 41643 } attrs { promote: false } } peers { permanent_uuid: "44992f39b96c43dba1e367c8788a8eb7" member_type: NON_VOTER last_known_addr { host: "127.26.191.252" port: 36269 } attrs { promote: true } } }
I20260811 05:08:07.868121 5693 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8fed5a210a94d26b6993a9d4e186564 [sys.catalog]: This master's current role is: LEADER
I20260811 05:08:07.868130 5849 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 44992f39b96c43dba1e367c8788a8eb7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260811 05:08:07.868198 5849 log.cc:1196] T 00000000000000000000000000000000 P 44992f39b96c43dba1e367c8788a8eb7: Deleting WAL directory at /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260811 05:08:07.868417 5849 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 44992f39b96c43dba1e367c8788a8eb7: Deleting consensus metadata
I20260811 05:08:07.868606 5849 master_runner.cc:315] Copying system tablet from 127.26.191.254:43813
I20260811 05:08:07.868678 5770 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 25cb19e8f2c245629b828de638b93da3 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 25cb19e8f2c245629b828de638b93da3 (127.26.191.253) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b8fed5a210a94d26b6993a9d4e186564" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 43813 } } peers { permanent_uuid: "25cb19e8f2c245629b828de638b93da3" member_type: VOTER last_known_addr { host: "127.26.191.253" port: 41643 } attrs { promote: false } } peers { permanent_uuid: "44992f39b96c43dba1e367c8788a8eb7" member_type: NON_VOTER last_known_addr { host: "127.26.191.252" port: 36269 } attrs { promote: true } } }
I20260811 05:08:07.869335 5849 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 44992f39b96c43dba1e367c8788a8eb7: tablet copy: Beginning tablet copy session from remote peer at address 127.26.191.254:43813
I20260811 05:08:07.869616 5812 sys_catalog.cc:455] T 00000000000000000000000000000000 P 25cb19e8f2c245629b828de638b93da3 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b8fed5a210a94d26b6993a9d4e186564" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b8fed5a210a94d26b6993a9d4e186564" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 43813 } } peers { permanent_uuid: "25cb19e8f2c245629b828de638b93da3" member_type: VOTER last_known_addr { host: "127.26.191.253" port: 41643 } attrs { promote: false } } peers { permanent_uuid: "44992f39b96c43dba1e367c8788a8eb7" member_type: NON_VOTER last_known_addr { host: "127.26.191.252" port: 36269 } attrs { promote: true } } }
I20260811 05:08:07.869710 5812 sys_catalog.cc:458] T 00000000000000000000000000000000 P 25cb19e8f2c245629b828de638b93da3 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 05:08:07.877667 4836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:07.870013 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40718 (local address 127.26.191.254:43813)
0811 05:08:07.870059 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:07.870061 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:07.870212 (+ 151us) server_negotiation.cc:407] Connection header received
0811 05:08:07.870248 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:07.870250 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:07.870261 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:07.870334 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:07.870754 (+ 420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:07.871627 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:07.872709 (+ 1082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:07.873128 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:07.873214 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:07.874433 (+ 1219us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:07.874435 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:07.874435 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:08:07.874444 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:07.876271 (+ 1827us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:07.876699 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:07.876700 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:07.876700 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:07.876802 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:07.877040 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:07.877041 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:07.877041 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:07.877204 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:07.877283 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:07.877463 (+ 180us) server_negotiation.cc:299] Negotiation successful
0811 05:08:07.877558 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 05:08:07.877676 6026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:07.870031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:43813 (local address 127.0.0.1:40718)
0811 05:08:07.870116 (+ 85us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:07.870127 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:07.870198 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:07.870367 (+ 169us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:07.870368 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:07.870587 (+ 219us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:07.870658 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:07.870660 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:07.871744 (+ 1084us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:07.871746 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:07.872609 (+ 863us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:07.872613 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:07.873227 (+ 614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:07.873228 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:07.873299 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:07.873908 (+ 609us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:07.873913 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:07.874330 (+ 417us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:08:07.876370 (+ 2040us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:07.876371 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:07.876372 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:07.876611 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:07.876889 (+ 278us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:07.876890 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:07.876891 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:07.876964 (+ 73us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:07.877282 (+ 318us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:08:07.877283 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:08:07.877340 (+ 57us) client_negotiation.cc:769] Sending connection context
0811 05:08:07.877413 (+ 73us) client_negotiation.cc:240] Negotiation successful
0811 05:08:07.877531 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":68,"thread_start_us":46,"threads_started":1}
I20260811 05:08:07.878360 4802 tablet_copy_service.cc:140] P b8fed5a210a94d26b6993a9d4e186564: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 44992f39b96c43dba1e367c8788a8eb7 ({username='oryx', principal='oryx/127.26.191.252@KRBTEST.COM'} at 127.0.0.1:40718)
I20260811 05:08:07.878438 4802 tablet_copy_service.cc:161] P b8fed5a210a94d26b6993a9d4e186564: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 44992f39b96c43dba1e367c8788a8eb7 at {username='oryx', principal='oryx/127.26.191.252@KRBTEST.COM'} at 127.0.0.1:40718: session id = 44992f39b96c43dba1e367c8788a8eb7-00000000000000000000000000000000
I20260811 05:08:07.879133 4802 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P b8fed5a210a94d26b6993a9d4e186564: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 05:08:07.879751 5849 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260811 05:08:07.881448 5849 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 44992f39b96c43dba1e367c8788a8eb7: tablet copy: Starting download of 0 data blocks...
I20260811 05:08:07.881630 5849 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 44992f39b96c43dba1e367c8788a8eb7: tablet copy: Starting download of 1 WAL segments...
I20260811 05:08:07.882591 5849 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 44992f39b96c43dba1e367c8788a8eb7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 05:08:07.883662 4802 tablet_copy_service.cc:342] P b8fed5a210a94d26b6993a9d4e186564: Request end of tablet copy session 44992f39b96c43dba1e367c8788a8eb7-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.26.191.252@KRBTEST.COM'} at 127.0.0.1:40718
I20260811 05:08:07.883733 4802 tablet_copy_service.cc:433] P b8fed5a210a94d26b6993a9d4e186564: ending tablet copy session 44992f39b96c43dba1e367c8788a8eb7-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 44992f39b96c43dba1e367c8788a8eb7
I20260811 05:08:07.886649 5849 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:08:07.888063 6028 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:08:07.890040 5849 server_base.cc:1034] running on GCE node
W20260811 05:08:07.890214 6036 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:07.897351 6030 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:08:07.897558 5849 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:08:07.897789 5849 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:08:07.898936 5849 hybrid_clock.cc:648] HybridClock initialized: now 1786424887898914 us; error 46 us; skew 500 ppm
Aug 11 05:08:07 dist-test-slave-x5fp krb5kdc[4698](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424887, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.191.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:08:07.900624 5849 init.cc:377] Logged in from keytab as oryx/127.26.191.252@KRBTEST.COM (short username oryx)
I20260811 05:08:07.900959 5849 webserver.cc:460] Webserver started at http://127.26.191.252:41331/ using document root <none> and password file <none>
I20260811 05:08:07.901095 5849 fs_manager.cc:359] Metadata directory not provided
I20260811 05:08:07.901136 5849 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:08:07.901976 5849 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 05:08:07.902640 6047 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:07.902802 5849 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 05:08:07.902931 5849 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/master-2/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/master-2/wal
uuid: "44992f39b96c43dba1e367c8788a8eb7"
format_stamp: "Formatted at 2026-08-11 05:08:07 on dist-test-slave-x5fp"
server_key: "2c87abda29c2166c27d2a6377b9dc9db"
server_key_iv: "48bcae58fb79b582963cca0e3a258fae"
server_key_version: "encryptionkey@0"
I20260811 05:08:07.903008 5849 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:08:07.916188 5849 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:08:07.918430 5849 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:08:07.921720 5849 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.252:36269
I20260811 05:08:07.921759 6129 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.252:36269 every 8 connection(s)
I20260811 05:08:07.922096 5849 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/master-2/data/info.pb
I20260811 05:08:07.923062 6138 sys_catalog.cc:263] Verifying existing consensus state
I20260811 05:08:07.923631 6138 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 44992f39b96c43dba1e367c8788a8eb7: Bootstrap starting.
I20260811 05:08:07.926878 6138 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 44992f39b96c43dba1e367c8788a8eb7: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 05:08:07.927117 6138 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 44992f39b96c43dba1e367c8788a8eb7: Bootstrap complete.
I20260811 05:08:07.927330 6138 raft_consensus.cc:348] T 00000000000000000000000000000000 P 44992f39b96c43dba1e367c8788a8eb7 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b8fed5a210a94d26b6993a9d4e186564" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 43813 } } peers { permanent_uuid: "25cb19e8f2c245629b828de638b93da3" member_type: VOTER last_known_addr { host: "127.26.191.253" port: 41643 } attrs { promote: false } } peers { permanent_uuid: "44992f39b96c43dba1e367c8788a8eb7" member_type: NON_VOTER last_known_addr { host: "127.26.191.252" port: 36269 } attrs { promote: true } }
I20260811 05:08:07.927433 6138 raft_consensus.cc:729] T 00000000000000000000000000000000 P 44992f39b96c43dba1e367c8788a8eb7 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 44992f39b96c43dba1e367c8788a8eb7, State: Initialized, Role: LEARNER
I20260811 05:08:07.927474 6138 consensus_queue.cc:260] T 00000000000000000000000000000000 P 44992f39b96c43dba1e367c8788a8eb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b8fed5a210a94d26b6993a9d4e186564" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 43813 } } peers { permanent_uuid: "25cb19e8f2c245629b828de638b93da3" member_type: VOTER last_known_addr { host: "127.26.191.253" port: 41643 } attrs { promote: false } } peers { permanent_uuid: "44992f39b96c43dba1e367c8788a8eb7" member_type: NON_VOTER last_known_addr { host: "127.26.191.252" port: 36269 } attrs { promote: true } }
I20260811 05:08:07.927670 6138 sys_catalog.cc:564] T 00000000000000000000000000000000 P 44992f39b96c43dba1e367c8788a8eb7 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:08:07.927681 6141 sys_catalog.cc:455] T 00000000000000000000000000000000 P 44992f39b96c43dba1e367c8788a8eb7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b8fed5a210a94d26b6993a9d4e186564" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 43813 } } peers { permanent_uuid: "25cb19e8f2c245629b828de638b93da3" member_type: VOTER last_known_addr { host: "127.26.191.253" port: 41643 } attrs { promote: false } } peers { permanent_uuid: "44992f39b96c43dba1e367c8788a8eb7" member_type: NON_VOTER last_known_addr { host: "127.26.191.252" port: 36269 } attrs { promote: true } } }
I20260811 05:08:07.927945 6141 sys_catalog.cc:458] T 00000000000000000000000000000000 P 44992f39b96c43dba1e367c8788a8eb7 [sys.catalog]: This master's current role is: LEARNER
I20260811 05:08:07.929250 6157 catalog_manager.cc:1259] Loaded cluster ID: 3ed6af74e2204dc5a8aa5a0144170ddf
I20260811 05:08:07.929345 6157 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 44992f39b96c43dba1e367c8788a8eb7: loading cluster ID for follower catalog manager: success
I20260811 05:08:07.930656 6157 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 44992f39b96c43dba1e367c8788a8eb7: acquiring CA information for follower catalog manager: success
I20260811 05:08:07.931126 6157 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 44992f39b96c43dba1e367c8788a8eb7: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260811 05:08:07.952309 6007 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:08:07.952593 6007 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:08:07.952641 6007 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:08:07.954011 6007 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:08:07.954083 6007 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:08:07.954131 6007 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.191.193
I20260811 05:08:07.956744 6007 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:36473
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/krb5kdc/oryx_127.26.191.193.keytab
--principal=oryx/127.26.191.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.191.193:39383
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.191.193
--webserver_port=46389
--tserver_master_addrs=127.26.191.254:43813,127.26.191.253:41643,127.26.191.252:36269
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6007
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.191.193
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:08:07.957056 6007 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:08:07.957335 6007 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:08:07.964946 6165 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:07.965428 6171 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:07.965571 6164 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:08:07.965791 6007 server_base.cc:1034] running on GCE node
I20260811 05:08:07.966010 6007 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:08:07.966226 6007 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:08:07.967375 6007 hybrid_clock.cc:648] HybridClock initialized: now 1786424887967350 us; error 43 us; skew 500 ppm
Aug 11 05:08:07 dist-test-slave-x5fp krb5kdc[4698](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424887, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.191.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:08:07.973923 6007 init.cc:377] Logged in from keytab as oryx/127.26.191.193@KRBTEST.COM (short username oryx)
I20260811 05:08:07.974584 6007 webserver.cc:460] Webserver started at http://127.26.191.193:46389/ using document root <none> and password file <none>
I20260811 05:08:07.974865 6007 fs_manager.cc:359] Metadata directory not provided
I20260811 05:08:07.974967 6007 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:08:07.976536 6007 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 05:08:07.977314 6181 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:07.977519 6007 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 05:08:07.977648 6007 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/ts-0/wal
uuid: "db794d15babb45b6a10aeb091d4472fe"
format_stamp: "Formatted at 2026-08-11 05:08:06 on dist-test-slave-x5fp"
server_key: "833ff7796df14c6c7a2173ba5b4fb149"
server_key_iv: "26d86ec101011b5cade5aa81b15bd602"
server_key_version: "encryptionkey@0"
I20260811 05:08:07.978068 6007 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:08:08.007715 6007 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:08:08.010248 6007 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:08:08.010416 6007 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:08:08.010727 6007 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:08:08.011086 6007 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:08:08.011147 6007 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:08.011189 6007 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:08:08.011217 6007 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:08.018210 6007 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.193:39383
I20260811 05:08:08.018263 6365 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.193:39383 every 8 connection(s)
I20260811 05:08:08.018649 6007 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/ts-0/data/info.pb
I20260811 05:08:08.025354 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 6007
I20260811 05:08:08.025558 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 5093
Aug 11 05:08:08 dist-test-slave-x5fp krb5kdc[4698](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424887, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.191.193@KRBTEST.COM for oryx/127.26.191.253@KRBTEST.COM
Aug 11 05:08:08 dist-test-slave-x5fp krb5kdc[4698](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424887, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.191.193@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM
I20260811 05:08:08.046494 4836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:08.019730 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.193:55379 (local address 127.26.191.254:43813)
0811 05:08:08.019789 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:08.019791 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:08.020040 (+ 249us) server_negotiation.cc:407] Connection header received
0811 05:08:08.020782 (+ 742us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:08.020784 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:08.020798 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:08.020855 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:08.022030 (+ 1175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:08.022550 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:08.023622 (+ 1072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:08.023842 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:08.023925 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:08.041999 (+ 18074us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:08.042002 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:08.042002 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:08:08.042012 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:08.043811 (+ 1799us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:08.045143 (+ 1332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:08.045145 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:08.045145 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:08.045214 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:08.045571 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:08.045572 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:08.045572 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:08.045757 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:08.045819 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:08.046257 (+ 438us) server_negotiation.cc:299] Negotiation successful
0811 05:08:08.046363 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 05:08:08.046828 5816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:08.020033 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.193:54279 (local address 127.26.191.253:41643)
0811 05:08:08.020096 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:08.020099 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:08.020268 (+ 169us) server_negotiation.cc:407] Connection header received
0811 05:08:08.020846 (+ 578us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:08.020848 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:08.020864 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:08.020903 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:08.022057 (+ 1154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:08.022906 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:08.024061 (+ 1155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:08.024372 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:08.024437 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:08.043656 (+ 19219us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:08.043659 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:08.043660 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:08:08.043670 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:08.045566 (+ 1896us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:08.045959 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:08.045961 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:08.045961 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:08.046020 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:08.046222 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:08.046223 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:08.046223 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:08.046384 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:08.046431 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:08.046644 (+ 213us) server_negotiation.cc:299] Negotiation successful
0811 05:08:08.046734 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260811 05:08:08.047142 6373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:08.019599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:43813 (local address 127.26.191.193:55379)
0811 05:08:08.019851 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:08.019908 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:08.020638 (+ 730us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:08.020931 (+ 293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:08.020935 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:08.021629 (+ 694us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:08.021927 (+ 298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:08.021933 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:08.022665 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:08.022666 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:08.023523 (+ 857us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:08.023526 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:08.023935 (+ 409us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:08.023936 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:08.024107 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:08.024823 (+ 716us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:08.024833 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:08.041843 (+ 17010us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:08:08.043926 (+ 2083us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:08.043942 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:08.044256 (+ 314us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:08.045031 (+ 775us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:08.045298 (+ 267us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:08.045299 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:08.045299 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:08.045484 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:08.045856 (+ 372us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:08:08.045865 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:08:08.046075 (+ 210us) client_negotiation.cc:769] Sending connection context
0811 05:08:08.046658 (+ 583us) client_negotiation.cc:240] Negotiation successful
0811 05:08:08.046880 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":158,"threads_started":1}
I20260811 05:08:08.047142 6374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:08.019952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.253:41643 (local address 127.26.191.193:54279)
0811 05:08:08.020182 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:08.020191 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:08.020683 (+ 492us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:08.021012 (+ 329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:08.021014 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:08.021643 (+ 629us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:08.021928 (+ 285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:08.021936 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:08.023009 (+ 1073us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:08.023010 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:08.023966 (+ 956us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:08.023968 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:08.024447 (+ 479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:08.024448 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:08.024528 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:08.025016 (+ 488us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:08.025021 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:08.043506 (+ 18485us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:08:08.045658 (+ 2152us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:08.045658 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:08.045659 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:08.045876 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:08.046092 (+ 216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:08.046093 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:08.046093 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:08.046148 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:08.046482 (+ 334us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:08:08.046483 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:08:08.046525 (+ 42us) client_negotiation.cc:769] Sending connection context
0811 05:08:08.046953 (+ 428us) client_negotiation.cc:240] Negotiation successful
0811 05:08:08.047049 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":204,"mutex_wait_us":7,"thread_start_us":66,"threads_started":1}
I20260811 05:08:08.047684 6369 heartbeater.cc:347] Connected to a master server at 127.26.191.253:41643
I20260811 05:08:08.047785 6369 heartbeater.cc:464] Registering TS with master...
I20260811 05:08:08.047878 6368 heartbeater.cc:347] Connected to a master server at 127.26.191.254:43813
I20260811 05:08:08.047945 6369 heartbeater.cc:511] Master 127.26.191.253:41643 requested a full tablet report, sending...
I20260811 05:08:08.047964 6368 heartbeater.cc:464] Registering TS with master...
I20260811 05:08:08.048076 6368 heartbeater.cc:511] Master 127.26.191.254:43813 requested a full tablet report, sending...
I20260811 05:08:08.048403 4769 ts_manager.cc:194] Re-registered known tserver with Master: db794d15babb45b6a10aeb091d4472fe (127.26.191.193:39383)
I20260811 05:08:08.048482 5753 ts_manager.cc:194] Registered new tserver with Master: db794d15babb45b6a10aeb091d4472fe (127.26.191.193:39383)
I20260811 05:08:08.048930 4769 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.26.191.193@KRBTEST.COM'} at 127.26.191.193:55379
Aug 11 05:08:08 dist-test-slave-x5fp krb5kdc[4698](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424887, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.191.193@KRBTEST.COM for oryx/127.26.191.252@KRBTEST.COM
I20260811 05:08:08.064359 6372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:08.019599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.252:36269 (local address 127.26.191.193:33791)
0811 05:08:08.019851 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:08.019908 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:08.020683 (+ 775us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:08.021073 (+ 390us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:08.021074 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:08.021627 (+ 553us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:08.021928 (+ 301us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:08.021936 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:08.023284 (+ 1348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:08.023285 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:08.024158 (+ 873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:08.024160 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:08.024766 (+ 606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:08.024768 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:08.024841 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:08.057441 (+ 32600us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:08.057449 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:08.060259 (+ 2810us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:08:08.062839 (+ 2580us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:08.062841 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:08.062841 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:08.063108 (+ 267us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:08.063403 (+ 295us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:08.063404 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:08.063405 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:08.063492 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:08.063857 (+ 365us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:08:08.063858 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:08:08.063920 (+ 62us) client_negotiation.cc:769] Sending connection context
0811 05:08:08.064017 (+ 97us) client_negotiation.cc:240] Negotiation successful
0811 05:08:08.064186 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":214,"mutex_wait_us":8,"spinlock_wait_cycles":384,"thread_start_us":115,"threads_started":1}
I20260811 05:08:08.064358 6371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:08.019583 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.193:33791 (local address 127.26.191.252:36269)
0811 05:08:08.019737 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:08.019739 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:08.020008 (+ 269us) server_negotiation.cc:407] Connection header received
0811 05:08:08.020886 (+ 878us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:08.020888 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:08.020904 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:08.020960 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:08.022056 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:08.023188 (+ 1132us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:08.024255 (+ 1067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:08.024600 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:08.024673 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:08.060423 (+ 35750us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:08.060425 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:08.060425 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:08:08.060437 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:08.062687 (+ 2250us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:08.063215 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:08.063217 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:08.063218 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:08.063302 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:08.063577 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:08.063578 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:08.063579 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:08.063766 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:08.063858 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:08.064068 (+ 210us) server_negotiation.cc:299] Negotiation successful
0811 05:08:08.064193 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109,"thread_start_us":83,"threads_started":1}
I20260811 05:08:08.065016 6367 heartbeater.cc:347] Connected to a master server at 127.26.191.252:36269
I20260811 05:08:08.065091 6367 heartbeater.cc:464] Registering TS with master...
I20260811 05:08:08.065217 6367 heartbeater.cc:511] Master 127.26.191.252:36269 requested a full tablet report, sending...
I20260811 05:08:08.065677 6073 ts_manager.cc:194] Registered new tserver with Master: db794d15babb45b6a10aeb091d4472fe (127.26.191.193:39383)
I20260811 05:08:08.068707 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.191.194:39395
--local_ip_for_outbound_sockets=127.26.191.194
--tserver_master_addrs=127.26.191.254:43813
--webserver_port=39775
--webserver_interface=127.26.191.194
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/krb5kdc/oryx_127.26.191.194.keytab
--principal=oryx/127.26.191.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:36473
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.26.191.254:43813,127.26.191.253:41643
--tserver_master_addrs=127.26.191.254:43813,127.26.191.253:41643,127.26.191.252:36269 with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:08:08.161345 6375 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:08:08.161592 6375 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:08:08.161633 6375 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:08:08.162855 6375 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:08:08.162930 6375 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:08:08.162976 6375 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.191.194
I20260811 05:08:08.164556 6375 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:36473
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/krb5kdc/oryx_127.26.191.194.keytab
--principal=oryx/127.26.191.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.191.194:39395
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.191.194
--webserver_port=39775
--tserver_master_addrs=127.26.191.254:43813,127.26.191.253:41643,127.26.191.252:36269
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6375
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.191.194
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:08:08.164871 6375 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:08:08.165130 6375 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:08:08.171008 6394 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:08.170964 6387 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:08.170960 6388 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:08:08.171319 6375 server_base.cc:1034] running on GCE node
I20260811 05:08:08.171571 6375 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:08:08.171898 6375 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:08:08.173094 6375 hybrid_clock.cc:648] HybridClock initialized: now 1786424888173080 us; error 30 us; skew 500 ppm
Aug 11 05:08:08 dist-test-slave-x5fp krb5kdc[4698](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424888, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.191.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:08:08.176192 6375 init.cc:377] Logged in from keytab as oryx/127.26.191.194@KRBTEST.COM (short username oryx)
I20260811 05:08:08.176672 6375 webserver.cc:460] Webserver started at http://127.26.191.194:39775/ using document root <none> and password file <none>
I20260811 05:08:08.177006 6375 fs_manager.cc:359] Metadata directory not provided
I20260811 05:08:08.177109 6375 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:08:08.178574 6375 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 05:08:08.179347 6407 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:08.179595 6375 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 05:08:08.179698 6375 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/ts-1/wal
uuid: "95c53350afaf4f799751127bdd8f40fb"
format_stamp: "Formatted at 2026-08-11 05:08:07 on dist-test-slave-x5fp"
server_key: "aeff6bb04148f067f1f2bc590b1ae794"
server_key_iv: "e02b6000c8cde2259c936420553c5450"
server_key_version: "encryptionkey@0"
I20260811 05:08:08.180110 6375 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:08:08.191594 6375 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:08:08.194053 6375 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:08:08.194228 6375 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:08:08.194482 6375 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:08:08.194859 6375 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:08:08.194916 6375 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:08.194960 6375 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:08:08.194988 6375 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:08.201498 6375 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.194:39395
I20260811 05:08:08.201539 6601 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.194:39395 every 8 connection(s)
I20260811 05:08:08.201926 6375 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/ts-1/data/info.pb
I20260811 05:08:08.205065 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 6375
I20260811 05:08:08.205267 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 5313
Aug 11 05:08:08 dist-test-slave-x5fp krb5kdc[4698](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424888, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.191.194@KRBTEST.COM for oryx/127.26.191.252@KRBTEST.COM
I20260811 05:08:08.225051 6371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:08.203165 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.194:51955 (local address 127.26.191.252:36269)
0811 05:08:08.203215 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:08.203217 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:08.203381 (+ 164us) server_negotiation.cc:407] Connection header received
0811 05:08:08.203964 (+ 583us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:08.203966 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:08.203977 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:08.204028 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:08.204879 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:08.205677 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:08.216053 (+ 10376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:08.216372 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:08.216415 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:08.219746 (+ 3331us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:08.219748 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:08.219749 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:08:08.219757 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:08.223282 (+ 3525us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:08.223875 (+ 593us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:08.223876 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:08.223877 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:08.223936 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:08.224208 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:08.224209 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:08.224210 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:08.224352 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:08.224410 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:08.224829 (+ 419us) server_negotiation.cc:299] Negotiation successful
0811 05:08:08.224935 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 05:08:08.225673 6606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:08.203072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.252:36269 (local address 127.26.191.194:51955)
0811 05:08:08.203320 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:08.203327 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:08.203763 (+ 436us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:08.204091 (+ 328us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:08.204092 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:08.204464 (+ 372us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:08.204776 (+ 312us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:08.204782 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:08.214634 (+ 9852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:08.214636 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:08.215911 (+ 1275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:08.215916 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:08.216519 (+ 603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:08.216520 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:08.216670 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:08.217757 (+ 1087us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:08.217769 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:08.219619 (+ 1850us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:08:08.223386 (+ 3767us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:08.223397 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:08.223400 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:08.223788 (+ 388us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:08.223995 (+ 207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:08.223995 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:08.223996 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:08.224132 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:08.224445 (+ 313us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:08:08.224452 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:08:08.224625 (+ 173us) client_negotiation.cc:769] Sending connection context
0811 05:08:08.225215 (+ 590us) client_negotiation.cc:240] Negotiation successful
0811 05:08:08.225412 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":230,"thread_start_us":57,"threads_started":1}
I20260811 05:08:08.226249 6602 heartbeater.cc:347] Connected to a master server at 127.26.191.252:36269
I20260811 05:08:08.226336 6602 heartbeater.cc:464] Registering TS with master...
I20260811 05:08:08.226500 6602 heartbeater.cc:511] Master 127.26.191.252:36269 requested a full tablet report, sending...
I20260811 05:08:08.226962 6073 ts_manager.cc:194] Registered new tserver with Master: 95c53350afaf4f799751127bdd8f40fb (127.26.191.194:39395)
Aug 11 05:08:08 dist-test-slave-x5fp krb5kdc[4698](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424888, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.191.194@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM
I20260811 05:08:08.231770 4836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:08.202763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.194:36405 (local address 127.26.191.254:43813)
0811 05:08:08.202816 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:08.202818 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:08.203142 (+ 324us) server_negotiation.cc:407] Connection header received
0811 05:08:08.203887 (+ 745us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:08.203888 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:08.203903 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:08.203935 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:08.204906 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:08.205677 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:08.225163 (+ 19486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:08.225484 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:08.225539 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:08.228893 (+ 3354us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:08.228896 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:08.228896 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:08:08.228907 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:08.230478 (+ 1571us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:08.230916 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:08.230918 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:08.230918 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:08.230988 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:08.231203 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:08.231205 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:08.231205 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:08.231342 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:08.231417 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:08.231589 (+ 172us) server_negotiation.cc:299] Negotiation successful
0811 05:08:08.231673 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 05:08:08.231796 6607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:08.202763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:43813 (local address 127.26.191.194:36405)
0811 05:08:08.202951 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:08.202990 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:08.203751 (+ 761us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:08.204039 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:08.204044 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:08.204528 (+ 484us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:08.204776 (+ 248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:08.204783 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:08.224111 (+ 19328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:08.224112 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:08.225042 (+ 930us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:08.225045 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:08.225628 (+ 583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:08.225629 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:08.225703 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:08.227117 (+ 1414us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:08.227124 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:08.228625 (+ 1501us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:08:08.230591 (+ 1966us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:08.230593 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:08.230594 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:08.230824 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:08.231059 (+ 235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:08.231060 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:08.231061 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:08.231123 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:08.231419 (+ 296us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:08:08.231421 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:08:08.231467 (+ 46us) client_negotiation.cc:769] Sending connection context
0811 05:08:08.231545 (+ 78us) client_negotiation.cc:240] Negotiation successful
0811 05:08:08.231668 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"spinlock_wait_cycles":384,"thread_start_us":101,"threads_started":1}
I20260811 05:08:08.232193 6603 heartbeater.cc:347] Connected to a master server at 127.26.191.254:43813
I20260811 05:08:08.232254 6603 heartbeater.cc:464] Registering TS with master...
I20260811 05:08:08.232316 6603 heartbeater.cc:511] Master 127.26.191.254:43813 requested a full tablet report, sending...
I20260811 05:08:08.232576 4769 ts_manager.cc:194] Re-registered known tserver with Master: 95c53350afaf4f799751127bdd8f40fb (127.26.191.194:39395)
I20260811 05:08:08.233129 4769 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.26.191.194@KRBTEST.COM'} at 127.26.191.194:36405
I20260811 05:08:08.238692 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.191.195:34541
--local_ip_for_outbound_sockets=127.26.191.195
--tserver_master_addrs=127.26.191.254:43813
--webserver_port=41573
--webserver_interface=127.26.191.195
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/krb5kdc/oryx_127.26.191.195.keytab
--principal=oryx/127.26.191.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:36473
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.26.191.254:43813,127.26.191.253:41643
--tserver_master_addrs=127.26.191.254:43813,127.26.191.253:41643,127.26.191.252:36269 with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 05:08:08 dist-test-slave-x5fp krb5kdc[4698](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424888, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.191.194@KRBTEST.COM for oryx/127.26.191.253@KRBTEST.COM
I20260811 05:08:08.244969 5816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:08.202824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.194:44583 (local address 127.26.191.253:41643)
0811 05:08:08.202868 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:08.202870 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:08.203258 (+ 388us) server_negotiation.cc:407] Connection header received
0811 05:08:08.203869 (+ 611us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:08.203871 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:08.203885 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:08.203954 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:08.237440 (+ 33486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:08.238187 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:08.239409 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:08.239669 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:08.239728 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:08.242050 (+ 2322us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:08.242052 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:08.242052 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:08:08.242062 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:08.243611 (+ 1549us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:08.244022 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:08.244024 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:08.244025 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:08.244096 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:08.244334 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:08.244335 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:08.244335 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:08.244471 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:08.244559 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:08.244754 (+ 195us) server_negotiation.cc:299] Negotiation successful
0811 05:08:08.244853 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 05:08:08.244987 6608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:08.202775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.253:41643 (local address 127.26.191.194:44583)
0811 05:08:08.203190 (+ 415us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:08.203201 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:08.203766 (+ 565us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:08.204430 (+ 664us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:08.204431 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:08.204644 (+ 213us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:08.204776 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:08.204783 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:08.238306 (+ 33523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:08.238308 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:08.239285 (+ 977us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:08.239290 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:08.239754 (+ 464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:08.239756 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:08.239844 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:08.240357 (+ 513us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:08.240364 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:08.241939 (+ 1575us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:08:08.243722 (+ 1783us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:08.243723 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:08.243724 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:08.243932 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:08.244177 (+ 245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:08.244178 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:08.244178 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:08.244257 (+ 79us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:08.244549 (+ 292us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:08:08.244550 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:08:08.244602 (+ 52us) client_negotiation.cc:769] Sending connection context
0811 05:08:08.244701 (+ 99us) client_negotiation.cc:240] Negotiation successful
0811 05:08:08.244862 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":398,"thread_start_us":102,"threads_started":1}
I20260811 05:08:08.245568 6604 heartbeater.cc:347] Connected to a master server at 127.26.191.253:41643
I20260811 05:08:08.245625 6604 heartbeater.cc:464] Registering TS with master...
I20260811 05:08:08.245726 6604 heartbeater.cc:511] Master 127.26.191.253:41643 requested a full tablet report, sending...
I20260811 05:08:08.246088 5753 ts_manager.cc:194] Registered new tserver with Master: 95c53350afaf4f799751127bdd8f40fb (127.26.191.194:39395)
W20260811 05:08:08.332576 6609 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:08:08.332891 6609 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:08:08.332942 6609 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:08:08.334287 6609 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:08:08.334362 6609 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:08:08.334408 6609 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.191.195
I20260811 05:08:08.336042 6609 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:36473
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/krb5kdc/oryx_127.26.191.195.keytab
--principal=oryx/127.26.191.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.191.195:34541
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.191.195
--webserver_port=41573
--tserver_master_addrs=127.26.191.254:43813,127.26.191.253:41643,127.26.191.252:36269
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6609
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.191.195
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:08:08.336356 6609 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:08:08.336612 6609 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:08:08.342273 6617 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:08.342267 6620 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:08.342304 6615 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:08:08.342495 6609 server_base.cc:1034] running on GCE node
I20260811 05:08:08.342865 6609 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:08:08.343123 6609 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:08:08.344322 6609 hybrid_clock.cc:648] HybridClock initialized: now 1786424888344302 us; error 46 us; skew 500 ppm
Aug 11 05:08:08 dist-test-slave-x5fp krb5kdc[4698](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424888, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.191.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:08:08.347074 6609 init.cc:377] Logged in from keytab as oryx/127.26.191.195@KRBTEST.COM (short username oryx)
I20260811 05:08:08.347502 6609 webserver.cc:460] Webserver started at http://127.26.191.195:41573/ using document root <none> and password file <none>
I20260811 05:08:08.347712 6609 fs_manager.cc:359] Metadata directory not provided
I20260811 05:08:08.347769 6609 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:08:08.349298 6609 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 05:08:08.350010 6634 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:08.350244 6609 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 05:08:08.350333 6609 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/ts-2/wal
uuid: "4b1e476d7e6241fbac41768184552018"
format_stamp: "Formatted at 2026-08-11 05:08:07 on dist-test-slave-x5fp"
server_key: "a3a5fd8e29eba33acf9682a0584449f7"
server_key_iv: "af3b5cccf672b2faa8b90f8865eb27c5"
server_key_version: "encryptionkey@0"
I20260811 05:08:08.350698 6609 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:08:08.365584 6609 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:08:08.368182 6609 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:08:08.368374 6609 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:08:08.368644 6609 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:08:08.369007 6609 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:08:08.369066 6609 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:08.369112 6609 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:08:08.369141 6609 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:08.375146 6609 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.195:34541
I20260811 05:08:08.375231 6820 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.195:34541 every 8 connection(s)
I20260811 05:08:08.375634 6609 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/ts-2/data/info.pb
Aug 11 05:08:08 dist-test-slave-x5fp krb5kdc[4698](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424888, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.191.195@KRBTEST.COM for oryx/127.26.191.253@KRBTEST.COM
I20260811 05:08:08.385685 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 6609
Aug 11 05:08:08 dist-test-slave-x5fp krb5kdc[4698](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424888, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.191.195@KRBTEST.COM for oryx/127.26.191.252@KRBTEST.COM
Aug 11 05:08:08 dist-test-slave-x5fp krb5kdc[4698](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424888, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.191.195@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM
I20260811 05:08:08.390272 6833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:08.376920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.253:41643 (local address 127.26.191.195:35849)
0811 05:08:08.377078 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:08.377088 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:08.378261 (+ 1173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:08.378591 (+ 330us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:08.378597 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:08.379168 (+ 571us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:08.379359 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:08.379366 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:08.380360 (+ 994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:08.380361 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:08.381657 (+ 1296us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:08.381660 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:08.382200 (+ 540us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:08.382220 (+ 20us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:08.382296 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:08.383346 (+ 1050us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:08.383356 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:08.385685 (+ 2329us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:08:08.388337 (+ 2652us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:08.388348 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:08.388351 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:08.388694 (+ 343us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:08.388969 (+ 275us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:08.388970 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:08.388970 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:08.389127 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:08.389464 (+ 337us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:08:08.389471 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:08:08.389664 (+ 193us) client_negotiation.cc:769] Sending connection context
0811 05:08:08.389771 (+ 107us) client_negotiation.cc:240] Negotiation successful
0811 05:08:08.389982 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"mutex_wait_us":201,"thread_start_us":73,"threads_started":1}
I20260811 05:08:08.390621 5816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:08.376997 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.195:35849 (local address 127.26.191.253:41643)
0811 05:08:08.377050 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:08.377052 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:08.377167 (+ 115us) server_negotiation.cc:407] Connection header received
0811 05:08:08.378435 (+ 1268us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:08.378437 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:08.378451 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:08.378483 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:08.379492 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:08.380261 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:08.381766 (+ 1505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:08.382075 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:08.382139 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:08.385852 (+ 3713us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:08.385854 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:08.385854 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:08:08.385864 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:08.387889 (+ 2025us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:08.388816 (+ 927us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:08.388817 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:08.388818 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:08.388894 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:08.389211 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:08.389212 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:08.389213 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:08.389368 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:08.389433 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:08.390433 (+ 1000us) server_negotiation.cc:299] Negotiation successful
0811 05:08:08.390518 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 05:08:08.390812 6832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:08.376485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.252:36269 (local address 127.26.191.195:40989)
0811 05:08:08.376692 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:08.376771 (+ 79us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:08.378233 (+ 1462us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:08.378591 (+ 358us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:08.378597 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:08.379172 (+ 575us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:08.379359 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:08.379366 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:08.380381 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:08.380382 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:08.381514 (+ 1132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:08.381517 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:08.382046 (+ 529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:08.382047 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:08.382234 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:08.383707 (+ 1473us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:08.383712 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:08.386154 (+ 2442us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:08:08.388463 (+ 2309us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:08.388464 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:08.388464 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:08.388828 (+ 364us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:08.389465 (+ 637us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:08.389465 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:08.389466 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:08.389524 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:08.390469 (+ 945us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:08:08.390470 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:08:08.390515 (+ 45us) client_negotiation.cc:769] Sending connection context
0811 05:08:08.390570 (+ 55us) client_negotiation.cc:240] Negotiation successful
0811 05:08:08.390668 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":164,"mutex_wait_us":133,"thread_start_us":129,"threads_started":1}
I20260811 05:08:08.391044 6829 heartbeater.cc:347] Connected to a master server at 127.26.191.253:41643
I20260811 05:08:08.391156 6829 heartbeater.cc:464] Registering TS with master...
I20260811 05:08:08.391373 6829 heartbeater.cc:511] Master 127.26.191.253:41643 requested a full tablet report, sending...
I20260811 05:08:08.392231 5753 ts_manager.cc:194] Registered new tserver with Master: 4b1e476d7e6241fbac41768184552018 (127.26.191.195:34541)
I20260811 05:08:08.393143 6831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:08.376496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:43813 (local address 127.26.191.195:55173)
0811 05:08:08.376963 (+ 467us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:08.376974 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:08.378234 (+ 1260us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:08.378593 (+ 359us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:08.378598 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:08.379033 (+ 435us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:08.379359 (+ 326us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:08.379364 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:08.380182 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:08.380183 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:08.381659 (+ 1476us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:08.381660 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:08.382244 (+ 584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:08.382245 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:08.382302 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:08.383453 (+ 1151us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:08.383459 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:08.388246 (+ 4787us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:08:08.391909 (+ 3663us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:08.391910 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:08.391911 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:08.392133 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:08.392355 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:08.392356 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:08.392357 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:08.392432 (+ 75us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:08.392788 (+ 356us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:08:08.392789 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:08:08.392832 (+ 43us) client_negotiation.cc:769] Sending connection context
0811 05:08:08.392901 (+ 69us) client_negotiation.cc:240] Negotiation successful
0811 05:08:08.393028 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":441,"mutex_wait_us":122,"thread_start_us":106,"threads_started":1}
I20260811 05:08:08.393149 6371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:08.376602 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.195:40989 (local address 127.26.191.252:36269)
0811 05:08:08.376657 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:08.376659 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:08.376862 (+ 203us) server_negotiation.cc:407] Connection header received
0811 05:08:08.378477 (+ 1615us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:08.378479 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:08.378496 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:08.378558 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:08.379492 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:08.380289 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:08.381622 (+ 1333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:08.381952 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:08.382037 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:08.386474 (+ 4437us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:08.386477 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:08.386477 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:08:08.386488 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:08.388365 (+ 1877us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:08.389323 (+ 958us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:08.389324 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:08.389324 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:08.389395 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:08.390201 (+ 806us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:08.390202 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:08.390202 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:08.390359 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:08.390441 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:08.392669 (+ 2228us) server_negotiation.cc:299] Negotiation successful
0811 05:08:08.393053 (+ 384us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 05:08:08.393507 4836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:08.376538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.195:55173 (local address 127.26.191.254:43813)
0811 05:08:08.376596 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:08.376598 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:08.377031 (+ 433us) server_negotiation.cc:407] Connection header received
0811 05:08:08.378387 (+ 1356us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:08.378389 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:08.378405 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:08.378478 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:08.379474 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:08.380053 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:08.381794 (+ 1741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:08.382163 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:08.382242 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:08.388912 (+ 6670us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:08.388914 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:08.388914 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:08:08.388922 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:08.391813 (+ 2891us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:08.392217 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:08.392219 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:08.392219 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:08.392282 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:08.392505 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:08.392507 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:08.392507 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:08.392649 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:08.392759 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:08.393293 (+ 534us) server_negotiation.cc:299] Negotiation successful
0811 05:08:08.393385 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260811 05:08:08.393561 6827 heartbeater.cc:347] Connected to a master server at 127.26.191.252:36269
I20260811 05:08:08.393606 6827 heartbeater.cc:464] Registering TS with master...
I20260811 05:08:08.393677 6827 heartbeater.cc:511] Master 127.26.191.252:36269 requested a full tablet report, sending...
I20260811 05:08:08.393918 6828 heartbeater.cc:347] Connected to a master server at 127.26.191.254:43813
I20260811 05:08:08.393973 6828 heartbeater.cc:464] Registering TS with master...
I20260811 05:08:08.394037 6828 heartbeater.cc:511] Master 127.26.191.254:43813 requested a full tablet report, sending...
I20260811 05:08:08.394245 6073 ts_manager.cc:194] Registered new tserver with Master: 4b1e476d7e6241fbac41768184552018 (127.26.191.195:34541)
I20260811 05:08:08.394577 4769 ts_manager.cc:194] Re-registered known tserver with Master: 4b1e476d7e6241fbac41768184552018 (127.26.191.195:34541)
I20260811 05:08:08.394963 4769 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.26.191.195@KRBTEST.COM'} at 127.26.191.195:55173
I20260811 05:08:08.398975 6843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:08.387765 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40720 (local address 127.26.191.254:43813)
0811 05:08:08.388090 (+ 325us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:08.388092 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:08.388332 (+ 240us) server_negotiation.cc:407] Connection header received
0811 05:08:08.388364 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:08.388364 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:08.388380 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:08.388449 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:08.389341 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:08.390198 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:08.391971 (+ 1773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:08.392349 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:08.392441 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:08.394728 (+ 2287us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:08.394730 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:08.394730 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:08:08.394737 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:08.397479 (+ 2742us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:08.397936 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:08.397938 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:08.397938 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:08.398011 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:08.398235 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:08.398236 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:08.398236 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:08.398386 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:08.398492 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:08.398702 (+ 210us) server_negotiation.cc:299] Negotiation successful
0811 05:08:08.398792 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":284,"thread_start_us":68,"threads_started":1}
I20260811 05:08:08.399612 6854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:08.388584 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54790 (local address 127.26.191.253:41643)
0811 05:08:08.388752 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:08.388755 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:08.388764 (+ 9us) server_negotiation.cc:407] Connection header received
0811 05:08:08.388788 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:08.388788 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:08.388803 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:08.389481 (+ 678us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:08.389517 (+ 36us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:08.390223 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:08.393225 (+ 3002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:08.393561 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:08.395770 (+ 2209us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:08.395825 (+ 55us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:08.395826 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:08.395826 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:08:08.395831 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:08.397584 (+ 1753us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:08.398126 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:08.398127 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:08.398127 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:08.398214 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:08.398510 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:08.398511 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:08.398512 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:08.398679 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:08.399332 (+ 653us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:08.399382 (+ 50us) server_negotiation.cc:299] Negotiation successful
0811 05:08:08.399488 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":120,"thread_start_us":65,"threads_started":1}
I20260811 05:08:08.400645 4769 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40720:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 05:08:08.402762 4769 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 05:08:08.403035 6846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:08.388062 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34886 (local address 127.26.191.252:36269)
0811 05:08:08.388318 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:08.388320 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:08.390524 (+ 2204us) server_negotiation.cc:407] Connection header received
0811 05:08:08.390625 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:08.390626 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:08.390639 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:08.390675 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:08.393986 (+ 3311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:08.394794 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:08.397129 (+ 2335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:08.397521 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:08.397592 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:08.399427 (+ 1835us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:08.399428 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:08.399429 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:08:08.399437 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:08.401673 (+ 2236us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:08.402078 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:08.402079 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:08.402079 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:08.402135 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:08.402336 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:08.402337 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:08.402337 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:08.402495 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:08.402615 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:08.402832 (+ 217us) server_negotiation.cc:299] Negotiation successful
0811 05:08:08.402943 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":236,"thread_start_us":65,"threads_started":1}
I20260811 05:08:08.411172 6863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:08.406837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.194:39395 (local address 127.0.0.1:35586)
0811 05:08:08.406986 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:08.406998 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:08.407186 (+ 188us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:08.407502 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:08.407503 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:08.407507 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:08:08.407568 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:08.407570 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:08.408957 (+ 1387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:08.408959 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:08.409872 (+ 913us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:08.409874 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:08.410797 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:08.410798 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:08.410924 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:08.410929 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 05:08:08.410991 (+ 62us) client_negotiation.cc:240] Negotiation successful
0811 05:08:08.411040 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"mutex_wait_us":21,"thread_start_us":104,"threads_started":1}
I20260811 05:08:08.411537 6864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:08.406988 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35586 (local address 127.26.191.194:39395)
0811 05:08:08.407189 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:08.407195 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:08.407237 (+ 42us) server_negotiation.cc:407] Connection header received
0811 05:08:08.407361 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:08.407363 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:08.407387 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:08.407507 (+ 120us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:08:08.407631 (+ 124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:08.408868 (+ 1237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:08.409967 (+ 1099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:08.410673 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:08.410815 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:08.410890 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:08.411388 (+ 498us) server_negotiation.cc:299] Negotiation successful
0811 05:08:08.411434 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":124,"threads_started":1}
I20260811 05:08:08.412046 6868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:08.407074 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.195:34541 (local address 127.0.0.1:54904)
0811 05:08:08.407377 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:08.407386 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:08.407442 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:08.408013 (+ 571us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:08.408014 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:08.408017 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:08:08.408061 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:08.408063 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:08.409818 (+ 1755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:08.409819 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:08.410925 (+ 1106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:08.410927 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:08.411800 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:08.411801 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:08.411871 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:08.411876 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 05:08:08.411908 (+ 32us) client_negotiation.cc:240] Negotiation successful
0811 05:08:08.411950 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":281,"mutex_wait_us":30,"thread_start_us":85,"threads_started":1}
I20260811 05:08:08.412173 6870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:08.407614 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43760 (local address 127.26.191.193:39383)
0811 05:08:08.407827 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:08.407832 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:08.408062 (+ 230us) server_negotiation.cc:407] Connection header received
0811 05:08:08.408105 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:08.408107 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:08.408124 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:08.408193 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:08:08.408440 (+ 247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:08.409587 (+ 1147us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:08.410993 (+ 1406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:08.411809 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:08.411938 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:08.412001 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:08.412039 (+ 38us) server_negotiation.cc:299] Negotiation successful
0811 05:08:08.412083 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":168,"thread_start_us":103,"threads_started":1}
I20260811 05:08:08.412400 6865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:08.407269 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.193:39383 (local address 127.0.0.1:43760)
0811 05:08:08.407945 (+ 676us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:08.407957 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:08.408003 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:08.408265 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:08.408266 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:08.408268 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:08:08.408357 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:08.408358 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:08.409683 (+ 1325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:08.409684 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:08.410889 (+ 1205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:08.410901 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:08.411905 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:08.411906 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:08.411979 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:08.411983 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 05:08:08.412025 (+ 42us) client_negotiation.cc:240] Negotiation successful
0811 05:08:08.412059 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":656,"mutex_wait_us":3,"thread_start_us":68,"threads_started":1}
I20260811 05:08:08.412352 6495 tablet_service.cc:1467] Processing CreateTablet for tablet e71f3281e90c48599052cabc94cfc3b5 (DEFAULT_TABLE table=test-table [id=45603c108b9041c38b3d0cfa22977f6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:08:08.412595 6871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:08.407684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54904 (local address 127.26.191.195:34541)
0811 05:08:08.407848 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:08.407853 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:08.407864 (+ 11us) server_negotiation.cc:407] Connection header received
0811 05:08:08.407906 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:08.407908 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:08.407927 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:08.408015 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:08:08.408181 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:08.409727 (+ 1546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:08.411011 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:08.411701 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:08.412299 (+ 598us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:08.412369 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:08.412422 (+ 53us) server_negotiation.cc:299] Negotiation successful
0811 05:08:08.412472 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":95,"threads_started":1}
I20260811 05:08:08.412896 6495 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e71f3281e90c48599052cabc94cfc3b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:08:08.413213 6263 tablet_service.cc:1467] Processing CreateTablet for tablet e71f3281e90c48599052cabc94cfc3b5 (DEFAULT_TABLE table=test-table [id=45603c108b9041c38b3d0cfa22977f6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:08:08.413313 6709 tablet_service.cc:1467] Processing CreateTablet for tablet e71f3281e90c48599052cabc94cfc3b5 (DEFAULT_TABLE table=test-table [id=45603c108b9041c38b3d0cfa22977f6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:08:08.413587 6263 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e71f3281e90c48599052cabc94cfc3b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:08:08.413718 6709 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e71f3281e90c48599052cabc94cfc3b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:08:08.416538 6872 tablet_bootstrap.cc:492] T e71f3281e90c48599052cabc94cfc3b5 P db794d15babb45b6a10aeb091d4472fe: Bootstrap starting.
I20260811 05:08:08.417375 6874 tablet_bootstrap.cc:492] T e71f3281e90c48599052cabc94cfc3b5 P 95c53350afaf4f799751127bdd8f40fb: Bootstrap starting.
I20260811 05:08:08.417580 6875 tablet_bootstrap.cc:492] T e71f3281e90c48599052cabc94cfc3b5 P 4b1e476d7e6241fbac41768184552018: Bootstrap starting.
I20260811 05:08:08.417827 6872 tablet_bootstrap.cc:654] T e71f3281e90c48599052cabc94cfc3b5 P db794d15babb45b6a10aeb091d4472fe: Neither blocks nor log segments found. Creating new log.
I20260811 05:08:08.418128 6874 tablet_bootstrap.cc:654] T e71f3281e90c48599052cabc94cfc3b5 P 95c53350afaf4f799751127bdd8f40fb: Neither blocks nor log segments found. Creating new log.
I20260811 05:08:08.418244 6872 log.cc:824] T e71f3281e90c48599052cabc94cfc3b5 P db794d15babb45b6a10aeb091d4472fe: Log is configured to *not* fsync() on all Append() calls
I20260811 05:08:08.418406 6875 tablet_bootstrap.cc:654] T e71f3281e90c48599052cabc94cfc3b5 P 4b1e476d7e6241fbac41768184552018: Neither blocks nor log segments found. Creating new log.
I20260811 05:08:08.418515 6874 log.cc:824] T e71f3281e90c48599052cabc94cfc3b5 P 95c53350afaf4f799751127bdd8f40fb: Log is configured to *not* fsync() on all Append() calls
I20260811 05:08:08.418821 6875 log.cc:824] T e71f3281e90c48599052cabc94cfc3b5 P 4b1e476d7e6241fbac41768184552018: Log is configured to *not* fsync() on all Append() calls
I20260811 05:08:08.419168 6872 tablet_bootstrap.cc:492] T e71f3281e90c48599052cabc94cfc3b5 P db794d15babb45b6a10aeb091d4472fe: No bootstrap required, opened a new log
I20260811 05:08:08.419250 6872 ts_tablet_manager.cc:1397] T e71f3281e90c48599052cabc94cfc3b5 P db794d15babb45b6a10aeb091d4472fe: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 05:08:08.419432 6874 tablet_bootstrap.cc:492] T e71f3281e90c48599052cabc94cfc3b5 P 95c53350afaf4f799751127bdd8f40fb: No bootstrap required, opened a new log
I20260811 05:08:08.419505 6874 ts_tablet_manager.cc:1397] T e71f3281e90c48599052cabc94cfc3b5 P 95c53350afaf4f799751127bdd8f40fb: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 05:08:08.419710 6875 tablet_bootstrap.cc:492] T e71f3281e90c48599052cabc94cfc3b5 P 4b1e476d7e6241fbac41768184552018: No bootstrap required, opened a new log
I20260811 05:08:08.419786 6875 ts_tablet_manager.cc:1397] T e71f3281e90c48599052cabc94cfc3b5 P 4b1e476d7e6241fbac41768184552018: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 05:08:08.421577 6875 raft_consensus.cc:348] T e71f3281e90c48599052cabc94cfc3b5 P 4b1e476d7e6241fbac41768184552018 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95c53350afaf4f799751127bdd8f40fb" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 39395 } } peers { permanent_uuid: "4b1e476d7e6241fbac41768184552018" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 34541 } } peers { permanent_uuid: "db794d15babb45b6a10aeb091d4472fe" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 39383 } }
I20260811 05:08:08.421757 6875 raft_consensus.cc:374] T e71f3281e90c48599052cabc94cfc3b5 P 4b1e476d7e6241fbac41768184552018 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:08:08.421808 6875 raft_consensus.cc:729] T e71f3281e90c48599052cabc94cfc3b5 P 4b1e476d7e6241fbac41768184552018 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b1e476d7e6241fbac41768184552018, State: Initialized, Role: FOLLOWER
I20260811 05:08:08.421959 6875 consensus_queue.cc:260] T e71f3281e90c48599052cabc94cfc3b5 P 4b1e476d7e6241fbac41768184552018 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95c53350afaf4f799751127bdd8f40fb" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 39395 } } peers { permanent_uuid: "4b1e476d7e6241fbac41768184552018" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 34541 } } peers { permanent_uuid: "db794d15babb45b6a10aeb091d4472fe" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 39383 } }
I20260811 05:08:08.422303 6828 heartbeater.cc:503] Master 127.26.191.254:43813 was elected leader, sending a full tablet report...
I20260811 05:08:08.422333 6872 raft_consensus.cc:348] T e71f3281e90c48599052cabc94cfc3b5 P db794d15babb45b6a10aeb091d4472fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95c53350afaf4f799751127bdd8f40fb" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 39395 } } peers { permanent_uuid: "4b1e476d7e6241fbac41768184552018" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 34541 } } peers { permanent_uuid: "db794d15babb45b6a10aeb091d4472fe" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 39383 } }
I20260811 05:08:08.422501 6872 raft_consensus.cc:374] T e71f3281e90c48599052cabc94cfc3b5 P db794d15babb45b6a10aeb091d4472fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:08:08.422542 6872 raft_consensus.cc:729] T e71f3281e90c48599052cabc94cfc3b5 P db794d15babb45b6a10aeb091d4472fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: db794d15babb45b6a10aeb091d4472fe, State: Initialized, Role: FOLLOWER
I20260811 05:08:08.422662 6872 consensus_queue.cc:260] T e71f3281e90c48599052cabc94cfc3b5 P db794d15babb45b6a10aeb091d4472fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95c53350afaf4f799751127bdd8f40fb" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 39395 } } peers { permanent_uuid: "4b1e476d7e6241fbac41768184552018" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 34541 } } peers { permanent_uuid: "db794d15babb45b6a10aeb091d4472fe" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 39383 } }
I20260811 05:08:08.422566 6874 raft_consensus.cc:348] T e71f3281e90c48599052cabc94cfc3b5 P 95c53350afaf4f799751127bdd8f40fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95c53350afaf4f799751127bdd8f40fb" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 39395 } } peers { permanent_uuid: "4b1e476d7e6241fbac41768184552018" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 34541 } } peers { permanent_uuid: "db794d15babb45b6a10aeb091d4472fe" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 39383 } }
I20260811 05:08:08.422749 6874 raft_consensus.cc:374] T e71f3281e90c48599052cabc94cfc3b5 P 95c53350afaf4f799751127bdd8f40fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:08:08.422791 6874 raft_consensus.cc:729] T e71f3281e90c48599052cabc94cfc3b5 P 95c53350afaf4f799751127bdd8f40fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95c53350afaf4f799751127bdd8f40fb, State: Initialized, Role: FOLLOWER
I20260811 05:08:08.422951 6872 ts_tablet_manager.cc:1428] T e71f3281e90c48599052cabc94cfc3b5 P db794d15babb45b6a10aeb091d4472fe: Time spent starting tablet: real 0.004s user 0.001s sys 0.003s
I20260811 05:08:08.422945 6874 consensus_queue.cc:260] T e71f3281e90c48599052cabc94cfc3b5 P 95c53350afaf4f799751127bdd8f40fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95c53350afaf4f799751127bdd8f40fb" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 39395 } } peers { permanent_uuid: "4b1e476d7e6241fbac41768184552018" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 34541 } } peers { permanent_uuid: "db794d15babb45b6a10aeb091d4472fe" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 39383 } }
I20260811 05:08:08.423233 6874 ts_tablet_manager.cc:1428] T e71f3281e90c48599052cabc94cfc3b5 P 95c53350afaf4f799751127bdd8f40fb: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260811 05:08:08.423326 6603 heartbeater.cc:503] Master 127.26.191.254:43813 was elected leader, sending a full tablet report...
I20260811 05:08:08.423743 6368 heartbeater.cc:503] Master 127.26.191.254:43813 was elected leader, sending a full tablet report...
I20260811 05:08:08.424688 6875 ts_tablet_manager.cc:1428] T e71f3281e90c48599052cabc94cfc3b5 P 4b1e476d7e6241fbac41768184552018: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
W20260811 05:08:08.453380 6605 tablet.cc:2369] T e71f3281e90c48599052cabc94cfc3b5 P 95c53350afaf4f799751127bdd8f40fb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 05:08:08.485571 6865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:08.482387 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.252:36269 (local address 127.0.0.1:34892)
0811 05:08:08.482497 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:08.482516 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:08.482595 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:08.482794 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:08.482796 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:08.482798 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:08:08.482873 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:08.482875 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:08.483629 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:08.483630 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:08.484529 (+ 899us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:08.484531 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:08.485289 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:08.485290 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:08.485369 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:08.485374 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 05:08:08.485432 (+ 58us) client_negotiation.cc:240] Negotiation successful
0811 05:08:08.485499 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":67}
I20260811 05:08:08.485600 6846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:08.482459 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34892 (local address 127.26.191.252:36269)
0811 05:08:08.482535 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:08.482538 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:08.482572 (+ 34us) server_negotiation.cc:407] Connection header received
0811 05:08:08.482683 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:08.482684 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:08.482711 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:08.482789 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:08:08.482945 (+ 156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:08.483516 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:08.484633 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:08.485209 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:08.485277 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:08.485339 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:08.485441 (+ 102us) server_negotiation.cc:299] Negotiation successful
0811 05:08:08.485498 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 05:08:08.485980 6081 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 44992f39b96c43dba1e367c8788a8eb7 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.9] Dedup: 1.7->[1.8-1.9]
I20260811 05:08:08.486999 6885 sys_catalog.cc:455] T 00000000000000000000000000000000 P 44992f39b96c43dba1e367c8788a8eb7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b8fed5a210a94d26b6993a9d4e186564. Latest consensus state: current_term: 1 leader_uuid: "b8fed5a210a94d26b6993a9d4e186564" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b8fed5a210a94d26b6993a9d4e186564" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 43813 } } peers { permanent_uuid: "25cb19e8f2c245629b828de638b93da3" member_type: VOTER last_known_addr { host: "127.26.191.253" port: 41643 } attrs { promote: false } } peers { permanent_uuid: "44992f39b96c43dba1e367c8788a8eb7" member_type: NON_VOTER last_known_addr { host: "127.26.191.252" port: 36269 } attrs { promote: true } } }
I20260811 05:08:08.487130 6885 sys_catalog.cc:458] T 00000000000000000000000000000000 P 44992f39b96c43dba1e367c8788a8eb7 [sys.catalog]: This master's current role is: LEARNER
W20260811 05:08:08.519794 6370 tablet.cc:2369] T e71f3281e90c48599052cabc94cfc3b5 P db794d15babb45b6a10aeb091d4472fe: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 05:08:08.531874 6881 raft_consensus.cc:482] T e71f3281e90c48599052cabc94cfc3b5 P 4b1e476d7e6241fbac41768184552018 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 05:08:08.532020 6881 raft_consensus.cc:504] T e71f3281e90c48599052cabc94cfc3b5 P 4b1e476d7e6241fbac41768184552018 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95c53350afaf4f799751127bdd8f40fb" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 39395 } } peers { permanent_uuid: "4b1e476d7e6241fbac41768184552018" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 34541 } } peers { permanent_uuid: "db794d15babb45b6a10aeb091d4472fe" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 39383 } }
I20260811 05:08:08.532502 6881 leader_election.cc:288] T e71f3281e90c48599052cabc94cfc3b5 P 4b1e476d7e6241fbac41768184552018 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95c53350afaf4f799751127bdd8f40fb (127.26.191.194:39395), db794d15babb45b6a10aeb091d4472fe (127.26.191.193:39383)
I20260811 05:08:08.535813 6864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:08.532869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.195:41319 (local address 127.26.191.194:39395)
0811 05:08:08.532929 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:08.532932 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:08.532985 (+ 53us) server_negotiation.cc:407] Connection header received
0811 05:08:08.533093 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:08.533095 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:08.533107 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:08.533154 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:08:08.533431 (+ 277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:08.533937 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:08.534983 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:08.535401 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:08.535508 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:08.535518 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:08.535685 (+ 167us) server_negotiation.cc:299] Negotiation successful
0811 05:08:08.535727 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 05:08:08.535820 6870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:08.533106 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.195:59971 (local address 127.26.191.193:39383)
0811 05:08:08.533164 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:08.533166 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:08.533175 (+ 9us) server_negotiation.cc:407] Connection header received
0811 05:08:08.533205 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:08.533206 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:08.533214 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:08.533278 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:08:08.533444 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:08.533991 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:08.535002 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:08.535408 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:08.535497 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:08.535507 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:08.535674 (+ 167us) server_negotiation.cc:299] Negotiation successful
0811 05:08:08.535726 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260811 05:08:08.535851 6832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:08.533032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.193:39383 (local address 127.26.191.195:59971)
0811 05:08:08.533086 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:08.533098 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:08.533144 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:08.533284 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:08.533284 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:08.533286 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:08:08.533355 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:08.533356 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:08.534104 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:08.534105 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:08.534895 (+ 790us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:08.534897 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:08.535507 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:08.535508 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:08.535591 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:08.535594 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 05:08:08.535666 (+ 72us) client_negotiation.cc:240] Negotiation successful
0811 05:08:08.535717 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38,"mutex_wait_us":1}
I20260811 05:08:08.535874 6831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:08.532853 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.194:39395 (local address 127.26.191.195:41319)
0811 05:08:08.532911 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:08.532925 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:08.533003 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:08.533212 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:08.533213 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:08.533214 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:08:08.533317 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:08.533319 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:08.534037 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:08.534038 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:08.534851 (+ 813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:08.534853 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:08.535508 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:08.535509 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:08.535598 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:08.535601 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 05:08:08.535666 (+ 65us) client_negotiation.cc:240] Negotiation successful
0811 05:08:08.535717 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34,"mutex_wait_us":42}
I20260811 05:08:08.536284 6522 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e71f3281e90c48599052cabc94cfc3b5" candidate_uuid: "4b1e476d7e6241fbac41768184552018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95c53350afaf4f799751127bdd8f40fb" is_pre_election: true
I20260811 05:08:08.536301 6294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e71f3281e90c48599052cabc94cfc3b5" candidate_uuid: "4b1e476d7e6241fbac41768184552018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db794d15babb45b6a10aeb091d4472fe" is_pre_election: true
I20260811 05:08:08.536496 6522 raft_consensus.cc:2454] T e71f3281e90c48599052cabc94cfc3b5 P 95c53350afaf4f799751127bdd8f40fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b1e476d7e6241fbac41768184552018 in term 0.
I20260811 05:08:08.536497 6294 raft_consensus.cc:2454] T e71f3281e90c48599052cabc94cfc3b5 P db794d15babb45b6a10aeb091d4472fe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b1e476d7e6241fbac41768184552018 in term 0.
I20260811 05:08:08.536834 6636 leader_election.cc:302] T e71f3281e90c48599052cabc94cfc3b5 P 4b1e476d7e6241fbac41768184552018 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b1e476d7e6241fbac41768184552018, db794d15babb45b6a10aeb091d4472fe; no voters:
I20260811 05:08:08.536978 6881 raft_consensus.cc:2781] T e71f3281e90c48599052cabc94cfc3b5 P 4b1e476d7e6241fbac41768184552018 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 05:08:08.537038 6881 raft_consensus.cc:482] T e71f3281e90c48599052cabc94cfc3b5 P 4b1e476d7e6241fbac41768184552018 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 05:08:08.537074 6881 raft_consensus.cc:3037] T e71f3281e90c48599052cabc94cfc3b5 P 4b1e476d7e6241fbac41768184552018 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:08:08.538220 6881 raft_consensus.cc:504] T e71f3281e90c48599052cabc94cfc3b5 P 4b1e476d7e6241fbac41768184552018 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95c53350afaf4f799751127bdd8f40fb" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 39395 } } peers { permanent_uuid: "4b1e476d7e6241fbac41768184552018" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 34541 } } peers { permanent_uuid: "db794d15babb45b6a10aeb091d4472fe" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 39383 } }
I20260811 05:08:08.538396 6881 leader_election.cc:288] T e71f3281e90c48599052cabc94cfc3b5 P 4b1e476d7e6241fbac41768184552018 [CANDIDATE]: Term 1 election: Requested vote from peers 95c53350afaf4f799751127bdd8f40fb (127.26.191.194:39395), db794d15babb45b6a10aeb091d4472fe (127.26.191.193:39383)
I20260811 05:08:08.538614 6294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e71f3281e90c48599052cabc94cfc3b5" candidate_uuid: "4b1e476d7e6241fbac41768184552018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db794d15babb45b6a10aeb091d4472fe"
I20260811 05:08:08.538690 6522 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e71f3281e90c48599052cabc94cfc3b5" candidate_uuid: "4b1e476d7e6241fbac41768184552018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95c53350afaf4f799751127bdd8f40fb"
I20260811 05:08:08.538738 6294 raft_consensus.cc:3037] T e71f3281e90c48599052cabc94cfc3b5 P db794d15babb45b6a10aeb091d4472fe [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:08:08.538781 6522 raft_consensus.cc:3037] T e71f3281e90c48599052cabc94cfc3b5 P 95c53350afaf4f799751127bdd8f40fb [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:08:08.539858 6522 raft_consensus.cc:2454] T e71f3281e90c48599052cabc94cfc3b5 P 95c53350afaf4f799751127bdd8f40fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b1e476d7e6241fbac41768184552018 in term 1.
I20260811 05:08:08.539858 6294 raft_consensus.cc:2454] T e71f3281e90c48599052cabc94cfc3b5 P db794d15babb45b6a10aeb091d4472fe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b1e476d7e6241fbac41768184552018 in term 1.
I20260811 05:08:08.540125 6636 leader_election.cc:302] T e71f3281e90c48599052cabc94cfc3b5 P 4b1e476d7e6241fbac41768184552018 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b1e476d7e6241fbac41768184552018, db794d15babb45b6a10aeb091d4472fe; no voters:
I20260811 05:08:08.540253 6881 raft_consensus.cc:2781] T e71f3281e90c48599052cabc94cfc3b5 P 4b1e476d7e6241fbac41768184552018 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:08:08.540473 6881 raft_consensus.cc:686] T e71f3281e90c48599052cabc94cfc3b5 P 4b1e476d7e6241fbac41768184552018 [term 1 LEADER]: Becoming Leader. State: Replica: 4b1e476d7e6241fbac41768184552018, State: Running, Role: LEADER
I20260811 05:08:08.540578 6881 consensus_queue.cc:237] T e71f3281e90c48599052cabc94cfc3b5 P 4b1e476d7e6241fbac41768184552018 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95c53350afaf4f799751127bdd8f40fb" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 39395 } } peers { permanent_uuid: "4b1e476d7e6241fbac41768184552018" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 34541 } } peers { permanent_uuid: "db794d15babb45b6a10aeb091d4472fe" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 39383 } }
I20260811 05:08:08.541842 4769 catalog_manager.cc:5495] T e71f3281e90c48599052cabc94cfc3b5 P 4b1e476d7e6241fbac41768184552018 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b1e476d7e6241fbac41768184552018 (127.26.191.195). New cstate: current_term: 1 leader_uuid: "4b1e476d7e6241fbac41768184552018" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95c53350afaf4f799751127bdd8f40fb" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 39395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b1e476d7e6241fbac41768184552018" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 34541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "db794d15babb45b6a10aeb091d4472fe" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 39383 } health_report { overall_health: UNKNOWN } } }
I20260811 05:08:08.542529 6856 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8fed5a210a94d26b6993a9d4e186564 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b8fed5a210a94d26b6993a9d4e186564" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b8fed5a210a94d26b6993a9d4e186564" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 43813 } } peers { permanent_uuid: "25cb19e8f2c245629b828de638b93da3" member_type: VOTER last_known_addr { host: "127.26.191.253" port: 41643 } attrs { promote: false } } peers { permanent_uuid: "44992f39b96c43dba1e367c8788a8eb7" member_type: NON_VOTER last_known_addr { host: "127.26.191.252" port: 36269 } attrs { promote: true } } }
I20260811 05:08:08.542670 6856 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8fed5a210a94d26b6993a9d4e186564 [sys.catalog]: This master's current role is: LEADER
I20260811 05:08:08.543704 5690 raft_consensus.cc:1050] T 00000000000000000000000000000000 P b8fed5a210a94d26b6993a9d4e186564: attempting to promote NON_VOTER 44992f39b96c43dba1e367c8788a8eb7 to VOTER
I20260811 05:08:08.543845 5690 consensus_queue.cc:237] T 00000000000000000000000000000000 P b8fed5a210a94d26b6993a9d4e186564 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 1.10, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "b8fed5a210a94d26b6993a9d4e186564" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 43813 } } peers { permanent_uuid: "25cb19e8f2c245629b828de638b93da3" member_type: VOTER last_known_addr { host: "127.26.191.253" port: 41643 } attrs { promote: false } } peers { permanent_uuid: "44992f39b96c43dba1e367c8788a8eb7" member_type: VOTER last_known_addr { host: "127.26.191.252" port: 36269 } attrs { promote: false } }
I20260811 05:08:08.544427 6081 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 44992f39b96c43dba1e367c8788a8eb7 [term 1 LEARNER]: Refusing update from remote peer b8fed5a210a94d26b6993a9d4e186564: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20260811 05:08:08.544488 5770 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 25cb19e8f2c245629b828de638b93da3 [term 1 FOLLOWER]: Refusing update from remote peer b8fed5a210a94d26b6993a9d4e186564: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20260811 05:08:08.544718 6902 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b8fed5a210a94d26b6993a9d4e186564 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44992f39b96c43dba1e367c8788a8eb7" member_type: VOTER last_known_addr { host: "127.26.191.252" port: 36269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260811 05:08:08.544867 6856 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b8fed5a210a94d26b6993a9d4e186564 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25cb19e8f2c245629b828de638b93da3" member_type: VOTER last_known_addr { host: "127.26.191.253" port: 41643 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260811 05:08:08.545558 5690 raft_consensus.cc:2932] T 00000000000000000000000000000000 P b8fed5a210a94d26b6993a9d4e186564 [term 1 LEADER]: Committing config change with OpId 1.11: config changed from index 7 to 11, 44992f39b96c43dba1e367c8788a8eb7 (127.26.191.252) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "b8fed5a210a94d26b6993a9d4e186564" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 43813 } } peers { permanent_uuid: "25cb19e8f2c245629b828de638b93da3" member_type: VOTER last_known_addr { host: "127.26.191.253" port: 41643 } attrs { promote: false } } peers { permanent_uuid: "44992f39b96c43dba1e367c8788a8eb7" member_type: VOTER last_known_addr { host: "127.26.191.252" port: 36269 } attrs { promote: false } } }
I20260811 05:08:08.546496 5690 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8fed5a210a94d26b6993a9d4e186564 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "b8fed5a210a94d26b6993a9d4e186564" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "b8fed5a210a94d26b6993a9d4e186564" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 43813 } } peers { permanent_uuid: "25cb19e8f2c245629b828de638b93da3" member_type: VOTER last_known_addr { host: "127.26.191.253" port: 41643 } attrs { promote: false } } peers { permanent_uuid: "44992f39b96c43dba1e367c8788a8eb7" member_type: VOTER last_known_addr { host: "127.26.191.252" port: 36269 } attrs { promote: false } } }
I20260811 05:08:08.546526 6861 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8fed5a210a94d26b6993a9d4e186564 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b8fed5a210a94d26b6993a9d4e186564" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "b8fed5a210a94d26b6993a9d4e186564" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 43813 } } peers { permanent_uuid: "25cb19e8f2c245629b828de638b93da3" member_type: VOTER last_known_addr { host: "127.26.191.253" port: 41643 } attrs { promote: false } } peers { permanent_uuid: "44992f39b96c43dba1e367c8788a8eb7" member_type: VOTER last_known_addr { host: "127.26.191.252" port: 36269 } attrs { promote: false } } }
I20260811 05:08:08.546608 6861 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8fed5a210a94d26b6993a9d4e186564 [sys.catalog]: This master's current role is: LEADER
I20260811 05:08:08.546581 6856 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8fed5a210a94d26b6993a9d4e186564 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b8fed5a210a94d26b6993a9d4e186564" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "b8fed5a210a94d26b6993a9d4e186564" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 43813 } } peers { permanent_uuid: "25cb19e8f2c245629b828de638b93da3" member_type: VOTER last_known_addr { host: "127.26.191.253" port: 41643 } attrs { promote: false } } peers { permanent_uuid: "44992f39b96c43dba1e367c8788a8eb7" member_type: VOTER last_known_addr { host: "127.26.191.252" port: 36269 } attrs { promote: false } } }
I20260811 05:08:08.546716 6856 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8fed5a210a94d26b6993a9d4e186564 [sys.catalog]: This master's current role is: LEADER
I20260811 05:08:08.546598 5690 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8fed5a210a94d26b6993a9d4e186564 [sys.catalog]: This master's current role is: LEADER
I20260811 05:08:08.546819 5770 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 25cb19e8f2c245629b828de638b93da3 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 7 to 11, 44992f39b96c43dba1e367c8788a8eb7 (127.26.191.252) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "b8fed5a210a94d26b6993a9d4e186564" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 43813 } } peers { permanent_uuid: "25cb19e8f2c245629b828de638b93da3" member_type: VOTER last_known_addr { host: "127.26.191.253" port: 41643 } attrs { promote: false } } peers { permanent_uuid: "44992f39b96c43dba1e367c8788a8eb7" member_type: VOTER last_known_addr { host: "127.26.191.252" port: 36269 } attrs { promote: false } } }
I20260811 05:08:08.546869 6081 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 44992f39b96c43dba1e367c8788a8eb7 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 7 to 11, 44992f39b96c43dba1e367c8788a8eb7 (127.26.191.252) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "b8fed5a210a94d26b6993a9d4e186564" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 43813 } } peers { permanent_uuid: "25cb19e8f2c245629b828de638b93da3" member_type: VOTER last_known_addr { host: "127.26.191.253" port: 41643 } attrs { promote: false } } peers { permanent_uuid: "44992f39b96c43dba1e367c8788a8eb7" member_type: VOTER last_known_addr { host: "127.26.191.252" port: 36269 } attrs { promote: false } } }
I20260811 05:08:08.547950 6885 sys_catalog.cc:455] T 00000000000000000000000000000000 P 44992f39b96c43dba1e367c8788a8eb7 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b8fed5a210a94d26b6993a9d4e186564" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "b8fed5a210a94d26b6993a9d4e186564" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 43813 } } peers { permanent_uuid: "25cb19e8f2c245629b828de638b93da3" member_type: VOTER last_known_addr { host: "127.26.191.253" port: 41643 } attrs { promote: false } } peers { permanent_uuid: "44992f39b96c43dba1e367c8788a8eb7" member_type: VOTER last_known_addr { host: "127.26.191.252" port: 36269 } attrs { promote: false } } }
I20260811 05:08:08.547956 6906 sys_catalog.cc:455] T 00000000000000000000000000000000 P 25cb19e8f2c245629b828de638b93da3 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b8fed5a210a94d26b6993a9d4e186564" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "b8fed5a210a94d26b6993a9d4e186564" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 43813 } } peers { permanent_uuid: "25cb19e8f2c245629b828de638b93da3" member_type: VOTER last_known_addr { host: "127.26.191.253" port: 41643 } attrs { promote: false } } peers { permanent_uuid: "44992f39b96c43dba1e367c8788a8eb7" member_type: VOTER last_known_addr { host: "127.26.191.252" port: 36269 } attrs { promote: false } } }
I20260811 05:08:08.548071 6885 sys_catalog.cc:458] T 00000000000000000000000000000000 P 44992f39b96c43dba1e367c8788a8eb7 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 05:08:08.548072 6906 sys_catalog.cc:458] T 00000000000000000000000000000000 P 25cb19e8f2c245629b828de638b93da3 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 05:08:08.567301 6871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:08.564433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54920 (local address 127.26.191.195:34541)
0811 05:08:08.564511 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:08.564513 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:08.564521 (+ 8us) server_negotiation.cc:407] Connection header received
0811 05:08:08.564557 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:08.564558 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:08.564577 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:08.564677 (+ 100us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:08:08.564976 (+ 299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:08.565490 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:08.566384 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:08.566592 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:08.566658 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:08.566915 (+ 257us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:08:08.567031 (+ 116us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:08:08.567158 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:08.567177 (+ 19us) server_negotiation.cc:299] Negotiation successful
0811 05:08:08.567208 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 05:08:08.569694 6522 raft_consensus.cc:1261] T e71f3281e90c48599052cabc94cfc3b5 P 95c53350afaf4f799751127bdd8f40fb [term 1 FOLLOWER]: Refusing update from remote peer 4b1e476d7e6241fbac41768184552018: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:08:08.569694 6294 raft_consensus.cc:1261] T e71f3281e90c48599052cabc94cfc3b5 P db794d15babb45b6a10aeb091d4472fe [term 1 FOLLOWER]: Refusing update from remote peer 4b1e476d7e6241fbac41768184552018: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:08:08.570127 6881 consensus_queue.cc:1035] T e71f3281e90c48599052cabc94cfc3b5 P 4b1e476d7e6241fbac41768184552018 [LEADER]: Connected to new peer: Peer: permanent_uuid: "db794d15babb45b6a10aeb091d4472fe" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 39383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:08:08.570353 6897 consensus_queue.cc:1035] T e71f3281e90c48599052cabc94cfc3b5 P 4b1e476d7e6241fbac41768184552018 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95c53350afaf4f799751127bdd8f40fb" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 39395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:08:08.573432 6910 mvcc.cc:205] Tried to move back new op lower bound from 7317196343578247168 to 7317196343463305216. Current Snapshot: MvccSnapshot[applied={T|T < 7317196343578247168}]
I20260811 05:08:08.573835 6908 mvcc.cc:205] Tried to move back new op lower bound from 7317196343578247168 to 7317196343463305216. Current Snapshot: MvccSnapshot[applied={T|T < 7317196343578247168 or (T in {7317196343578247168})}]
I20260811 05:08:08.575438 6909 mvcc.cc:205] Tried to move back new op lower bound from 7317196343578247168 to 7317196343463305216. Current Snapshot: MvccSnapshot[applied={T|T < 7317196343578247168}]
I20260811 05:08:08.576207 4769 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40720:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:08:08.576303 4769 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40720:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:08:08.577775 4769 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b8fed5a210a94d26b6993a9d4e186564: Sending DeleteTablet for 3 replicas of tablet e71f3281e90c48599052cabc94cfc3b5
I20260811 05:08:08.578203 6263 tablet_service.cc:1514] Processing DeleteTablet for tablet e71f3281e90c48599052cabc94cfc3b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:08:08 UTC) from {username='oryx', principal='oryx/127.26.191.254@KRBTEST.COM'} at 127.0.0.1:43760
I20260811 05:08:08.578215 6709 tablet_service.cc:1514] Processing DeleteTablet for tablet e71f3281e90c48599052cabc94cfc3b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:08:08 UTC) from {username='oryx', principal='oryx/127.26.191.254@KRBTEST.COM'} at 127.0.0.1:54904
I20260811 05:08:08.579030 6924 tablet_replica.cc:330] T e71f3281e90c48599052cabc94cfc3b5 P 4b1e476d7e6241fbac41768184552018: stopping tablet replica
I20260811 05:08:08.579151 6924 raft_consensus.cc:2229] T e71f3281e90c48599052cabc94cfc3b5 P 4b1e476d7e6241fbac41768184552018 [term 1 LEADER]: Raft consensus shutting down.
I20260811 05:08:08.579293 6924 raft_consensus.cc:2258] T e71f3281e90c48599052cabc94cfc3b5 P 4b1e476d7e6241fbac41768184552018 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:08:08.579339 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 4715
I20260811 05:08:08.588609 6846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:08.578752 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34906 (local address 127.26.191.252:36269)
0811 05:08:08.578795 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:08.578797 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:08.578808 (+ 11us) server_negotiation.cc:407] Connection header received
0811 05:08:08.578906 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:08.578907 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:08.578918 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:08.578950 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:08.580376 (+ 1426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:08.581085 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:08.582048 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:08.582301 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:08.582355 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:08.584266 (+ 1911us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:08.584268 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:08.584269 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:08:08.584279 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:08.586731 (+ 2452us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:08.587311 (+ 580us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:08.587312 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:08.587313 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:08.587392 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:08.587681 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:08.587683 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:08.587683 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:08.587896 (+ 213us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:08.587996 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:08.588304 (+ 308us) server_negotiation.cc:299] Negotiation successful
0811 05:08:08.588430 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 05:08:08.590576 6924 ts_tablet_manager.cc:1905] T e71f3281e90c48599052cabc94cfc3b5 P 4b1e476d7e6241fbac41768184552018: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:08:08.591462 6495 tablet_service.cc:1514] Processing DeleteTablet for tablet e71f3281e90c48599052cabc94cfc3b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:08:08 UTC) from {username='oryx', principal='oryx/127.26.191.254@KRBTEST.COM'} at 127.0.0.1:35586
I20260811 05:08:08.592227 6923 tablet_replica.cc:330] T e71f3281e90c48599052cabc94cfc3b5 P db794d15babb45b6a10aeb091d4472fe: stopping tablet replica
I20260811 05:08:08.592381 6923 raft_consensus.cc:2229] T e71f3281e90c48599052cabc94cfc3b5 P db794d15babb45b6a10aeb091d4472fe [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 05:08:08.592597 6923 raft_consensus.cc:2258] T e71f3281e90c48599052cabc94cfc3b5 P db794d15babb45b6a10aeb091d4472fe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:08:08.592696 6924 ts_tablet_manager.cc:1918] T e71f3281e90c48599052cabc94cfc3b5 P 4b1e476d7e6241fbac41768184552018: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 05:08:08.592795 6924 log.cc:1196] T e71f3281e90c48599052cabc94cfc3b5 P 4b1e476d7e6241fbac41768184552018: Deleting WAL directory at /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/ts-2/wal/wals/e71f3281e90c48599052cabc94cfc3b5
I20260811 05:08:08.593227 6924 ts_tablet_manager.cc:1939] T e71f3281e90c48599052cabc94cfc3b5 P 4b1e476d7e6241fbac41768184552018: Deleting consensus metadata
I20260811 05:08:08.594002 6923 ts_tablet_manager.cc:1905] T e71f3281e90c48599052cabc94cfc3b5 P db794d15babb45b6a10aeb091d4472fe: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:08:08.596112 6923 ts_tablet_manager.cc:1918] T e71f3281e90c48599052cabc94cfc3b5 P db794d15babb45b6a10aeb091d4472fe: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 05:08:08.596216 6923 log.cc:1196] T e71f3281e90c48599052cabc94cfc3b5 P db794d15babb45b6a10aeb091d4472fe: Deleting WAL directory at /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/ts-0/wal/wals/e71f3281e90c48599052cabc94cfc3b5
I20260811 05:08:08.597012 6923 ts_tablet_manager.cc:1939] T e71f3281e90c48599052cabc94cfc3b5 P db794d15babb45b6a10aeb091d4472fe: Deleting consensus metadata
I20260811 05:08:08.600972 6927 tablet_replica.cc:330] T e71f3281e90c48599052cabc94cfc3b5 P 95c53350afaf4f799751127bdd8f40fb: stopping tablet replica
I20260811 05:08:08.601239 6927 raft_consensus.cc:2229] T e71f3281e90c48599052cabc94cfc3b5 P 95c53350afaf4f799751127bdd8f40fb [term 1 FOLLOWER]: Raft consensus shutting down.
W20260811 05:08:08.601300 6183 connection.cc:535] server connection from 127.0.0.1:43760 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 05:08:08.601495 6927 raft_consensus.cc:2258] T e71f3281e90c48599052cabc94cfc3b5 P 95c53350afaf4f799751127bdd8f40fb [term 1 FOLLOWER]: Raft consensus is shut down!
W20260811 05:08:08.601529 5726 connection.cc:535] server connection from 127.0.0.1:54782 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260811 05:08:08.601737 6635 connection.cc:535] server connection from 127.0.0.1:54904 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 05:08:08.603096 6927 ts_tablet_manager.cc:1905] T e71f3281e90c48599052cabc94cfc3b5 P 95c53350afaf4f799751127bdd8f40fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:08:08.605165 6927 ts_tablet_manager.cc:1918] T e71f3281e90c48599052cabc94cfc3b5 P 95c53350afaf4f799751127bdd8f40fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 05:08:08.605314 6927 log.cc:1196] T e71f3281e90c48599052cabc94cfc3b5 P 95c53350afaf4f799751127bdd8f40fb: Deleting WAL directory at /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/ts-1/wal/wals/e71f3281e90c48599052cabc94cfc3b5
I20260811 05:08:08.605664 6927 ts_tablet_manager.cc:1939] T e71f3281e90c48599052cabc94cfc3b5 P 95c53350afaf4f799751127bdd8f40fb: Deleting consensus metadata
W20260811 05:08:08.606129 6411 connection.cc:441] server connection from 127.0.0.1:35586 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35586 (request call id 1) could send its response
I20260811 05:08:08.612423 6854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:08.604282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54792 (local address 127.26.191.253:41643)
0811 05:08:08.604335 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:08.604338 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:08.604398 (+ 60us) server_negotiation.cc:407] Connection header received
0811 05:08:08.604537 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:08.604538 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:08.604555 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:08.604588 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:08.605487 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:08.606273 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:08.607187 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:08.607413 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:08.607506 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:08.609193 (+ 1687us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:08.609195 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:08.609195 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:08:08.609204 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:08.610965 (+ 1761us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:08.611338 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:08.611339 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:08.611339 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:08.611405 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:08.611625 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:08.611626 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:08.611626 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:08.611873 (+ 247us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:08.611952 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:08.612186 (+ 234us) server_negotiation.cc:299] Negotiation successful
0811 05:08:08.612303 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 05:08:08.613325 6846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:08.604377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34920 (local address 127.26.191.252:36269)
0811 05:08:08.604425 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:08.604427 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:08.604699 (+ 272us) server_negotiation.cc:407] Connection header received
0811 05:08:08.604854 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:08.604856 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:08.604867 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:08.604899 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:08.605979 (+ 1080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:08.606722 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:08.607866 (+ 1144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:08.608153 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:08.608261 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:08.609694 (+ 1433us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:08.609695 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:08.609696 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:08:08.609704 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:08.611330 (+ 1626us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:08.611713 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:08.611714 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:08.611715 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:08.611781 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:08.612026 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:08.612027 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:08.612028 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:08.612183 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:08.612291 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:08.613106 (+ 815us) server_negotiation.cc:299] Negotiation successful
0811 05:08:08.613206 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 05:08:09.574977 6935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:09.574554 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:43813 (local address 127.26.191.193:34655)
0811 05:08:09.574777 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:09.574900 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:43813: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":84,"threads_started":1}
W20260811 05:08:09.575399 6368 heartbeater.cc:644] Failed to heartbeat to 127.26.191.254:43813 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.26.191.254:43813: connect: Connection refused (error 111)
I20260811 05:08:09.575616 6936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:09.575261 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:43813 (local address 127.26.191.195:39527)
0811 05:08:09.575424 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:09.575547 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:43813: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":85,"threads_started":1}
W20260811 05:08:09.575991 6828 heartbeater.cc:644] Failed to heartbeat to 127.26.191.254:43813 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.26.191.254:43813: connect: Connection refused (error 111)
I20260811 05:08:09.576249 6937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:09.575993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:43813 (local address 127.26.191.194:38123)
0811 05:08:09.576116 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:09.576191 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:43813: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":71,"threads_started":1}
W20260811 05:08:09.576524 6603 heartbeater.cc:644] Failed to heartbeat to 127.26.191.254:43813 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.26.191.254:43813: connect: Connection refused (error 111)
I20260811 05:08:10.077981 6938 raft_consensus.cc:482] T 00000000000000000000000000000000 P 44992f39b96c43dba1e367c8788a8eb7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8fed5a210a94d26b6993a9d4e186564)
I20260811 05:08:10.078138 6938 raft_consensus.cc:504] T 00000000000000000000000000000000 P 44992f39b96c43dba1e367c8788a8eb7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "b8fed5a210a94d26b6993a9d4e186564" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 43813 } } peers { permanent_uuid: "25cb19e8f2c245629b828de638b93da3" member_type: VOTER last_known_addr { host: "127.26.191.253" port: 41643 } attrs { promote: false } } peers { permanent_uuid: "44992f39b96c43dba1e367c8788a8eb7" member_type: VOTER last_known_addr { host: "127.26.191.252" port: 36269 } attrs { promote: false } }
I20260811 05:08:10.078616 6938 leader_election.cc:288] T 00000000000000000000000000000000 P 44992f39b96c43dba1e367c8788a8eb7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8fed5a210a94d26b6993a9d4e186564 (127.26.191.254:43813), 25cb19e8f2c245629b828de638b93da3 (127.26.191.253:41643)
I20260811 05:08:10.079133 6943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:10.078838 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:43813 (local address 127.0.0.1:41206)
0811 05:08:10.078984 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:10.079073 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:43813: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":66,"threads_started":1}
I20260811 05:08:10.079200 6946 raft_consensus.cc:482] T 00000000000000000000000000000000 P 25cb19e8f2c245629b828de638b93da3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8fed5a210a94d26b6993a9d4e186564)
W20260811 05:08:10.079334 6049 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.191.254:43813: connect: Connection refused (error 111)
I20260811 05:08:10.079340 6946 raft_consensus.cc:504] T 00000000000000000000000000000000 P 25cb19e8f2c245629b828de638b93da3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "b8fed5a210a94d26b6993a9d4e186564" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 43813 } } peers { permanent_uuid: "25cb19e8f2c245629b828de638b93da3" member_type: VOTER last_known_addr { host: "127.26.191.253" port: 41643 } attrs { promote: false } } peers { permanent_uuid: "44992f39b96c43dba1e367c8788a8eb7" member_type: VOTER last_known_addr { host: "127.26.191.252" port: 36269 } attrs { promote: false } }
I20260811 05:08:10.079820 6943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:10.079686 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:43813 (local address 127.0.0.1:41216)
0811 05:08:10.079753 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:10.079789 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:43813: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260811 05:08:10.079914 6948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:10.079696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:43813 (local address 127.0.0.1:41222)
0811 05:08:10.079815 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:10.079871 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:43813: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":76,"threads_started":1}
W20260811 05:08:10.080032 5725 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.191.254:43813: connect: Connection refused (error 111)
W20260811 05:08:10.080030 6049 leader_election.cc:334] T 00000000000000000000000000000000 P 44992f39b96c43dba1e367c8788a8eb7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b8fed5a210a94d26b6993a9d4e186564 (127.26.191.254:43813): Network error: Client connection negotiation failed: client connection to 127.26.191.254:43813: connect: Connection refused (error 111)
I20260811 05:08:10.080287 6946 leader_election.cc:288] T 00000000000000000000000000000000 P 25cb19e8f2c245629b828de638b93da3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8fed5a210a94d26b6993a9d4e186564 (127.26.191.254:43813), 44992f39b96c43dba1e367c8788a8eb7 (127.26.191.252:36269)
I20260811 05:08:10.080549 6950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:10.080424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:43813 (local address 127.0.0.1:41230)
0811 05:08:10.080470 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:10.080523 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:43813: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260811 05:08:10.080670 5725 leader_election.cc:334] T 00000000000000000000000000000000 P 25cb19e8f2c245629b828de638b93da3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b8fed5a210a94d26b6993a9d4e186564 (127.26.191.254:43813): Network error: Client connection negotiation failed: client connection to 127.26.191.254:43813: connect: Connection refused (error 111)
I20260811 05:08:10.082702 6941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:10.078863 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.253:41643 (local address 127.0.0.1:54808)
0811 05:08:10.078986 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:10.078998 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:10.079066 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:10.079379 (+ 313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:10.079381 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:10.079384 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:08:10.079457 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:10.079460 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:10.080463 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:10.080465 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:10.081821 (+ 1356us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:10.081823 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:10.082388 (+ 565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:10.082389 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:10.082457 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:10.082461 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 05:08:10.082546 (+ 85us) client_negotiation.cc:240] Negotiation successful
0811 05:08:10.082592 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":78,"threads_started":1}
I20260811 05:08:10.082707 6944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:10.079013 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54808 (local address 127.26.191.253:41643)
0811 05:08:10.079200 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:10.079203 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:10.079214 (+ 11us) server_negotiation.cc:407] Connection header received
0811 05:08:10.079251 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:10.079253 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:10.079267 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:10.079541 (+ 274us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:08:10.079612 (+ 71us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:10.080379 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:10.081895 (+ 1516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:10.082299 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:10.082389 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:10.082399 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:10.082571 (+ 172us) server_negotiation.cc:299] Negotiation successful
0811 05:08:10.082624 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":158,"thread_start_us":51,"threads_started":1}
I20260811 05:08:10.083042 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "44992f39b96c43dba1e367c8788a8eb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "25cb19e8f2c245629b828de638b93da3" is_pre_election: true
I20260811 05:08:10.083173 5770 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 25cb19e8f2c245629b828de638b93da3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44992f39b96c43dba1e367c8788a8eb7 in term 1.
I20260811 05:08:10.083376 6054 leader_election.cc:302] T 00000000000000000000000000000000 P 44992f39b96c43dba1e367c8788a8eb7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25cb19e8f2c245629b828de638b93da3, 44992f39b96c43dba1e367c8788a8eb7; no voters: b8fed5a210a94d26b6993a9d4e186564
I20260811 05:08:10.083540 6938 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 44992f39b96c43dba1e367c8788a8eb7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 05:08:10.083628 6938 raft_consensus.cc:482] T 00000000000000000000000000000000 P 44992f39b96c43dba1e367c8788a8eb7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b8fed5a210a94d26b6993a9d4e186564)
I20260811 05:08:10.083655 6938 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 44992f39b96c43dba1e367c8788a8eb7 [term 1 FOLLOWER]: Advancing to term 2
I20260811 05:08:10.084030 6952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:10.080176 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34924 (local address 127.26.191.252:36269)
0811 05:08:10.080442 (+ 266us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:10.080444 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:10.080452 (+ 8us) server_negotiation.cc:407] Connection header received
0811 05:08:10.080707 (+ 255us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:10.080708 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:10.080744 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:10.080881 (+ 137us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:08:10.081029 (+ 148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:10.081740 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:10.083053 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:10.083613 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:10.083687 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:10.083697 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:10.083915 (+ 218us) server_negotiation.cc:299] Negotiation successful
0811 05:08:10.083960 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":240,"thread_start_us":87,"threads_started":1}
I20260811 05:08:10.084022 6948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:10.079987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.252:36269 (local address 127.0.0.1:34924)
0811 05:08:10.080254 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:10.080265 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:10.080321 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:10.080891 (+ 570us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:10.080892 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:10.080896 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:08:10.080946 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:10.080952 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:10.081931 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:10.081932 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:10.082969 (+ 1037us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:10.082973 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:10.083686 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:10.083687 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:10.083820 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:10.083826 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 05:08:10.083907 (+ 81us) client_negotiation.cc:240] Negotiation successful
0811 05:08:10.083953 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":256,"mutex_wait_us":1,"thread_start_us":42,"threads_started":1}
I20260811 05:08:10.084295 6081 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "25cb19e8f2c245629b828de638b93da3" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "44992f39b96c43dba1e367c8788a8eb7" is_pre_election: true
I20260811 05:08:10.084671 6938 raft_consensus.cc:504] T 00000000000000000000000000000000 P 44992f39b96c43dba1e367c8788a8eb7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "b8fed5a210a94d26b6993a9d4e186564" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 43813 } } peers { permanent_uuid: "25cb19e8f2c245629b828de638b93da3" member_type: VOTER last_known_addr { host: "127.26.191.253" port: 41643 } attrs { promote: false } } peers { permanent_uuid: "44992f39b96c43dba1e367c8788a8eb7" member_type: VOTER last_known_addr { host: "127.26.191.252" port: 36269 } attrs { promote: false } }
I20260811 05:08:10.084889 6081 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 44992f39b96c43dba1e367c8788a8eb7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25cb19e8f2c245629b828de638b93da3 in current term 2: Already voted for candidate 44992f39b96c43dba1e367c8788a8eb7 in this term.
I20260811 05:08:10.084897 6938 leader_election.cc:288] T 00000000000000000000000000000000 P 44992f39b96c43dba1e367c8788a8eb7 [CANDIDATE]: Term 2 election: Requested vote from peers b8fed5a210a94d26b6993a9d4e186564 (127.26.191.254:43813), 25cb19e8f2c245629b828de638b93da3 (127.26.191.253:41643)
I20260811 05:08:10.085090 6941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:10.084993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:43813 (local address 127.0.0.1:41246)
0811 05:08:10.085030 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:10.085065 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:43813: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":19}
I20260811 05:08:10.085049 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "44992f39b96c43dba1e367c8788a8eb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "25cb19e8f2c245629b828de638b93da3"
I20260811 05:08:10.085119 5727 leader_election.cc:302] T 00000000000000000000000000000000 P 25cb19e8f2c245629b828de638b93da3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25cb19e8f2c245629b828de638b93da3; no voters: 44992f39b96c43dba1e367c8788a8eb7, b8fed5a210a94d26b6993a9d4e186564
I20260811 05:08:10.085121 5770 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 25cb19e8f2c245629b828de638b93da3 [term 1 FOLLOWER]: Advancing to term 2
I20260811 05:08:10.085451 6941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:10.085311 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:43813 (local address 127.0.0.1:41262)
0811 05:08:10.085394 (+ 83us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:10.085428 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:43813: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
W20260811 05:08:10.085530 6049 leader_election.cc:334] T 00000000000000000000000000000000 P 44992f39b96c43dba1e367c8788a8eb7 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer b8fed5a210a94d26b6993a9d4e186564 (127.26.191.254:43813): Network error: Client connection negotiation failed: client connection to 127.26.191.254:43813: connect: Connection refused (error 111)
I20260811 05:08:10.085948 5770 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 25cb19e8f2c245629b828de638b93da3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44992f39b96c43dba1e367c8788a8eb7 in term 2.
I20260811 05:08:10.086037 6946 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 25cb19e8f2c245629b828de638b93da3 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 05:08:10.086155 6054 leader_election.cc:302] T 00000000000000000000000000000000 P 44992f39b96c43dba1e367c8788a8eb7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25cb19e8f2c245629b828de638b93da3, 44992f39b96c43dba1e367c8788a8eb7; no voters: b8fed5a210a94d26b6993a9d4e186564
I20260811 05:08:10.086242 6938 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 44992f39b96c43dba1e367c8788a8eb7 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 05:08:10.086426 6938 raft_consensus.cc:686] T 00000000000000000000000000000000 P 44992f39b96c43dba1e367c8788a8eb7 [term 2 LEADER]: Becoming Leader. State: Replica: 44992f39b96c43dba1e367c8788a8eb7, State: Running, Role: LEADER
I20260811 05:08:10.086503 6938 consensus_queue.cc:237] T 00000000000000000000000000000000 P 44992f39b96c43dba1e367c8788a8eb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "b8fed5a210a94d26b6993a9d4e186564" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 43813 } } peers { permanent_uuid: "25cb19e8f2c245629b828de638b93da3" member_type: VOTER last_known_addr { host: "127.26.191.253" port: 41643 } attrs { promote: false } } peers { permanent_uuid: "44992f39b96c43dba1e367c8788a8eb7" member_type: VOTER last_known_addr { host: "127.26.191.252" port: 36269 } attrs { promote: false } }
I20260811 05:08:10.086871 6954 sys_catalog.cc:455] T 00000000000000000000000000000000 P 44992f39b96c43dba1e367c8788a8eb7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 44992f39b96c43dba1e367c8788a8eb7. Latest consensus state: current_term: 2 leader_uuid: "44992f39b96c43dba1e367c8788a8eb7" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "b8fed5a210a94d26b6993a9d4e186564" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 43813 } } peers { permanent_uuid: "25cb19e8f2c245629b828de638b93da3" member_type: VOTER last_known_addr { host: "127.26.191.253" port: 41643 } attrs { promote: false } } peers { permanent_uuid: "44992f39b96c43dba1e367c8788a8eb7" member_type: VOTER last_known_addr { host: "127.26.191.252" port: 36269 } attrs { promote: false } } }
I20260811 05:08:10.086982 6954 sys_catalog.cc:458] T 00000000000000000000000000000000 P 44992f39b96c43dba1e367c8788a8eb7 [sys.catalog]: This master's current role is: LEADER
I20260811 05:08:10.087188 6956 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:08:10.087718 6956 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:08:10.087787 6956 catalog_manager.cc:1259] Loaded cluster ID: 3ed6af74e2204dc5a8aa5a0144170ddf
I20260811 05:08:10.087805 6956 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:08:10.088045 6956 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:08:10.088135 6956 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 44992f39b96c43dba1e367c8788a8eb7: Loaded TSK: 0
I20260811 05:08:10.088286 6956 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 05:08:10.091689 6071 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34920:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 05:08:10.093616 6071 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 05:08:10.094900 6941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:10.094756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:43813 (local address 127.0.0.1:41270)
0811 05:08:10.094821 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:10.094864 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:43813: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260811 05:08:10.094892 5770 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 25cb19e8f2c245629b828de638b93da3 [term 2 FOLLOWER]: Refusing update from remote peer 44992f39b96c43dba1e367c8788a8eb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
I20260811 05:08:10.095180 6938 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 44992f39b96c43dba1e367c8788a8eb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25cb19e8f2c245629b828de638b93da3" member_type: VOTER last_known_addr { host: "127.26.191.253" port: 41643 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260811 05:08:10.095393 6941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:10.095266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:43813 (local address 127.0.0.1:41276)
0811 05:08:10.095328 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:10.095364 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:43813: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260811 05:08:10.095474 6049 consensus_peers.cc:487] T 00000000000000000000000000000000 P 44992f39b96c43dba1e367c8788a8eb7 -> Peer b8fed5a210a94d26b6993a9d4e186564 (127.26.191.254:43813): Couldn't send request to peer b8fed5a210a94d26b6993a9d4e186564. Status: Network error: Client connection negotiation failed: client connection to 127.26.191.254:43813: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 05:08:10.095922 6946 sys_catalog.cc:455] T 00000000000000000000000000000000 P 25cb19e8f2c245629b828de638b93da3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 44992f39b96c43dba1e367c8788a8eb7. Latest consensus state: current_term: 2 leader_uuid: "44992f39b96c43dba1e367c8788a8eb7" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "b8fed5a210a94d26b6993a9d4e186564" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 43813 } } peers { permanent_uuid: "25cb19e8f2c245629b828de638b93da3" member_type: VOTER last_known_addr { host: "127.26.191.253" port: 41643 } attrs { promote: false } } peers { permanent_uuid: "44992f39b96c43dba1e367c8788a8eb7" member_type: VOTER last_known_addr { host: "127.26.191.252" port: 36269 } attrs { promote: false } } }
I20260811 05:08:10.096028 6946 sys_catalog.cc:458] T 00000000000000000000000000000000 P 25cb19e8f2c245629b828de638b93da3 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 05:08:10.096594 6954 sys_catalog.cc:455] T 00000000000000000000000000000000 P 44992f39b96c43dba1e367c8788a8eb7 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "44992f39b96c43dba1e367c8788a8eb7" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "b8fed5a210a94d26b6993a9d4e186564" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 43813 } } peers { permanent_uuid: "25cb19e8f2c245629b828de638b93da3" member_type: VOTER last_known_addr { host: "127.26.191.253" port: 41643 } attrs { promote: false } } peers { permanent_uuid: "44992f39b96c43dba1e367c8788a8eb7" member_type: VOTER last_known_addr { host: "127.26.191.252" port: 36269 } attrs { promote: false } } }
I20260811 05:08:10.096751 6954 sys_catalog.cc:458] T 00000000000000000000000000000000 P 44992f39b96c43dba1e367c8788a8eb7 [sys.catalog]: This master's current role is: LEADER
I20260811 05:08:10.096822 6946 sys_catalog.cc:455] T 00000000000000000000000000000000 P 25cb19e8f2c245629b828de638b93da3 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "44992f39b96c43dba1e367c8788a8eb7" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "b8fed5a210a94d26b6993a9d4e186564" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 43813 } } peers { permanent_uuid: "25cb19e8f2c245629b828de638b93da3" member_type: VOTER last_known_addr { host: "127.26.191.253" port: 41643 } attrs { promote: false } } peers { permanent_uuid: "44992f39b96c43dba1e367c8788a8eb7" member_type: VOTER last_known_addr { host: "127.26.191.252" port: 36269 } attrs { promote: false } } }
I20260811 05:08:10.096932 6946 sys_catalog.cc:458] T 00000000000000000000000000000000 P 25cb19e8f2c245629b828de638b93da3 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 05:08:10.096942 6959 mvcc.cc:205] Tried to move back new op lower bound from 7317196349826310144 to 7317196349795012608. Current Snapshot: MvccSnapshot[applied={T|T < 7317196349826310144}]
I20260811 05:08:10.102340 6941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:10.098884 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.195:34541 (local address 127.0.0.1:54926)
0811 05:08:10.098967 (+ 83us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:10.098983 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:10.099038 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:10.099300 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:10.099301 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:10.099303 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:08:10.099366 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:10.099367 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:10.100299 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:10.100300 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:10.101303 (+ 1003us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:10.101305 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:10.102086 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:10.102087 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:10.102153 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:10.102158 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 05:08:10.102218 (+ 60us) client_negotiation.cc:240] Negotiation successful
0811 05:08:10.102261 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":61}
I20260811 05:08:10.102380 6966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:10.098993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54926 (local address 127.26.191.195:34541)
0811 05:08:10.099114 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:10.099116 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:10.099127 (+ 11us) server_negotiation.cc:407] Connection header received
0811 05:08:10.099168 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:10.099169 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:10.099182 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:10.099440 (+ 258us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:08:10.099487 (+ 47us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:10.100195 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:10.101414 (+ 1219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:10.102025 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:10.102082 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:10.102090 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:10.102223 (+ 133us) server_negotiation.cc:299] Negotiation successful
0811 05:08:10.102252 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95,"thread_start_us":65,"threads_started":1}
I20260811 05:08:10.102931 6709 tablet_service.cc:1467] Processing CreateTablet for tablet 028d3458c1b24299b2eff57ecad531dd (DEFAULT_TABLE table=test-table [id=d28db0865cd54319a59b171f4a377ef8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:08:10.103116 6709 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 028d3458c1b24299b2eff57ecad531dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:08:10.103691 6967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:10.099091 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.193:39383 (local address 127.0.0.1:43762)
0811 05:08:10.099261 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:10.099273 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:10.099325 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:10.099823 (+ 498us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:10.099824 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:10.099834 (+ 10us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:08:10.099881 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:10.099882 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:10.100926 (+ 1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:10.100927 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:10.101927 (+ 1000us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:10.101929 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:10.103412 (+ 1483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:10.103413 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:10.103480 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:10.103485 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 05:08:10.103538 (+ 53us) client_negotiation.cc:240] Negotiation successful
0811 05:08:10.103580 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":96,"threads_started":1}
I20260811 05:08:10.104022 6971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:10.099461 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43762 (local address 127.26.191.193:39383)
0811 05:08:10.099670 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:10.099673 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:10.099682 (+ 9us) server_negotiation.cc:407] Connection header received
0811 05:08:10.099711 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:10.099711 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:10.099723 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:10.099952 (+ 229us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:08:10.100021 (+ 69us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:10.100831 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:10.102637 (+ 1806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:10.103306 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:10.103403 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:10.103413 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:10.103891 (+ 478us) server_negotiation.cc:299] Negotiation successful
0811 05:08:10.103944 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":185,"thread_start_us":63,"threads_started":1}
I20260811 05:08:10.104089 6943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:10.098999 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.194:39395 (local address 127.0.0.1:35594)
0811 05:08:10.099232 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:10.099243 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:10.099290 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:10.099591 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:10.099592 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:10.099595 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:08:10.099650 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:10.099652 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:10.100714 (+ 1062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:10.100715 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:10.101828 (+ 1113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:10.101831 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:10.103844 (+ 2013us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:10.103846 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:10.103929 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:10.103932 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 05:08:10.103975 (+ 43us) client_negotiation.cc:240] Negotiation successful
0811 05:08:10.104014 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":215,"mutex_wait_us":23}
I20260811 05:08:10.104382 6263 tablet_service.cc:1467] Processing CreateTablet for tablet 028d3458c1b24299b2eff57ecad531dd (DEFAULT_TABLE table=test-table [id=d28db0865cd54319a59b171f4a377ef8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:08:10.104526 6263 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 028d3458c1b24299b2eff57ecad531dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:08:10.104642 6969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:10.099142 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35594 (local address 127.26.191.194:39395)
0811 05:08:10.099416 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:10.099418 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:10.099425 (+ 7us) server_negotiation.cc:407] Connection header received
0811 05:08:10.099473 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:10.099474 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:10.099485 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:10.099728 (+ 243us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:08:10.099789 (+ 61us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:10.100617 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:10.101909 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:10.103659 (+ 1750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:10.104478 (+ 819us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:10.104489 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:10.104510 (+ 21us) server_negotiation.cc:299] Negotiation successful
0811 05:08:10.104558 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":255,"thread_start_us":91,"threads_started":1}
I20260811 05:08:10.104890 6973 tablet_bootstrap.cc:492] T 028d3458c1b24299b2eff57ecad531dd P 4b1e476d7e6241fbac41768184552018: Bootstrap starting.
I20260811 05:08:10.104964 6495 tablet_service.cc:1467] Processing CreateTablet for tablet 028d3458c1b24299b2eff57ecad531dd (DEFAULT_TABLE table=test-table [id=d28db0865cd54319a59b171f4a377ef8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:08:10.105109 6495 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 028d3458c1b24299b2eff57ecad531dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:08:10.105324 6973 tablet_bootstrap.cc:654] T 028d3458c1b24299b2eff57ecad531dd P 4b1e476d7e6241fbac41768184552018: Neither blocks nor log segments found. Creating new log.
I20260811 05:08:10.105993 6973 tablet_bootstrap.cc:492] T 028d3458c1b24299b2eff57ecad531dd P 4b1e476d7e6241fbac41768184552018: No bootstrap required, opened a new log
I20260811 05:08:10.106056 6973 ts_tablet_manager.cc:1397] T 028d3458c1b24299b2eff57ecad531dd P 4b1e476d7e6241fbac41768184552018: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 05:08:10.106174 6973 raft_consensus.cc:348] T 028d3458c1b24299b2eff57ecad531dd P 4b1e476d7e6241fbac41768184552018 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b1e476d7e6241fbac41768184552018" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 34541 } } peers { permanent_uuid: "95c53350afaf4f799751127bdd8f40fb" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 39395 } } peers { permanent_uuid: "db794d15babb45b6a10aeb091d4472fe" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 39383 } }
I20260811 05:08:10.106264 6973 raft_consensus.cc:374] T 028d3458c1b24299b2eff57ecad531dd P 4b1e476d7e6241fbac41768184552018 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:08:10.106287 6973 raft_consensus.cc:729] T 028d3458c1b24299b2eff57ecad531dd P 4b1e476d7e6241fbac41768184552018 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b1e476d7e6241fbac41768184552018, State: Initialized, Role: FOLLOWER
I20260811 05:08:10.106333 6973 consensus_queue.cc:260] T 028d3458c1b24299b2eff57ecad531dd P 4b1e476d7e6241fbac41768184552018 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b1e476d7e6241fbac41768184552018" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 34541 } } peers { permanent_uuid: "95c53350afaf4f799751127bdd8f40fb" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 39395 } } peers { permanent_uuid: "db794d15babb45b6a10aeb091d4472fe" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 39383 } }
I20260811 05:08:10.106469 6973 ts_tablet_manager.cc:1428] T 028d3458c1b24299b2eff57ecad531dd P 4b1e476d7e6241fbac41768184552018: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 05:08:10.106972 6979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:10.106743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:43813 (local address 127.26.191.195:59427)
0811 05:08:10.106898 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:10.106941 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:43813: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":108,"threads_started":1}
I20260811 05:08:10.107285 6978 tablet_bootstrap.cc:492] T 028d3458c1b24299b2eff57ecad531dd P 95c53350afaf4f799751127bdd8f40fb: Bootstrap starting.
I20260811 05:08:10.107688 6978 tablet_bootstrap.cc:654] T 028d3458c1b24299b2eff57ecad531dd P 95c53350afaf4f799751127bdd8f40fb: Neither blocks nor log segments found. Creating new log.
I20260811 05:08:10.108107 6976 tablet_bootstrap.cc:492] T 028d3458c1b24299b2eff57ecad531dd P db794d15babb45b6a10aeb091d4472fe: Bootstrap starting.
I20260811 05:08:10.108517 6976 tablet_bootstrap.cc:654] T 028d3458c1b24299b2eff57ecad531dd P db794d15babb45b6a10aeb091d4472fe: Neither blocks nor log segments found. Creating new log.
I20260811 05:08:10.108983 6978 tablet_bootstrap.cc:492] T 028d3458c1b24299b2eff57ecad531dd P 95c53350afaf4f799751127bdd8f40fb: No bootstrap required, opened a new log
I20260811 05:08:10.109035 6978 ts_tablet_manager.cc:1397] T 028d3458c1b24299b2eff57ecad531dd P 95c53350afaf4f799751127bdd8f40fb: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 05:08:10.109225 6976 tablet_bootstrap.cc:492] T 028d3458c1b24299b2eff57ecad531dd P db794d15babb45b6a10aeb091d4472fe: No bootstrap required, opened a new log
I20260811 05:08:10.109215 6978 raft_consensus.cc:348] T 028d3458c1b24299b2eff57ecad531dd P 95c53350afaf4f799751127bdd8f40fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b1e476d7e6241fbac41768184552018" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 34541 } } peers { permanent_uuid: "95c53350afaf4f799751127bdd8f40fb" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 39395 } } peers { permanent_uuid: "db794d15babb45b6a10aeb091d4472fe" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 39383 } }
I20260811 05:08:10.109275 6978 raft_consensus.cc:374] T 028d3458c1b24299b2eff57ecad531dd P 95c53350afaf4f799751127bdd8f40fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:08:10.109303 6976 ts_tablet_manager.cc:1397] T 028d3458c1b24299b2eff57ecad531dd P db794d15babb45b6a10aeb091d4472fe: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 05:08:10.109293 6978 raft_consensus.cc:729] T 028d3458c1b24299b2eff57ecad531dd P 95c53350afaf4f799751127bdd8f40fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95c53350afaf4f799751127bdd8f40fb, State: Initialized, Role: FOLLOWER
I20260811 05:08:10.109371 6978 consensus_queue.cc:260] T 028d3458c1b24299b2eff57ecad531dd P 95c53350afaf4f799751127bdd8f40fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b1e476d7e6241fbac41768184552018" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 34541 } } peers { permanent_uuid: "95c53350afaf4f799751127bdd8f40fb" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 39395 } } peers { permanent_uuid: "db794d15babb45b6a10aeb091d4472fe" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 39383 } }
I20260811 05:08:10.109503 6976 raft_consensus.cc:348] T 028d3458c1b24299b2eff57ecad531dd P db794d15babb45b6a10aeb091d4472fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b1e476d7e6241fbac41768184552018" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 34541 } } peers { permanent_uuid: "95c53350afaf4f799751127bdd8f40fb" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 39395 } } peers { permanent_uuid: "db794d15babb45b6a10aeb091d4472fe" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 39383 } }
I20260811 05:08:10.109545 6978 ts_tablet_manager.cc:1428] T 028d3458c1b24299b2eff57ecad531dd P 95c53350afaf4f799751127bdd8f40fb: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 05:08:10.109591 6976 raft_consensus.cc:374] T 028d3458c1b24299b2eff57ecad531dd P db794d15babb45b6a10aeb091d4472fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:08:10.109627 6976 raft_consensus.cc:729] T 028d3458c1b24299b2eff57ecad531dd P db794d15babb45b6a10aeb091d4472fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: db794d15babb45b6a10aeb091d4472fe, State: Initialized, Role: FOLLOWER
I20260811 05:08:10.109681 6976 consensus_queue.cc:260] T 028d3458c1b24299b2eff57ecad531dd P db794d15babb45b6a10aeb091d4472fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b1e476d7e6241fbac41768184552018" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 34541 } } peers { permanent_uuid: "95c53350afaf4f799751127bdd8f40fb" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 39395 } } peers { permanent_uuid: "db794d15babb45b6a10aeb091d4472fe" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 39383 } }
I20260811 05:08:10.109864 6976 ts_tablet_manager.cc:1428] T 028d3458c1b24299b2eff57ecad531dd P db794d15babb45b6a10aeb091d4472fe: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 05:08:10.110245 6986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:10.109812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:43813 (local address 127.26.191.194:52855)
0811 05:08:10.110062 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:10.110104 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:43813: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":228,"thread_start_us":87,"threads_started":1}
I20260811 05:08:10.110559 6367 heartbeater.cc:503] Master 127.26.191.252:36269 was elected leader, sending a full tablet report...
I20260811 05:08:10.110594 6602 heartbeater.cc:503] Master 127.26.191.252:36269 was elected leader, sending a full tablet report...
I20260811 05:08:10.110764 6986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:10.110650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:43813 (local address 127.26.191.194:33967)
0811 05:08:10.110703 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:10.110733 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:43813: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260811 05:08:10.111049 6988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:10.110083 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:43813 (local address 127.26.191.193:41739)
0811 05:08:10.110943 (+ 860us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:10.110988 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:43813: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":832,"thread_start_us":83,"threads_started":1}
I20260811 05:08:10.111454 6988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:10.111356 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:43813 (local address 127.26.191.193:36715)
0811 05:08:10.111396 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:10.111432 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:43813: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
W20260811 05:08:10.131218 6830 tablet.cc:2369] T 028d3458c1b24299b2eff57ecad531dd P 4b1e476d7e6241fbac41768184552018: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 05:08:10.272070 6983 raft_consensus.cc:482] T 028d3458c1b24299b2eff57ecad531dd P 95c53350afaf4f799751127bdd8f40fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 05:08:10.272220 6983 raft_consensus.cc:504] T 028d3458c1b24299b2eff57ecad531dd P 95c53350afaf4f799751127bdd8f40fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b1e476d7e6241fbac41768184552018" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 34541 } } peers { permanent_uuid: "95c53350afaf4f799751127bdd8f40fb" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 39395 } } peers { permanent_uuid: "db794d15babb45b6a10aeb091d4472fe" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 39383 } }
I20260811 05:08:10.272626 6983 leader_election.cc:288] T 028d3458c1b24299b2eff57ecad531dd P 95c53350afaf4f799751127bdd8f40fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b1e476d7e6241fbac41768184552018 (127.26.191.195:34541), db794d15babb45b6a10aeb091d4472fe (127.26.191.193:39383)
I20260811 05:08:10.276167 6986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:10.272978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.195:34541 (local address 127.26.191.194:42025)
0811 05:08:10.273043 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:10.273056 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:10.273117 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:10.273296 (+ 179us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:10.273297 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:10.273300 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:08:10.273388 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:10.273390 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:10.274232 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:10.274233 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:10.275193 (+ 960us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:10.275196 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:10.275862 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:10.275863 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:10.275939 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:10.275943 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 05:08:10.276009 (+ 66us) client_negotiation.cc:240] Negotiation successful
0811 05:08:10.276063 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39,"mutex_wait_us":29}
I20260811 05:08:10.276221 6971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:10.273196 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.194:46177 (local address 127.26.191.193:39383)
0811 05:08:10.273257 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:10.273260 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:10.273439 (+ 179us) server_negotiation.cc:407] Connection header received
0811 05:08:10.273470 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:10.273471 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:10.273482 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:10.273536 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:08:10.273706 (+ 170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:10.274195 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:10.275198 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:10.275738 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:10.275830 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:10.275845 (+ 15us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:10.276074 (+ 229us) server_negotiation.cc:299] Negotiation successful
0811 05:08:10.276129 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260811 05:08:10.276221 6966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:10.273069 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.194:42025 (local address 127.26.191.195:34541)
0811 05:08:10.273149 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:10.273151 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:10.273163 (+ 12us) server_negotiation.cc:407] Connection header received
0811 05:08:10.273198 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:10.273199 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:10.273209 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:10.273288 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:08:10.273542 (+ 254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:10.274137 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:10.275262 (+ 1125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:10.275788 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:10.275856 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:10.275866 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:10.276074 (+ 208us) server_negotiation.cc:299] Negotiation successful
0811 05:08:10.276129 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 05:08:10.276167 6990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:10.273139 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.193:39383 (local address 127.26.191.194:46177)
0811 05:08:10.273359 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:10.273367 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:10.273417 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:10.273559 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:10.273559 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:10.273561 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:08:10.273628 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:10.273630 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:10.274295 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:10.274295 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:10.275093 (+ 798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:10.275096 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:10.275841 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:10.275842 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:10.275939 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:10.275944 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 05:08:10.276009 (+ 65us) client_negotiation.cc:240] Negotiation successful
0811 05:08:10.276063 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":195,"mutex_wait_us":7,"thread_start_us":129,"threads_started":1}
I20260811 05:08:10.276592 6747 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "028d3458c1b24299b2eff57ecad531dd" candidate_uuid: "95c53350afaf4f799751127bdd8f40fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b1e476d7e6241fbac41768184552018" is_pre_election: true
I20260811 05:08:10.276819 6747 raft_consensus.cc:2454] T 028d3458c1b24299b2eff57ecad531dd P 4b1e476d7e6241fbac41768184552018 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95c53350afaf4f799751127bdd8f40fb in term 0.
I20260811 05:08:10.276800 6294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "028d3458c1b24299b2eff57ecad531dd" candidate_uuid: "95c53350afaf4f799751127bdd8f40fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db794d15babb45b6a10aeb091d4472fe" is_pre_election: true
I20260811 05:08:10.276885 6294 raft_consensus.cc:2454] T 028d3458c1b24299b2eff57ecad531dd P db794d15babb45b6a10aeb091d4472fe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95c53350afaf4f799751127bdd8f40fb in term 0.
I20260811 05:08:10.277035 6410 leader_election.cc:302] T 028d3458c1b24299b2eff57ecad531dd P 95c53350afaf4f799751127bdd8f40fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b1e476d7e6241fbac41768184552018, 95c53350afaf4f799751127bdd8f40fb; no voters:
I20260811 05:08:10.277179 6983 raft_consensus.cc:2781] T 028d3458c1b24299b2eff57ecad531dd P 95c53350afaf4f799751127bdd8f40fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 05:08:10.277223 6983 raft_consensus.cc:482] T 028d3458c1b24299b2eff57ecad531dd P 95c53350afaf4f799751127bdd8f40fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 05:08:10.277245 6983 raft_consensus.cc:3037] T 028d3458c1b24299b2eff57ecad531dd P 95c53350afaf4f799751127bdd8f40fb [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:08:10.277987 6983 raft_consensus.cc:504] T 028d3458c1b24299b2eff57ecad531dd P 95c53350afaf4f799751127bdd8f40fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b1e476d7e6241fbac41768184552018" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 34541 } } peers { permanent_uuid: "95c53350afaf4f799751127bdd8f40fb" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 39395 } } peers { permanent_uuid: "db794d15babb45b6a10aeb091d4472fe" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 39383 } }
I20260811 05:08:10.278134 6983 leader_election.cc:288] T 028d3458c1b24299b2eff57ecad531dd P 95c53350afaf4f799751127bdd8f40fb [CANDIDATE]: Term 1 election: Requested vote from peers 4b1e476d7e6241fbac41768184552018 (127.26.191.195:34541), db794d15babb45b6a10aeb091d4472fe (127.26.191.193:39383)
I20260811 05:08:10.278370 6747 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "028d3458c1b24299b2eff57ecad531dd" candidate_uuid: "95c53350afaf4f799751127bdd8f40fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b1e476d7e6241fbac41768184552018"
I20260811 05:08:10.278365 6294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "028d3458c1b24299b2eff57ecad531dd" candidate_uuid: "95c53350afaf4f799751127bdd8f40fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db794d15babb45b6a10aeb091d4472fe"
I20260811 05:08:10.278473 6747 raft_consensus.cc:3037] T 028d3458c1b24299b2eff57ecad531dd P 4b1e476d7e6241fbac41768184552018 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:08:10.278473 6294 raft_consensus.cc:3037] T 028d3458c1b24299b2eff57ecad531dd P db794d15babb45b6a10aeb091d4472fe [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:08:10.279387 6747 raft_consensus.cc:2454] T 028d3458c1b24299b2eff57ecad531dd P 4b1e476d7e6241fbac41768184552018 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95c53350afaf4f799751127bdd8f40fb in term 1.
I20260811 05:08:10.279387 6294 raft_consensus.cc:2454] T 028d3458c1b24299b2eff57ecad531dd P db794d15babb45b6a10aeb091d4472fe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95c53350afaf4f799751127bdd8f40fb in term 1.
I20260811 05:08:10.279588 6410 leader_election.cc:302] T 028d3458c1b24299b2eff57ecad531dd P 95c53350afaf4f799751127bdd8f40fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95c53350afaf4f799751127bdd8f40fb, db794d15babb45b6a10aeb091d4472fe; no voters:
I20260811 05:08:10.279728 6983 raft_consensus.cc:2781] T 028d3458c1b24299b2eff57ecad531dd P 95c53350afaf4f799751127bdd8f40fb [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:08:10.279987 6983 raft_consensus.cc:686] T 028d3458c1b24299b2eff57ecad531dd P 95c53350afaf4f799751127bdd8f40fb [term 1 LEADER]: Becoming Leader. State: Replica: 95c53350afaf4f799751127bdd8f40fb, State: Running, Role: LEADER
I20260811 05:08:10.280084 6983 consensus_queue.cc:237] T 028d3458c1b24299b2eff57ecad531dd P 95c53350afaf4f799751127bdd8f40fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b1e476d7e6241fbac41768184552018" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 34541 } } peers { permanent_uuid: "95c53350afaf4f799751127bdd8f40fb" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 39395 } } peers { permanent_uuid: "db794d15babb45b6a10aeb091d4472fe" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 39383 } }
I20260811 05:08:10.280651 6990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:10.280315 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:43813 (local address 127.26.191.194:34281)
0811 05:08:10.280378 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:10.280612 (+ 234us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:43813: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260811 05:08:10.281034 6073 catalog_manager.cc:5495] T 028d3458c1b24299b2eff57ecad531dd P 95c53350afaf4f799751127bdd8f40fb reported cstate change: term changed from 0 to 1, leader changed from <none> to 95c53350afaf4f799751127bdd8f40fb (127.26.191.194). New cstate: current_term: 1 leader_uuid: "95c53350afaf4f799751127bdd8f40fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b1e476d7e6241fbac41768184552018" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 34541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95c53350afaf4f799751127bdd8f40fb" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 39395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "db794d15babb45b6a10aeb091d4472fe" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 39383 } health_report { overall_health: UNKNOWN } } }
I20260811 05:08:10.333549 6969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:10.330152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35210 (local address 127.26.191.194:39395)
0811 05:08:10.330259 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:10.330261 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:10.330272 (+ 11us) server_negotiation.cc:407] Connection header received
0811 05:08:10.330457 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:10.330459 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:10.330494 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:10.330578 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:08:10.330893 (+ 315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:10.331379 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:10.332244 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:10.332501 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:10.332576 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:10.333037 (+ 461us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:08:10.333181 (+ 144us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:08:10.333265 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:10.333377 (+ 112us) server_negotiation.cc:299] Negotiation successful
0811 05:08:10.333405 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260811 05:08:10.335198 6294 raft_consensus.cc:1261] T 028d3458c1b24299b2eff57ecad531dd P db794d15babb45b6a10aeb091d4472fe [term 1 FOLLOWER]: Refusing update from remote peer 95c53350afaf4f799751127bdd8f40fb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:08:10.335283 6747 raft_consensus.cc:1261] T 028d3458c1b24299b2eff57ecad531dd P 4b1e476d7e6241fbac41768184552018 [term 1 FOLLOWER]: Refusing update from remote peer 95c53350afaf4f799751127bdd8f40fb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:08:10.335602 6983 consensus_queue.cc:1035] T 028d3458c1b24299b2eff57ecad531dd P 95c53350afaf4f799751127bdd8f40fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "db794d15babb45b6a10aeb091d4472fe" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 39383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:08:10.335774 6991 consensus_queue.cc:1035] T 028d3458c1b24299b2eff57ecad531dd P 95c53350afaf4f799751127bdd8f40fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b1e476d7e6241fbac41768184552018" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 34541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:08:10.336498 6827 heartbeater.cc:503] Master 127.26.191.252:36269 was elected leader, sending a full tablet report...
I20260811 05:08:10.337431 6979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:10.336897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:43813 (local address 127.26.191.195:46493)
0811 05:08:10.337339 (+ 442us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:10.337384 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:43813: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":419}
I20260811 05:08:10.337666 6988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:10.336959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:43813 (local address 127.26.191.193:43619)
0811 05:08:10.337590 (+ 631us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:10.337629 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:43813: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":608}
I20260811 05:08:10.338519 6979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:10.338419 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:43813 (local address 127.26.191.195:59541)
0811 05:08:10.338460 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:10.338488 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:43813: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
I20260811 05:08:10.339015 6990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:10.338894 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:43813 (local address 127.26.191.194:52817)
0811 05:08:10.338938 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:10.338971 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:43813: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
I20260811 05:08:10.339473 6990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:10.339379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:43813 (local address 127.26.191.194:34811)
0811 05:08:10.339417 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:10.339441 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:43813: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
I20260811 05:08:10.339622 6988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:10.339408 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:43813 (local address 127.26.191.193:58483)
0811 05:08:10.339551 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:10.339585 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:43813: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128}
I20260811 05:08:10.341840 6072 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34920:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:08:10.341950 6072 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34920:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:08:10.343350 6072 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 44992f39b96c43dba1e367c8788a8eb7: Sending DeleteTablet for 3 replicas of tablet 028d3458c1b24299b2eff57ecad531dd
I20260811 05:08:10.343708 6709 tablet_service.cc:1514] Processing DeleteTablet for tablet 028d3458c1b24299b2eff57ecad531dd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:08:10 UTC) from {username='oryx', principal='oryx/127.26.191.252@KRBTEST.COM'} at 127.0.0.1:54926
I20260811 05:08:10.343853 6495 tablet_service.cc:1514] Processing DeleteTablet for tablet 028d3458c1b24299b2eff57ecad531dd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:08:10 UTC) from {username='oryx', principal='oryx/127.26.191.252@KRBTEST.COM'} at 127.0.0.1:35594
I20260811 05:08:10.344128 7013 tablet_replica.cc:330] T 028d3458c1b24299b2eff57ecad531dd P 95c53350afaf4f799751127bdd8f40fb: stopping tablet replica
I20260811 05:08:10.344198 7013 raft_consensus.cc:2229] T 028d3458c1b24299b2eff57ecad531dd P 95c53350afaf4f799751127bdd8f40fb [term 1 LEADER]: Raft consensus shutting down.
I20260811 05:08:10.344194 6263 tablet_service.cc:1514] Processing DeleteTablet for tablet 028d3458c1b24299b2eff57ecad531dd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:08:10 UTC) from {username='oryx', principal='oryx/127.26.191.252@KRBTEST.COM'} at 127.0.0.1:43762
I20260811 05:08:10.344287 7013 raft_consensus.cc:2258] T 028d3458c1b24299b2eff57ecad531dd P 95c53350afaf4f799751127bdd8f40fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:08:10.344640 7015 tablet_replica.cc:330] T 028d3458c1b24299b2eff57ecad531dd P db794d15babb45b6a10aeb091d4472fe: stopping tablet replica
I20260811 05:08:10.344660 7013 ts_tablet_manager.cc:1905] T 028d3458c1b24299b2eff57ecad531dd P 95c53350afaf4f799751127bdd8f40fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:08:10.344702 7015 raft_consensus.cc:2229] T 028d3458c1b24299b2eff57ecad531dd P db794d15babb45b6a10aeb091d4472fe [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 05:08:10.344772 7015 raft_consensus.cc:2258] T 028d3458c1b24299b2eff57ecad531dd P db794d15babb45b6a10aeb091d4472fe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:08:10.344833 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 6007
I20260811 05:08:10.350035 7013 ts_tablet_manager.cc:1918] T 028d3458c1b24299b2eff57ecad531dd P 95c53350afaf4f799751127bdd8f40fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 05:08:10.350119 7013 log.cc:1196] T 028d3458c1b24299b2eff57ecad531dd P 95c53350afaf4f799751127bdd8f40fb: Deleting WAL directory at /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/ts-1/wal/wals/028d3458c1b24299b2eff57ecad531dd
I20260811 05:08:10.350478 7013 ts_tablet_manager.cc:1939] T 028d3458c1b24299b2eff57ecad531dd P 95c53350afaf4f799751127bdd8f40fb: Deleting consensus metadata
I20260811 05:08:10.352442 6053 catalog_manager.cc:4841] TS 95c53350afaf4f799751127bdd8f40fb (127.26.191.194:39395): tablet 028d3458c1b24299b2eff57ecad531dd (table test-table [id=d28db0865cd54319a59b171f4a377ef8]) successfully deleted
I20260811 05:08:10.361677 7010 tablet_replica.cc:330] T 028d3458c1b24299b2eff57ecad531dd P 4b1e476d7e6241fbac41768184552018: stopping tablet replica
I20260811 05:08:10.361745 6943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:10.361600 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.193:39383 (local address 127.0.0.1:46882)
0811 05:08:10.361659 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:10.361685 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.193:39383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260811 05:08:10.361806 7010 raft_consensus.cc:2229] T 028d3458c1b24299b2eff57ecad531dd P 4b1e476d7e6241fbac41768184552018 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 05:08:10.361891 7010 raft_consensus.cc:2258] T 028d3458c1b24299b2eff57ecad531dd P 4b1e476d7e6241fbac41768184552018 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260811 05:08:10.361914 6053 catalog_manager.cc:4584] TS db794d15babb45b6a10aeb091d4472fe (127.26.191.193:39383): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 028d3458c1b24299b2eff57ecad531dd: Network error: Client connection negotiation failed: client connection to 127.26.191.193:39383: connect: Connection refused (error 111)
I20260811 05:08:10.362103 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 6375
I20260811 05:08:10.362295 7010 ts_tablet_manager.cc:1905] T 028d3458c1b24299b2eff57ecad531dd P 4b1e476d7e6241fbac41768184552018: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:08:10.366067 7010 ts_tablet_manager.cc:1918] T 028d3458c1b24299b2eff57ecad531dd P 4b1e476d7e6241fbac41768184552018: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 05:08:10.366138 7010 log.cc:1196] T 028d3458c1b24299b2eff57ecad531dd P 4b1e476d7e6241fbac41768184552018: Deleting WAL directory at /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424853995437-27391-0/minicluster-data/ts-2/wal/wals/028d3458c1b24299b2eff57ecad531dd
I20260811 05:08:10.366381 7010 ts_tablet_manager.cc:1939] T 028d3458c1b24299b2eff57ecad531dd P 4b1e476d7e6241fbac41768184552018: Deleting consensus metadata
I20260811 05:08:10.366775 6053 catalog_manager.cc:4841] TS 4b1e476d7e6241fbac41768184552018 (127.26.191.195:34541): tablet 028d3458c1b24299b2eff57ecad531dd (table test-table [id=d28db0865cd54319a59b171f4a377ef8]) successfully deleted
I20260811 05:08:10.373004 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 6609
I20260811 05:08:10.388105 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 5543
I20260811 05:08:10.406051 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 5849
2026-08-11T05:08:10Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (5280 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 05:08:10 dist-test-slave-x5fp krb5kdc[7022](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 05:08:10 dist-test-slave-x5fp krb5kdc[7022](info): set up 2 sockets
Aug 11 05:08:10 dist-test-slave-x5fp krb5kdc[7022](info): commencing operation
krb5kdc: starting...
W20260811 05:08:11.705947 27391 mini_kdc.cc:121] Time spent starting KDC: real 1.271s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/krb5kdc/test-user.keytab.
Aug 11 05:08:11 dist-test-slave-x5fp krb5kdc[7022](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424891, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T05:08:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:08:11Z Disabled control of system clock
WARNING: no policy specified for oryx/127.26.191.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.191.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.191.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/krb5kdc/oryx_127.26.191.254.keytab.
Entry for principal oryx/127.26.191.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/krb5kdc/oryx_127.26.191.254.keytab.
I20260811 05:08:11.849831 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.254:45729
--webserver_interface=127.26.191.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/krb5kdc/oryx_127.26.191.254.keytab
--principal=oryx/127.26.191.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:45799
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.191.254:45729
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:08:11.940903 7044 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:08:11.941182 7044 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:08:11.941221 7044 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:08:11.942454 7044 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:08:11.942533 7044 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260811 05:08:11.942554 7044 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:08:11.942577 7044 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:08:11.942605 7044 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:08:11.942636 7044 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:08:11.944224 7044 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:45799
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.191.254:45729
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/krb5kdc/oryx_127.26.191.254.keytab
--principal=oryx/127.26.191.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.254:45729
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.191.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7044
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:08:11.944530 7044 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:08:11.944809 7044 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:08:11.950412 7061 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:08:11.950412 7044 server_base.cc:1034] running on GCE node
W20260811 05:08:11.950443 7056 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:11.950438 7058 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:08:11.951099 7044 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:08:11.951390 7044 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:08:11.952560 7044 hybrid_clock.cc:648] HybridClock initialized: now 1786424891952509 us; error 76 us; skew 500 ppm
Aug 11 05:08:11 dist-test-slave-x5fp krb5kdc[7022](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424891, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.191.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:08:11.955680 7044 init.cc:377] Logged in from keytab as oryx/127.26.191.254@KRBTEST.COM (short username oryx)
I20260811 05:08:11.956403 7044 webserver.cc:460] Webserver started at http://127.26.191.254:39413/ using document root <none> and password file <none>
I20260811 05:08:11.956763 7044 fs_manager.cc:359] Metadata directory not provided
I20260811 05:08:11.956831 7044 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:08:11.956982 7044 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:08:11.958758 7044 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/minicluster-data/master-0/data/instance:
uuid: "a24399409f294f0f8815ab9516c10f81"
format_stamp: "Formatted at 2026-08-11 05:08:11 on dist-test-slave-x5fp"
server_key: "91246ae699d8d4390cb172f3118e394e"
server_key_iv: "b513eacc3ceeeee175190dde610cbcdc"
server_key_version: "encryptionkey@0"
I20260811 05:08:11.959291 7044 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/minicluster-data/master-0/wal/instance:
uuid: "a24399409f294f0f8815ab9516c10f81"
format_stamp: "Formatted at 2026-08-11 05:08:11 on dist-test-slave-x5fp"
server_key: "91246ae699d8d4390cb172f3118e394e"
server_key_iv: "b513eacc3ceeeee175190dde610cbcdc"
server_key_version: "encryptionkey@0"
I20260811 05:08:11.961210 7044 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.003s
I20260811 05:08:11.962332 7072 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:11.962546 7044 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:08:11.962684 7044 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/minicluster-data/master-0/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/minicluster-data/master-0/wal
uuid: "a24399409f294f0f8815ab9516c10f81"
format_stamp: "Formatted at 2026-08-11 05:08:11 on dist-test-slave-x5fp"
server_key: "91246ae699d8d4390cb172f3118e394e"
server_key_iv: "b513eacc3ceeeee175190dde610cbcdc"
server_key_version: "encryptionkey@0"
I20260811 05:08:11.962786 7044 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:08:11.995503 7044 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:08:11.998459 7044 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:08:11.998634 7044 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:08:12.006466 7044 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.254:45729
I20260811 05:08:12.006615 7180 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.254:45729 every 8 connection(s)
I20260811 05:08:12.006990 7044 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
I20260811 05:08:12.007568 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 7044
I20260811 05:08:12.007717 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/minicluster-data/master-0/wal/instance
I20260811 05:08:12.007856 7184 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:08:12.008019 27391 external_mini_cluster.cc:1428] Setting key bb0e40ccb3f2fe13269b58d93ba41364
I20260811 05:08:12.011221 7184 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a24399409f294f0f8815ab9516c10f81: Bootstrap starting.
I20260811 05:08:12.012005 7184 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a24399409f294f0f8815ab9516c10f81: Neither blocks nor log segments found. Creating new log.
I20260811 05:08:12.012363 7184 log.cc:824] T 00000000000000000000000000000000 P a24399409f294f0f8815ab9516c10f81: Log is configured to *not* fsync() on all Append() calls
I20260811 05:08:12.013319 7184 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a24399409f294f0f8815ab9516c10f81: No bootstrap required, opened a new log
Aug 11 05:08:12 dist-test-slave-x5fp krb5kdc[7022](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424891, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM
I20260811 05:08:12.015323 7184 raft_consensus.cc:348] T 00000000000000000000000000000000 P a24399409f294f0f8815ab9516c10f81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a24399409f294f0f8815ab9516c10f81" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 45729 } }
I20260811 05:08:12.015502 7184 raft_consensus.cc:374] T 00000000000000000000000000000000 P a24399409f294f0f8815ab9516c10f81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:08:12.015551 7184 raft_consensus.cc:729] T 00000000000000000000000000000000 P a24399409f294f0f8815ab9516c10f81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a24399409f294f0f8815ab9516c10f81, State: Initialized, Role: FOLLOWER
I20260811 05:08:12.015717 7184 consensus_queue.cc:260] T 00000000000000000000000000000000 P a24399409f294f0f8815ab9516c10f81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a24399409f294f0f8815ab9516c10f81" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 45729 } }
I20260811 05:08:12.015825 7184 raft_consensus.cc:388] T 00000000000000000000000000000000 P a24399409f294f0f8815ab9516c10f81 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:08:12.015867 7184 raft_consensus.cc:482] T 00000000000000000000000000000000 P a24399409f294f0f8815ab9516c10f81 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:08:12.015925 7184 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a24399409f294f0f8815ab9516c10f81 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:08:12.016813 7184 raft_consensus.cc:504] T 00000000000000000000000000000000 P a24399409f294f0f8815ab9516c10f81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a24399409f294f0f8815ab9516c10f81" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 45729 } }
I20260811 05:08:12.016927 7184 leader_election.cc:302] T 00000000000000000000000000000000 P a24399409f294f0f8815ab9516c10f81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a24399409f294f0f8815ab9516c10f81; no voters:
I20260811 05:08:12.017149 7184 leader_election.cc:288] T 00000000000000000000000000000000 P a24399409f294f0f8815ab9516c10f81 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 05:08:12.017179 7189 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a24399409f294f0f8815ab9516c10f81 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:08:12.017356 7189 raft_consensus.cc:686] T 00000000000000000000000000000000 P a24399409f294f0f8815ab9516c10f81 [term 1 LEADER]: Becoming Leader. State: Replica: a24399409f294f0f8815ab9516c10f81, State: Running, Role: LEADER
I20260811 05:08:12.017473 7189 consensus_queue.cc:237] T 00000000000000000000000000000000 P a24399409f294f0f8815ab9516c10f81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a24399409f294f0f8815ab9516c10f81" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 45729 } }
I20260811 05:08:12.017482 7184 sys_catalog.cc:564] T 00000000000000000000000000000000 P a24399409f294f0f8815ab9516c10f81 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:08:12.017939 7190 sys_catalog.cc:455] T 00000000000000000000000000000000 P a24399409f294f0f8815ab9516c10f81 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a24399409f294f0f8815ab9516c10f81" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a24399409f294f0f8815ab9516c10f81" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 45729 } } }
I20260811 05:08:12.018064 7190 sys_catalog.cc:458] T 00000000000000000000000000000000 P a24399409f294f0f8815ab9516c10f81 [sys.catalog]: This master's current role is: LEADER
I20260811 05:08:12.017928 7191 sys_catalog.cc:455] T 00000000000000000000000000000000 P a24399409f294f0f8815ab9516c10f81 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a24399409f294f0f8815ab9516c10f81. Latest consensus state: current_term: 1 leader_uuid: "a24399409f294f0f8815ab9516c10f81" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a24399409f294f0f8815ab9516c10f81" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 45729 } } }
I20260811 05:08:12.018268 7191 sys_catalog.cc:458] T 00000000000000000000000000000000 P a24399409f294f0f8815ab9516c10f81 [sys.catalog]: This master's current role is: LEADER
I20260811 05:08:12.018399 7201 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:08:12.018949 7201 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:08:12.020164 7187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:12.008644 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48078 (local address 127.26.191.254:45729)
0811 05:08:12.008858 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:12.008869 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:12.008908 (+ 39us) server_negotiation.cc:407] Connection header received
0811 05:08:12.009415 (+ 507us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:12.009422 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:12.009471 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:12.009633 (+ 162us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:12.010344 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:12.011275 (+ 931us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:12.012082 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:12.012624 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:12.012771 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:12.015717 (+ 2946us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:12.015721 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:12.015722 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:08:12.015735 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:12.018249 (+ 2514us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:12.018768 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:12.018772 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:12.018772 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:12.018911 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:12.019178 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:12.019179 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:12.019180 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:12.019470 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:12.019601 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:12.019810 (+ 209us) server_negotiation.cc:299] Negotiation successful
0811 05:08:12.019959 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":112,"threads_started":1}
I20260811 05:08:12.020970 7201 catalog_manager.cc:1347] Generated new cluster ID: d2eb9b10f6b446a68e817b3548019ef3
I20260811 05:08:12.021026 7201 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:08:12.029139 7201 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:08:12.029898 7201 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:08:12.036389 7201 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a24399409f294f0f8815ab9516c10f81: Generated new TSK 0
I20260811 05:08:12.036602 7201 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.26.191.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.191.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.191.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/krb5kdc/oryx_127.26.191.193.keytab.
Entry for principal oryx/127.26.191.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/krb5kdc/oryx_127.26.191.193.keytab.
I20260811 05:08:12.073196 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.191.193:0
--local_ip_for_outbound_sockets=127.26.191.193
--webserver_interface=127.26.191.193
--webserver_port=0
--tserver_master_addrs=127.26.191.254:45729
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/krb5kdc/oryx_127.26.191.193.keytab
--principal=oryx/127.26.191.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:45799
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:08:12.178059 7221 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:08:12.178329 7221 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:08:12.178366 7221 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:08:12.179842 7221 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:08:12.179910 7221 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:08:12.179934 7221 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 05:08:12.179953 7221 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.191.193
I20260811 05:08:12.181725 7221 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:45799
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/krb5kdc/oryx_127.26.191.193.keytab
--principal=oryx/127.26.191.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.191.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.191.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.26.191.254:45729
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7221
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.191.193
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:08:12.181962 7221 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:08:12.182155 7221 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:08:12.187789 7226 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:12.187794 7230 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:08:12.187839 7221 server_base.cc:1034] running on GCE node
W20260811 05:08:12.187816 7227 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:08:12.188316 7221 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:08:12.188542 7221 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:08:12.189723 7221 hybrid_clock.cc:648] HybridClock initialized: now 1786424892189706 us; error 27 us; skew 500 ppm
Aug 11 05:08:12 dist-test-slave-x5fp krb5kdc[7022](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424892, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.191.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:08:12.193260 7221 init.cc:377] Logged in from keytab as oryx/127.26.191.193@KRBTEST.COM (short username oryx)
I20260811 05:08:12.193768 7221 webserver.cc:460] Webserver started at http://127.26.191.193:44671/ using document root <none> and password file <none>
I20260811 05:08:12.194033 7221 fs_manager.cc:359] Metadata directory not provided
I20260811 05:08:12.194108 7221 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:08:12.194265 7221 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:08:12.195413 7221 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/minicluster-data/ts-0/data/instance:
uuid: "ad5f93824f4041b0a3c2b68164a07c41"
format_stamp: "Formatted at 2026-08-11 05:08:12 on dist-test-slave-x5fp"
server_key: "761ec68486c7c674a526024827444b95"
server_key_iv: "4982939481dd927884d26f673f2c3a95"
server_key_version: "encryptionkey@0"
I20260811 05:08:12.195807 7221 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/minicluster-data/ts-0/wal/instance:
uuid: "ad5f93824f4041b0a3c2b68164a07c41"
format_stamp: "Formatted at 2026-08-11 05:08:12 on dist-test-slave-x5fp"
server_key: "761ec68486c7c674a526024827444b95"
server_key_iv: "4982939481dd927884d26f673f2c3a95"
server_key_version: "encryptionkey@0"
I20260811 05:08:12.197418 7221 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 05:08:12.198438 7238 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:12.198917 7221 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 05:08:12.199071 7221 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/minicluster-data/ts-0/wal
uuid: "ad5f93824f4041b0a3c2b68164a07c41"
format_stamp: "Formatted at 2026-08-11 05:08:12 on dist-test-slave-x5fp"
server_key: "761ec68486c7c674a526024827444b95"
server_key_iv: "4982939481dd927884d26f673f2c3a95"
server_key_version: "encryptionkey@0"
I20260811 05:08:12.199167 7221 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:08:12.211759 7221 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:08:12.214533 7221 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:08:12.214773 7221 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:08:12.215535 7221 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:08:12.215600 7221 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:12.215641 7221 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:08:12.215667 7221 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 05:08:12 dist-test-slave-x5fp krb5kdc[7022](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424892, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.191.193@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM
I20260811 05:08:12.224588 7221 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.193:34179
I20260811 05:08:12.224792 7443 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.193:34179 every 8 connection(s)
I20260811 05:08:12.225121 7221 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/minicluster-data/ts-0/data/info.pb
I20260811 05:08:12.228005 7187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:12.215965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.193:53947 (local address 127.26.191.254:45729)
0811 05:08:12.216020 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:12.216023 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:12.216432 (+ 409us) server_negotiation.cc:407] Connection header received
0811 05:08:12.217147 (+ 715us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:12.217149 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:12.217164 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:12.217274 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:12.218014 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:12.219030 (+ 1016us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:12.220972 (+ 1942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:12.221306 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:12.221376 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:12.224175 (+ 2799us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:12.224176 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:12.224177 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:08:12.224193 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:12.226112 (+ 1919us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:12.226625 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:12.226626 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:12.226626 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:12.226693 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:12.227080 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:12.227081 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:12.227081 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:12.227283 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:12.227353 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:12.227815 (+ 462us) server_negotiation.cc:299] Negotiation successful
0811 05:08:12.227918 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 05:08:12.228315 7265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:12.215931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:45729 (local address 127.26.191.193:53947)
0811 05:08:12.216273 (+ 342us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:12.216342 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:12.217026 (+ 684us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:12.217363 (+ 337us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:12.217367 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:12.217714 (+ 347us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:12.217929 (+ 215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:12.217934 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:12.219166 (+ 1232us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:12.219168 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:12.220858 (+ 1690us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:12.220863 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:12.221425 (+ 562us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:12.221426 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:12.221621 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:12.222470 (+ 849us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:12.222480 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:12.224054 (+ 1574us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:08:12.226222 (+ 2168us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:12.226230 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:12.226233 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:12.226499 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:12.226848 (+ 349us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:12.226849 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:12.226849 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:12.226977 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:12.227381 (+ 404us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:08:12.227389 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:08:12.227569 (+ 180us) client_negotiation.cc:769] Sending connection context
0811 05:08:12.227698 (+ 129us) client_negotiation.cc:240] Negotiation successful
0811 05:08:12.227984 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":298,"thread_start_us":90,"threads_started":1}
I20260811 05:08:12.229146 7444 heartbeater.cc:347] Connected to a master server at 127.26.191.254:45729
I20260811 05:08:12.229238 7444 heartbeater.cc:464] Registering TS with master...
I20260811 05:08:12.229440 7444 heartbeater.cc:511] Master 127.26.191.254:45729 requested a full tablet report, sending...
I20260811 05:08:12.230083 7100 ts_manager.cc:194] Registered new tserver with Master: ad5f93824f4041b0a3c2b68164a07c41 (127.26.191.193:34179)
I20260811 05:08:12.231042 7100 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.26.191.193@KRBTEST.COM'} at 127.26.191.193:53947
I20260811 05:08:12.231458 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 7221
I20260811 05:08:12.231585 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/minicluster-data/ts-0/wal/instance
I20260811 05:08:12.231819 27391 external_mini_cluster.cc:1428] Setting key 5c34ecaeacedec5e8f0c28620d6e61bf
I20260811 05:08:12.237659 7452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:12.230387 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:45729 (local address 127.26.191.193:47797)
0811 05:08:12.230539 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:12.230551 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:12.230614 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:12.230741 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:12.230742 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:12.230960 (+ 218us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:12.231036 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:12.231039 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:12.232191 (+ 1152us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:12.232192 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:12.232924 (+ 732us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:12.232927 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:12.233339 (+ 412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:12.233340 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:12.233425 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:12.234000 (+ 575us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:12.234006 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:12.234367 (+ 361us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:08:12.236299 (+ 1932us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:12.236300 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:12.236301 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:12.236527 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:12.236835 (+ 308us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:12.236836 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:12.236836 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:12.236917 (+ 81us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:12.237229 (+ 312us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:08:12.237230 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:08:12.237290 (+ 60us) client_negotiation.cc:769] Sending connection context
0811 05:08:12.237411 (+ 121us) client_negotiation.cc:240] Negotiation successful
0811 05:08:12.237544 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":90,"threads_started":1}
I20260811 05:08:12.237655 7187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:12.230488 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.193:47797 (local address 127.26.191.254:45729)
0811 05:08:12.230541 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:12.230543 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:12.230597 (+ 54us) server_negotiation.cc:407] Connection header received
0811 05:08:12.230671 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:12.230671 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:12.230679 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:12.230735 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:12.231175 (+ 440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:12.232067 (+ 892us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:12.233028 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:12.233256 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:12.233341 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:12.234492 (+ 1151us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:12.234493 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:12.234494 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:08:12.234501 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:12.236095 (+ 1594us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:12.236626 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:12.236627 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:12.236628 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:12.236700 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:12.236999 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:12.237001 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:12.237001 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:12.237139 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:12.237226 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:12.237450 (+ 224us) server_negotiation.cc:299] Negotiation successful
0811 05:08:12.237543 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
WARNING: no policy specified for oryx/127.26.191.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.191.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.191.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/krb5kdc/oryx_127.26.191.194.keytab.
Entry for principal oryx/127.26.191.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/krb5kdc/oryx_127.26.191.194.keytab.
I20260811 05:08:12.264981 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.191.194:0
--local_ip_for_outbound_sockets=127.26.191.194
--webserver_interface=127.26.191.194
--webserver_port=0
--tserver_master_addrs=127.26.191.254:45729
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/krb5kdc/oryx_127.26.191.194.keytab
--principal=oryx/127.26.191.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:45799
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:08:12.355283 7455 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:08:12.355537 7455 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:08:12.355567 7455 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:08:12.357067 7455 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:08:12.357125 7455 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:08:12.357148 7455 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 05:08:12.357167 7455 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.191.194
I20260811 05:08:12.358883 7455 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:45799
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/krb5kdc/oryx_127.26.191.194.keytab
--principal=oryx/127.26.191.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.191.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.191.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.26.191.254:45729
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7455
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.191.194
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:08:12.359103 7455 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:08:12.359299 7455 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:08:12.365106 7462 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:12.365113 7466 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:12.365113 7464 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:08:12.366008 7455 server_base.cc:1034] running on GCE node
I20260811 05:08:12.366281 7455 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:08:12.366580 7455 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:08:12.367859 7455 hybrid_clock.cc:648] HybridClock initialized: now 1786424892367835 us; error 35 us; skew 500 ppm
Aug 11 05:08:12 dist-test-slave-x5fp krb5kdc[7022](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424892, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.191.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:08:12.370719 7455 init.cc:377] Logged in from keytab as oryx/127.26.191.194@KRBTEST.COM (short username oryx)
I20260811 05:08:12.371253 7455 webserver.cc:460] Webserver started at http://127.26.191.194:39299/ using document root <none> and password file <none>
I20260811 05:08:12.371529 7455 fs_manager.cc:359] Metadata directory not provided
I20260811 05:08:12.371604 7455 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:08:12.371762 7455 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:08:12.372968 7455 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/minicluster-data/ts-1/data/instance:
uuid: "504756e7feb345afabee92c0deefa926"
format_stamp: "Formatted at 2026-08-11 05:08:12 on dist-test-slave-x5fp"
server_key: "e5045f8de5c2130c0d66b2e72f2b7758"
server_key_iv: "2c15b9a8a7c38b246d5cc30c392601d9"
server_key_version: "encryptionkey@0"
I20260811 05:08:12.373363 7455 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/minicluster-data/ts-1/wal/instance:
uuid: "504756e7feb345afabee92c0deefa926"
format_stamp: "Formatted at 2026-08-11 05:08:12 on dist-test-slave-x5fp"
server_key: "e5045f8de5c2130c0d66b2e72f2b7758"
server_key_iv: "2c15b9a8a7c38b246d5cc30c392601d9"
server_key_version: "encryptionkey@0"
I20260811 05:08:12.374780 7455 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:08:12.375723 7483 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:12.375977 7455 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:08:12.376103 7455 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/minicluster-data/ts-1/wal
uuid: "504756e7feb345afabee92c0deefa926"
format_stamp: "Formatted at 2026-08-11 05:08:12 on dist-test-slave-x5fp"
server_key: "e5045f8de5c2130c0d66b2e72f2b7758"
server_key_iv: "2c15b9a8a7c38b246d5cc30c392601d9"
server_key_version: "encryptionkey@0"
I20260811 05:08:12.376187 7455 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:08:12.388059 7455 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:08:12.391162 7455 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:08:12.391407 7455 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:08:12.392125 7455 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:08:12.392184 7455 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:12.392221 7455 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:08:12.392246 7455 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 05:08:12 dist-test-slave-x5fp krb5kdc[7022](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424892, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.191.194@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM
I20260811 05:08:12.400120 7455 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.194:41189
I20260811 05:08:12.400218 7663 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.194:41189 every 8 connection(s)
I20260811 05:08:12.400555 7455 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/minicluster-data/ts-1/data/info.pb
I20260811 05:08:12.401737 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 7455
I20260811 05:08:12.402091 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/minicluster-data/ts-1/wal/instance
I20260811 05:08:12.402400 27391 external_mini_cluster.cc:1428] Setting key cf2e75a7cfe83926274c98cd05015d72
I20260811 05:08:12.403573 7187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:12.392611 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.194:49135 (local address 127.26.191.254:45729)
0811 05:08:12.392690 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:12.392693 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:12.392964 (+ 271us) server_negotiation.cc:407] Connection header received
0811 05:08:12.393597 (+ 633us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:12.393599 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:12.393613 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:12.393652 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:12.394464 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:12.395019 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:12.396119 (+ 1100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:12.396343 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:12.396428 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:12.399367 (+ 2939us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:12.399369 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:12.399370 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:08:12.399381 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:12.401267 (+ 1886us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:12.402098 (+ 831us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:12.402100 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:12.402101 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:12.402287 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:12.402673 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:12.402675 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:12.402675 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:12.402855 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:12.402935 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:12.403314 (+ 379us) server_negotiation.cc:299] Negotiation successful
0811 05:08:12.403432 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 05:08:12.403770 7497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:12.392598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:45729 (local address 127.26.191.194:49135)
0811 05:08:12.392826 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:12.392874 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:12.393478 (+ 604us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:12.393741 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:12.393744 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:12.394109 (+ 365us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:12.394350 (+ 241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:12.394356 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:12.395133 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:12.395134 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:12.396014 (+ 880us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:12.396017 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:12.396438 (+ 421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:12.396440 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:12.396582 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:12.397249 (+ 667us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:12.397258 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:12.399252 (+ 1994us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:08:12.401378 (+ 2126us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:12.401386 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:12.401389 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:12.401743 (+ 354us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:12.402390 (+ 647us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:12.402391 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:12.402391 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:12.402588 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:12.402971 (+ 383us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:08:12.402978 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:08:12.403148 (+ 170us) client_negotiation.cc:769] Sending connection context
0811 05:08:12.403270 (+ 122us) client_negotiation.cc:240] Negotiation successful
0811 05:08:12.403454 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":126,"threads_started":1}
I20260811 05:08:12.404260 7664 heartbeater.cc:347] Connected to a master server at 127.26.191.254:45729
I20260811 05:08:12.404366 7664 heartbeater.cc:464] Registering TS with master...
I20260811 05:08:12.404585 7664 heartbeater.cc:511] Master 127.26.191.254:45729 requested a full tablet report, sending...
I20260811 05:08:12.404991 7097 ts_manager.cc:194] Registered new tserver with Master: 504756e7feb345afabee92c0deefa926 (127.26.191.194:41189)
I20260811 05:08:12.405578 7097 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.26.191.194@KRBTEST.COM'} at 127.26.191.194:49135
I20260811 05:08:12.412549 7187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:12.405513 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.194:36063 (local address 127.26.191.254:45729)
0811 05:08:12.405553 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:12.405554 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:12.405690 (+ 136us) server_negotiation.cc:407] Connection header received
0811 05:08:12.405799 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:12.405800 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:12.405810 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:12.405859 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:12.406257 (+ 398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:12.406948 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:12.408050 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:12.408241 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:12.408301 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:12.409547 (+ 1246us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:12.409548 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:12.409548 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:08:12.409555 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:12.411051 (+ 1496us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:12.411511 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:12.411512 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:12.411513 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:12.411579 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:12.411866 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:12.411867 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:12.411868 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:12.412040 (+ 172us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:12.412109 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:12.412309 (+ 200us) server_negotiation.cc:299] Negotiation successful
0811 05:08:12.412477 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 05:08:12.412941 7675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:12.405445 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:45729 (local address 127.26.191.194:36063)
0811 05:08:12.405623 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:12.405636 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:12.405718 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:12.405868 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:12.405868 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:12.406098 (+ 230us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:12.406159 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:12.406161 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:12.407072 (+ 911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:12.407073 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:12.407953 (+ 880us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:12.407956 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:12.408333 (+ 377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:12.408334 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:12.408423 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:12.409002 (+ 579us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:12.409009 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:12.409448 (+ 439us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:08:12.411143 (+ 1695us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:12.411145 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:12.411145 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:12.411391 (+ 246us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:12.411662 (+ 271us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:12.411663 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:12.411664 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:12.411738 (+ 74us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:12.412128 (+ 390us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:08:12.412129 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:08:12.412193 (+ 64us) client_negotiation.cc:769] Sending connection context
0811 05:08:12.412285 (+ 92us) client_negotiation.cc:240] Negotiation successful
0811 05:08:12.412636 (+ 351us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":82,"threads_started":1}
WARNING: no policy specified for oryx/127.26.191.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.191.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.191.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/krb5kdc/oryx_127.26.191.195.keytab.
Entry for principal oryx/127.26.191.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/krb5kdc/oryx_127.26.191.195.keytab.
I20260811 05:08:12.438326 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.191.195:0
--local_ip_for_outbound_sockets=127.26.191.195
--webserver_interface=127.26.191.195
--webserver_port=0
--tserver_master_addrs=127.26.191.254:45729
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/krb5kdc/oryx_127.26.191.195.keytab
--principal=oryx/127.26.191.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:45799
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:08:12.526564 7678 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:08:12.526824 7678 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:08:12.526854 7678 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:08:12.528000 7678 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:08:12.528035 7678 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:08:12.528055 7678 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 05:08:12.528072 7678 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.191.195
I20260811 05:08:12.529947 7678 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:45799
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/krb5kdc/oryx_127.26.191.195.keytab
--principal=oryx/127.26.191.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.191.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.191.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.26.191.254:45729
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7678
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.191.195
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:08:12.530157 7678 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:08:12.530387 7678 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:08:12.535761 7694 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:12.535743 7689 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:08:12.535943 7678 server_base.cc:1034] running on GCE node
W20260811 05:08:12.535740 7690 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:08:12.536357 7678 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:08:12.536679 7678 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:08:12.537942 7678 hybrid_clock.cc:648] HybridClock initialized: now 1786424892537923 us; error 26 us; skew 500 ppm
Aug 11 05:08:12 dist-test-slave-x5fp krb5kdc[7022](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424892, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.191.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:08:12.540848 7678 init.cc:377] Logged in from keytab as oryx/127.26.191.195@KRBTEST.COM (short username oryx)
I20260811 05:08:12.541354 7678 webserver.cc:460] Webserver started at http://127.26.191.195:39537/ using document root <none> and password file <none>
I20260811 05:08:12.541621 7678 fs_manager.cc:359] Metadata directory not provided
I20260811 05:08:12.541697 7678 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:08:12.541859 7678 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:08:12.542958 7678 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/minicluster-data/ts-2/data/instance:
uuid: "2517723745f74d85afa8cf2236144acc"
format_stamp: "Formatted at 2026-08-11 05:08:12 on dist-test-slave-x5fp"
server_key: "227726bbcc112f66bb26c95bd5f27400"
server_key_iv: "f151f9eea44ce9f38ad2692d5f009c37"
server_key_version: "encryptionkey@0"
I20260811 05:08:12.543339 7678 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/minicluster-data/ts-2/wal/instance:
uuid: "2517723745f74d85afa8cf2236144acc"
format_stamp: "Formatted at 2026-08-11 05:08:12 on dist-test-slave-x5fp"
server_key: "227726bbcc112f66bb26c95bd5f27400"
server_key_iv: "f151f9eea44ce9f38ad2692d5f009c37"
server_key_version: "encryptionkey@0"
I20260811 05:08:12.544818 7678 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.001s
I20260811 05:08:12.545655 7708 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:12.545858 7678 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:08:12.545971 7678 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/minicluster-data/ts-2/wal
uuid: "2517723745f74d85afa8cf2236144acc"
format_stamp: "Formatted at 2026-08-11 05:08:12 on dist-test-slave-x5fp"
server_key: "227726bbcc112f66bb26c95bd5f27400"
server_key_iv: "f151f9eea44ce9f38ad2692d5f009c37"
server_key_version: "encryptionkey@0"
I20260811 05:08:12.546059 7678 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:08:12.554471 7678 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:08:12.556479 7678 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:08:12.556645 7678 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:08:12.557233 7678 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:08:12.557299 7678 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:12.557351 7678 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:08:12.557380 7678 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:12.565150 7678 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.195:38865
I20260811 05:08:12.565199 7890 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.195:38865 every 8 connection(s)
Aug 11 05:08:12 dist-test-slave-x5fp krb5kdc[7022](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424892, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.191.195@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM
I20260811 05:08:12.565604 7678 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/minicluster-data/ts-2/data/info.pb
I20260811 05:08:12.568993 7187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:12.558091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.195:55135 (local address 127.26.191.254:45729)
0811 05:08:12.558162 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:12.558164 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:12.558353 (+ 189us) server_negotiation.cc:407] Connection header received
0811 05:08:12.559037 (+ 684us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:12.559039 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:12.559054 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:12.559117 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:12.560017 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:12.560937 (+ 920us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:12.562648 (+ 1711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:12.562886 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:12.562952 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:12.566123 (+ 3171us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:12.566125 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:12.566125 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:08:12.566135 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:12.567584 (+ 1449us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:12.567991 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:12.567992 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:12.567992 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:12.568052 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:12.568316 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:12.568318 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:12.568318 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:12.568451 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:12.568516 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:12.568815 (+ 299us) server_negotiation.cc:299] Negotiation successful
0811 05:08:12.568925 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 05:08:12.569168 7721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:12.558020 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:45729 (local address 127.26.191.195:55135)
0811 05:08:12.558226 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:12.558264 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:12.558931 (+ 667us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:12.559197 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:12.559202 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:12.559623 (+ 421us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:12.559927 (+ 304us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:12.559932 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:12.561029 (+ 1097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:12.561031 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:12.562538 (+ 1507us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:12.562542 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:12.562992 (+ 450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:12.562993 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:12.563175 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:12.564009 (+ 834us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:12.564022 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:12.566012 (+ 1990us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:08:12.567665 (+ 1653us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:12.567672 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:12.567674 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:12.567903 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:12.568121 (+ 218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:12.568122 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:12.568122 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:12.568228 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:12.568518 (+ 290us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:08:12.568523 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:08:12.568644 (+ 121us) client_negotiation.cc:769] Sending connection context
0811 05:08:12.568785 (+ 141us) client_negotiation.cc:240] Negotiation successful
0811 05:08:12.568933 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":76,"threads_started":1}
I20260811 05:08:12.569715 7891 heartbeater.cc:347] Connected to a master server at 127.26.191.254:45729
I20260811 05:08:12.569852 7891 heartbeater.cc:464] Registering TS with master...
I20260811 05:08:12.570065 7891 heartbeater.cc:511] Master 127.26.191.254:45729 requested a full tablet report, sending...
I20260811 05:08:12.570506 7100 ts_manager.cc:194] Registered new tserver with Master: 2517723745f74d85afa8cf2236144acc (127.26.191.195:38865)
I20260811 05:08:12.571040 7100 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.26.191.195@KRBTEST.COM'} at 127.26.191.195:55135
I20260811 05:08:12.575126 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 7678
I20260811 05:08:12.575235 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/minicluster-data/ts-2/wal/instance
I20260811 05:08:12.575460 27391 external_mini_cluster.cc:1428] Setting key 085d0c91e63b054c910ce371ffd85e2a
I20260811 05:08:12.576373 27391 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 05:08:12.577126 7187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:12.570924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.195:37379 (local address 127.26.191.254:45729)
0811 05:08:12.571184 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:12.571186 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:12.571194 (+ 8us) server_negotiation.cc:407] Connection header received
0811 05:08:12.571214 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:12.571215 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:12.571225 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:12.571277 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:12.571678 (+ 401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:12.572204 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:12.573070 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:12.573256 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:12.573327 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:12.574276 (+ 949us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:12.574278 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:12.574278 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:08:12.574285 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:12.575915 (+ 1630us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:12.576299 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:12.576300 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:12.576300 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:12.576369 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:12.576592 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:12.576592 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:12.576593 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:12.576705 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:12.576820 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:12.576990 (+ 170us) server_negotiation.cc:299] Negotiation successful
0811 05:08:12.577058 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":241}
I20260811 05:08:12.577229 7903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:12.570850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:45729 (local address 127.26.191.195:37379)
0811 05:08:12.570993 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:12.571003 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:12.571057 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:12.571296 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:12.571297 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:12.571498 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:12.571586 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:12.571588 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:12.572299 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:12.572300 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:12.572991 (+ 691us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:12.572993 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:12.573334 (+ 341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:12.573335 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:12.573384 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:12.573850 (+ 466us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:12.573854 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:12.574158 (+ 304us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:08:12.575993 (+ 1835us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:12.575994 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:12.575994 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:12.576218 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:12.576449 (+ 231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:12.576450 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:12.576450 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:12.576523 (+ 73us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:12.576814 (+ 291us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:08:12.576815 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:08:12.576864 (+ 49us) client_negotiation.cc:769] Sending connection context
0811 05:08:12.576954 (+ 90us) client_negotiation.cc:240] Negotiation successful
0811 05:08:12.577079 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":86,"threads_started":1}
Aug 11 05:08:12 dist-test-slave-x5fp krb5kdc[7022](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424892, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 05:08:12 dist-test-slave-x5fp krb5kdc[7022](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:08:12 dist-test-slave-x5fp krb5kdc[7022](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
W20260811 05:08:12.602658 7187 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:08:12.596527 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48088 (local address 127.26.191.254:45729)
0811 05:08:12.596610 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:12.596612 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:12.596621 (+ 9us) server_negotiation.cc:407] Connection header received
0811 05:08:12.596650 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:12.596651 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:12.596661 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:12.596823 (+ 162us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:12.597468 (+ 645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:12.598029 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:12.598860 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:12.599073 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:12.599137 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:12.602537 (+ 3400us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48088: BlockingRecv error: recv got EOF from 127.0.0.1:48088 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Aug 11 05:08:12 dist-test-slave-x5fp krb5kdc[7022](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424892, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM
I20260811 05:08:12.611418 7187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:12.603614 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48096 (local address 127.26.191.254:45729)
0811 05:08:12.603717 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:12.603720 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:12.603773 (+ 53us) server_negotiation.cc:407] Connection header received
0811 05:08:12.603910 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:12.603912 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:12.603925 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:12.603998 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:12.604749 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:12.605299 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:12.606135 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:12.606383 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:12.606482 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:12.608873 (+ 2391us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:12.608876 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:12.608877 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:08:12.608888 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:12.610220 (+ 1332us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:12.610607 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:12.610608 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:12.610608 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:12.610671 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:12.610884 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:12.610884 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:12.610885 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:12.611006 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:12.611121 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:12.611223 (+ 102us) server_negotiation.cc:299] Negotiation successful
0811 05:08:12.611308 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260811 05:08:12.613616 7100 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48096:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 05:08:12.615298 7100 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 05:08:12.622424 7931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:12.618324 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35070 (local address 127.26.191.194:41189)
0811 05:08:12.618635 (+ 311us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:12.618640 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:12.618921 (+ 281us) server_negotiation.cc:407] Connection header received
0811 05:08:12.618982 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:12.618985 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:12.619005 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:12.619105 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:08:12.619462 (+ 357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:12.620167 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:12.621448 (+ 1281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:12.621979 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:12.622094 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:12.622162 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:12.622281 (+ 119us) server_negotiation.cc:299] Negotiation successful
0811 05:08:12.622321 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":275,"thread_start_us":97,"threads_started":1}
I20260811 05:08:12.622414 7930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:12.618120 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.194:41189 (local address 127.0.0.1:35070)
0811 05:08:12.618757 (+ 637us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:12.618770 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:12.618835 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:12.619345 (+ 510us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:12.619345 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:12.619347 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:08:12.619387 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:12.619388 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:12.620265 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:12.620266 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:12.621349 (+ 1083us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:12.621352 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:12.622072 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:12.622073 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:12.622161 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:12.622175 (+ 14us) client_negotiation.cc:769] Sending connection context
0811 05:08:12.622264 (+ 89us) client_negotiation.cc:240] Negotiation successful
0811 05:08:12.622321 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":612,"mutex_wait_us":439,"thread_start_us":121,"threads_started":1}
I20260811 05:08:12.623216 7570 tablet_service.cc:1467] Processing CreateTablet for tablet d9421558f5b144fbb044fd04fd8e535c (DEFAULT_TABLE table=test-table [id=42fae67caa2e4b06a88cc3d51356642b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:08:12.623677 7570 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d9421558f5b144fbb044fd04fd8e535c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:08:12.623721 7934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:12.618120 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.195:38865 (local address 127.0.0.1:46706)
0811 05:08:12.618731 (+ 611us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:12.618740 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:12.618888 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:12.619186 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:12.619187 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:12.619188 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:08:12.619231 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:12.619232 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:12.620782 (+ 1550us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:12.620783 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:12.622179 (+ 1396us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:12.622183 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:12.623368 (+ 1185us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:12.623369 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:12.623442 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:12.623446 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 05:08:12.623552 (+ 106us) client_negotiation.cc:240] Negotiation successful
0811 05:08:12.623611 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":585,"mutex_wait_us":55,"thread_start_us":140,"threads_started":1}
I20260811 05:08:12.623880 7929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:12.618120 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.193:34179 (local address 127.0.0.1:34744)
0811 05:08:12.618311 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:12.618403 (+ 92us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:12.618472 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:12.619118 (+ 646us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:12.619121 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:12.619124 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:08:12.619218 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:12.619220 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:12.620794 (+ 1574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:12.620795 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:12.622180 (+ 1385us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:12.622183 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:12.623624 (+ 1441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:12.623625 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:12.623691 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:12.623695 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 05:08:12.623733 (+ 38us) client_negotiation.cc:240] Negotiation successful
0811 05:08:12.623779 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":165,"mutex_wait_us":42,"thread_start_us":66,"threads_started":1}
I20260811 05:08:12.623980 7933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:12.618438 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46706 (local address 127.26.191.195:38865)
0811 05:08:12.618636 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:12.618640 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:12.618815 (+ 175us) server_negotiation.cc:407] Connection header received
0811 05:08:12.618994 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:12.618997 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:12.619015 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:12.619089 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:08:12.619347 (+ 258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:12.620634 (+ 1287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:12.622311 (+ 1677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:12.623146 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:12.623230 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:12.623287 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:12.623575 (+ 288us) server_negotiation.cc:299] Negotiation successful
0811 05:08:12.623632 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":159,"thread_start_us":110,"threads_started":1}
I20260811 05:08:12.624349 7932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:12.618360 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34744 (local address 127.26.191.193:34179)
0811 05:08:12.618922 (+ 562us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:12.618927 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:12.618941 (+ 14us) server_negotiation.cc:407] Connection header received
0811 05:08:12.618985 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:12.618987 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:12.619005 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:12.619105 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:08:12.619342 (+ 237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:12.620605 (+ 1263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:12.622302 (+ 1697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:12.623511 (+ 1209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:12.624038 (+ 527us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:12.624126 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:12.624173 (+ 47us) server_negotiation.cc:299] Negotiation successful
0811 05:08:12.624222 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":514,"thread_start_us":111,"threads_started":1}
I20260811 05:08:12.624794 7776 tablet_service.cc:1467] Processing CreateTablet for tablet d9421558f5b144fbb044fd04fd8e535c (DEFAULT_TABLE table=test-table [id=42fae67caa2e4b06a88cc3d51356642b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:08:12.625211 7776 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d9421558f5b144fbb044fd04fd8e535c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:08:12.625476 7331 tablet_service.cc:1467] Processing CreateTablet for tablet d9421558f5b144fbb044fd04fd8e535c (DEFAULT_TABLE table=test-table [id=42fae67caa2e4b06a88cc3d51356642b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:08:12.625859 7331 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d9421558f5b144fbb044fd04fd8e535c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:08:12.628129 7935 tablet_bootstrap.cc:492] T d9421558f5b144fbb044fd04fd8e535c P 504756e7feb345afabee92c0deefa926: Bootstrap starting.
I20260811 05:08:12.629232 7935 tablet_bootstrap.cc:654] T d9421558f5b144fbb044fd04fd8e535c P 504756e7feb345afabee92c0deefa926: Neither blocks nor log segments found. Creating new log.
I20260811 05:08:12.629383 7937 tablet_bootstrap.cc:492] T d9421558f5b144fbb044fd04fd8e535c P 2517723745f74d85afa8cf2236144acc: Bootstrap starting.
I20260811 05:08:12.629869 7938 tablet_bootstrap.cc:492] T d9421558f5b144fbb044fd04fd8e535c P ad5f93824f4041b0a3c2b68164a07c41: Bootstrap starting.
I20260811 05:08:12.630057 7935 log.cc:824] T d9421558f5b144fbb044fd04fd8e535c P 504756e7feb345afabee92c0deefa926: Log is configured to *not* fsync() on all Append() calls
I20260811 05:08:12.630129 7937 tablet_bootstrap.cc:654] T d9421558f5b144fbb044fd04fd8e535c P 2517723745f74d85afa8cf2236144acc: Neither blocks nor log segments found. Creating new log.
I20260811 05:08:12.630478 7937 log.cc:824] T d9421558f5b144fbb044fd04fd8e535c P 2517723745f74d85afa8cf2236144acc: Log is configured to *not* fsync() on all Append() calls
I20260811 05:08:12.630549 7938 tablet_bootstrap.cc:654] T d9421558f5b144fbb044fd04fd8e535c P ad5f93824f4041b0a3c2b68164a07c41: Neither blocks nor log segments found. Creating new log.
I20260811 05:08:12.630865 7938 log.cc:824] T d9421558f5b144fbb044fd04fd8e535c P ad5f93824f4041b0a3c2b68164a07c41: Log is configured to *not* fsync() on all Append() calls
I20260811 05:08:12.631111 7935 tablet_bootstrap.cc:492] T d9421558f5b144fbb044fd04fd8e535c P 504756e7feb345afabee92c0deefa926: No bootstrap required, opened a new log
I20260811 05:08:12.631203 7935 ts_tablet_manager.cc:1397] T d9421558f5b144fbb044fd04fd8e535c P 504756e7feb345afabee92c0deefa926: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 05:08:12.631278 7937 tablet_bootstrap.cc:492] T d9421558f5b144fbb044fd04fd8e535c P 2517723745f74d85afa8cf2236144acc: No bootstrap required, opened a new log
I20260811 05:08:12.631361 7937 ts_tablet_manager.cc:1397] T d9421558f5b144fbb044fd04fd8e535c P 2517723745f74d85afa8cf2236144acc: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 05:08:12.631590 7938 tablet_bootstrap.cc:492] T d9421558f5b144fbb044fd04fd8e535c P ad5f93824f4041b0a3c2b68164a07c41: No bootstrap required, opened a new log
I20260811 05:08:12.631678 7938 ts_tablet_manager.cc:1397] T d9421558f5b144fbb044fd04fd8e535c P ad5f93824f4041b0a3c2b68164a07c41: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 05:08:12.633358 7938 raft_consensus.cc:348] T d9421558f5b144fbb044fd04fd8e535c P ad5f93824f4041b0a3c2b68164a07c41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504756e7feb345afabee92c0deefa926" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 41189 } } peers { permanent_uuid: "2517723745f74d85afa8cf2236144acc" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 38865 } } peers { permanent_uuid: "ad5f93824f4041b0a3c2b68164a07c41" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 34179 } }
I20260811 05:08:12.633518 7938 raft_consensus.cc:374] T d9421558f5b144fbb044fd04fd8e535c P ad5f93824f4041b0a3c2b68164a07c41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:08:12.633564 7938 raft_consensus.cc:729] T d9421558f5b144fbb044fd04fd8e535c P ad5f93824f4041b0a3c2b68164a07c41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad5f93824f4041b0a3c2b68164a07c41, State: Initialized, Role: FOLLOWER
I20260811 05:08:12.633704 7938 consensus_queue.cc:260] T d9421558f5b144fbb044fd04fd8e535c P ad5f93824f4041b0a3c2b68164a07c41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504756e7feb345afabee92c0deefa926" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 41189 } } peers { permanent_uuid: "2517723745f74d85afa8cf2236144acc" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 38865 } } peers { permanent_uuid: "ad5f93824f4041b0a3c2b68164a07c41" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 34179 } }
I20260811 05:08:12.633698 7937 raft_consensus.cc:348] T d9421558f5b144fbb044fd04fd8e535c P 2517723745f74d85afa8cf2236144acc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504756e7feb345afabee92c0deefa926" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 41189 } } peers { permanent_uuid: "2517723745f74d85afa8cf2236144acc" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 38865 } } peers { permanent_uuid: "ad5f93824f4041b0a3c2b68164a07c41" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 34179 } }
I20260811 05:08:12.633701 7935 raft_consensus.cc:348] T d9421558f5b144fbb044fd04fd8e535c P 504756e7feb345afabee92c0deefa926 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504756e7feb345afabee92c0deefa926" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 41189 } } peers { permanent_uuid: "2517723745f74d85afa8cf2236144acc" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 38865 } } peers { permanent_uuid: "ad5f93824f4041b0a3c2b68164a07c41" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 34179 } }
I20260811 05:08:12.633888 7937 raft_consensus.cc:374] T d9421558f5b144fbb044fd04fd8e535c P 2517723745f74d85afa8cf2236144acc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:08:12.633888 7935 raft_consensus.cc:374] T d9421558f5b144fbb044fd04fd8e535c P 504756e7feb345afabee92c0deefa926 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:08:12.633944 7935 raft_consensus.cc:729] T d9421558f5b144fbb044fd04fd8e535c P 504756e7feb345afabee92c0deefa926 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 504756e7feb345afabee92c0deefa926, State: Initialized, Role: FOLLOWER
I20260811 05:08:12.633944 7937 raft_consensus.cc:729] T d9421558f5b144fbb044fd04fd8e535c P 2517723745f74d85afa8cf2236144acc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2517723745f74d85afa8cf2236144acc, State: Initialized, Role: FOLLOWER
I20260811 05:08:12.633989 7938 ts_tablet_manager.cc:1428] T d9421558f5b144fbb044fd04fd8e535c P ad5f93824f4041b0a3c2b68164a07c41: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 05:08:12.634120 7444 heartbeater.cc:503] Master 127.26.191.254:45729 was elected leader, sending a full tablet report...
I20260811 05:08:12.634106 7935 consensus_queue.cc:260] T d9421558f5b144fbb044fd04fd8e535c P 504756e7feb345afabee92c0deefa926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504756e7feb345afabee92c0deefa926" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 41189 } } peers { permanent_uuid: "2517723745f74d85afa8cf2236144acc" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 38865 } } peers { permanent_uuid: "ad5f93824f4041b0a3c2b68164a07c41" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 34179 } }
I20260811 05:08:12.634106 7937 consensus_queue.cc:260] T d9421558f5b144fbb044fd04fd8e535c P 2517723745f74d85afa8cf2236144acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504756e7feb345afabee92c0deefa926" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 41189 } } peers { permanent_uuid: "2517723745f74d85afa8cf2236144acc" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 38865 } } peers { permanent_uuid: "ad5f93824f4041b0a3c2b68164a07c41" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 34179 } }
I20260811 05:08:12.634423 7937 ts_tablet_manager.cc:1428] T d9421558f5b144fbb044fd04fd8e535c P 2517723745f74d85afa8cf2236144acc: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 05:08:12.634467 7664 heartbeater.cc:503] Master 127.26.191.254:45729 was elected leader, sending a full tablet report...
I20260811 05:08:12.634814 7891 heartbeater.cc:503] Master 127.26.191.254:45729 was elected leader, sending a full tablet report...
I20260811 05:08:12.635082 7935 ts_tablet_manager.cc:1428] T d9421558f5b144fbb044fd04fd8e535c P 504756e7feb345afabee92c0deefa926: Time spent starting tablet: real 0.004s user 0.000s sys 0.003s
W20260811 05:08:12.651212 7665 tablet.cc:2369] T d9421558f5b144fbb044fd04fd8e535c P 504756e7feb345afabee92c0deefa926: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 05:08:12.726828 7446 tablet.cc:2369] T d9421558f5b144fbb044fd04fd8e535c P ad5f93824f4041b0a3c2b68164a07c41: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 05:08:12.726843 7950 raft_consensus.cc:482] T d9421558f5b144fbb044fd04fd8e535c P 504756e7feb345afabee92c0deefa926 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 05:08:12.727036 7950 raft_consensus.cc:504] T d9421558f5b144fbb044fd04fd8e535c P 504756e7feb345afabee92c0deefa926 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504756e7feb345afabee92c0deefa926" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 41189 } } peers { permanent_uuid: "2517723745f74d85afa8cf2236144acc" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 38865 } } peers { permanent_uuid: "ad5f93824f4041b0a3c2b68164a07c41" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 34179 } }
I20260811 05:08:12.727480 7950 leader_election.cc:288] T d9421558f5b144fbb044fd04fd8e535c P 504756e7feb345afabee92c0deefa926 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2517723745f74d85afa8cf2236144acc (127.26.191.195:38865), ad5f93824f4041b0a3c2b68164a07c41 (127.26.191.193:34179)
I20260811 05:08:12.731951 7933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:12.727766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.194:50041 (local address 127.26.191.195:38865)
0811 05:08:12.727806 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:12.727808 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:12.728124 (+ 316us) server_negotiation.cc:407] Connection header received
0811 05:08:12.728160 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:12.728161 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:12.728168 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:12.728207 (+ 39us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:08:12.728383 (+ 176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:12.729109 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:12.730744 (+ 1635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:12.731385 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:12.731478 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:12.731488 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:12.731757 (+ 269us) server_negotiation.cc:299] Negotiation successful
0811 05:08:12.731861 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260811 05:08:12.731967 7951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:12.727699 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.195:38865 (local address 127.26.191.194:50041)
0811 05:08:12.727995 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:12.728003 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:12.728088 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:12.728235 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:12.728236 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:12.728238 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:08:12.728314 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:12.728315 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:12.729214 (+ 899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:12.729216 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:12.730610 (+ 1394us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:12.730611 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:12.731511 (+ 900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:12.731513 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:12.731637 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:12.731643 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 05:08:12.731725 (+ 82us) client_negotiation.cc:240] Negotiation successful
0811 05:08:12.731776 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":280,"mutex_wait_us":170,"thread_start_us":129,"threads_started":1}
I20260811 05:08:12.732461 7932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:12.727905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.194:50753 (local address 127.26.191.193:34179)
0811 05:08:12.727961 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:12.727963 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:12.727970 (+ 7us) server_negotiation.cc:407] Connection header received
0811 05:08:12.727994 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:12.727995 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:12.728003 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:12.728044 (+ 41us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:08:12.728279 (+ 235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:12.729128 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:12.730743 (+ 1615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:12.731390 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:12.731478 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:12.731488 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:12.732350 (+ 862us) server_negotiation.cc:299] Negotiation successful
0811 05:08:12.732391 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260811 05:08:12.732439 7497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:12.727696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.193:34179 (local address 127.26.191.194:50753)
0811 05:08:12.727751 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:12.727765 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:12.727828 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:12.728084 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:12.728085 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:12.728087 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:08:12.728174 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:12.728176 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:12.729214 (+ 1038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:12.729216 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:12.730605 (+ 1389us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:12.730610 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:12.731511 (+ 901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:12.731513 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:12.732276 (+ 763us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:12.732281 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 05:08:12.732339 (+ 58us) client_negotiation.cc:240] Negotiation successful
0811 05:08:12.732375 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31,"mutex_wait_us":59}
I20260811 05:08:12.732936 7366 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9421558f5b144fbb044fd04fd8e535c" candidate_uuid: "504756e7feb345afabee92c0deefa926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad5f93824f4041b0a3c2b68164a07c41" is_pre_election: true
I20260811 05:08:12.732945 7808 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9421558f5b144fbb044fd04fd8e535c" candidate_uuid: "504756e7feb345afabee92c0deefa926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2517723745f74d85afa8cf2236144acc" is_pre_election: true
I20260811 05:08:12.733115 7366 raft_consensus.cc:2454] T d9421558f5b144fbb044fd04fd8e535c P ad5f93824f4041b0a3c2b68164a07c41 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 504756e7feb345afabee92c0deefa926 in term 0.
I20260811 05:08:12.733126 7808 raft_consensus.cc:2454] T d9421558f5b144fbb044fd04fd8e535c P 2517723745f74d85afa8cf2236144acc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 504756e7feb345afabee92c0deefa926 in term 0.
I20260811 05:08:12.733417 7490 leader_election.cc:302] T d9421558f5b144fbb044fd04fd8e535c P 504756e7feb345afabee92c0deefa926 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2517723745f74d85afa8cf2236144acc, 504756e7feb345afabee92c0deefa926; no voters:
I20260811 05:08:12.733572 7950 raft_consensus.cc:2781] T d9421558f5b144fbb044fd04fd8e535c P 504756e7feb345afabee92c0deefa926 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 05:08:12.733650 7950 raft_consensus.cc:482] T d9421558f5b144fbb044fd04fd8e535c P 504756e7feb345afabee92c0deefa926 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 05:08:12.733686 7950 raft_consensus.cc:3037] T d9421558f5b144fbb044fd04fd8e535c P 504756e7feb345afabee92c0deefa926 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:08:12.734493 7950 raft_consensus.cc:504] T d9421558f5b144fbb044fd04fd8e535c P 504756e7feb345afabee92c0deefa926 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504756e7feb345afabee92c0deefa926" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 41189 } } peers { permanent_uuid: "2517723745f74d85afa8cf2236144acc" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 38865 } } peers { permanent_uuid: "ad5f93824f4041b0a3c2b68164a07c41" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 34179 } }
I20260811 05:08:12.734658 7950 leader_election.cc:288] T d9421558f5b144fbb044fd04fd8e535c P 504756e7feb345afabee92c0deefa926 [CANDIDATE]: Term 1 election: Requested vote from peers 2517723745f74d85afa8cf2236144acc (127.26.191.195:38865), ad5f93824f4041b0a3c2b68164a07c41 (127.26.191.193:34179)
I20260811 05:08:12.734843 7808 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9421558f5b144fbb044fd04fd8e535c" candidate_uuid: "504756e7feb345afabee92c0deefa926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2517723745f74d85afa8cf2236144acc"
I20260811 05:08:12.734853 7366 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9421558f5b144fbb044fd04fd8e535c" candidate_uuid: "504756e7feb345afabee92c0deefa926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad5f93824f4041b0a3c2b68164a07c41"
I20260811 05:08:12.734923 7808 raft_consensus.cc:3037] T d9421558f5b144fbb044fd04fd8e535c P 2517723745f74d85afa8cf2236144acc [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:08:12.734958 7366 raft_consensus.cc:3037] T d9421558f5b144fbb044fd04fd8e535c P ad5f93824f4041b0a3c2b68164a07c41 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:08:12.735648 7808 raft_consensus.cc:2454] T d9421558f5b144fbb044fd04fd8e535c P 2517723745f74d85afa8cf2236144acc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 504756e7feb345afabee92c0deefa926 in term 1.
I20260811 05:08:12.735769 7366 raft_consensus.cc:2454] T d9421558f5b144fbb044fd04fd8e535c P ad5f93824f4041b0a3c2b68164a07c41 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 504756e7feb345afabee92c0deefa926 in term 1.
I20260811 05:08:12.735826 7490 leader_election.cc:302] T d9421558f5b144fbb044fd04fd8e535c P 504756e7feb345afabee92c0deefa926 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2517723745f74d85afa8cf2236144acc, 504756e7feb345afabee92c0deefa926; no voters:
I20260811 05:08:12.735926 7950 raft_consensus.cc:2781] T d9421558f5b144fbb044fd04fd8e535c P 504756e7feb345afabee92c0deefa926 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:08:12.736089 7950 raft_consensus.cc:686] T d9421558f5b144fbb044fd04fd8e535c P 504756e7feb345afabee92c0deefa926 [term 1 LEADER]: Becoming Leader. State: Replica: 504756e7feb345afabee92c0deefa926, State: Running, Role: LEADER
I20260811 05:08:12.736204 7950 consensus_queue.cc:237] T d9421558f5b144fbb044fd04fd8e535c P 504756e7feb345afabee92c0deefa926 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504756e7feb345afabee92c0deefa926" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 41189 } } peers { permanent_uuid: "2517723745f74d85afa8cf2236144acc" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 38865 } } peers { permanent_uuid: "ad5f93824f4041b0a3c2b68164a07c41" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 34179 } }
I20260811 05:08:12.737126 7097 catalog_manager.cc:5495] T d9421558f5b144fbb044fd04fd8e535c P 504756e7feb345afabee92c0deefa926 reported cstate change: term changed from 0 to 1, leader changed from <none> to 504756e7feb345afabee92c0deefa926 (127.26.191.194). New cstate: current_term: 1 leader_uuid: "504756e7feb345afabee92c0deefa926" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504756e7feb345afabee92c0deefa926" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 41189 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2517723745f74d85afa8cf2236144acc" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 38865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad5f93824f4041b0a3c2b68164a07c41" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 34179 } health_report { overall_health: UNKNOWN } } }
I20260811 05:08:12.770853 7931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:12.768194 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35084 (local address 127.26.191.194:41189)
0811 05:08:12.768271 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:12.768275 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:12.768287 (+ 12us) server_negotiation.cc:407] Connection header received
0811 05:08:12.768326 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:12.768327 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:12.768346 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:12.768429 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:08:12.768604 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:12.769165 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:12.770027 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:12.770223 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:12.770302 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:12.770492 (+ 190us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:08:12.770596 (+ 104us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:08:12.770715 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:12.770733 (+ 18us) server_negotiation.cc:299] Negotiation successful
0811 05:08:12.770753 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 05:08:12.772845 7366 raft_consensus.cc:1261] T d9421558f5b144fbb044fd04fd8e535c P ad5f93824f4041b0a3c2b68164a07c41 [term 1 FOLLOWER]: Refusing update from remote peer 504756e7feb345afabee92c0deefa926: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:08:12.772845 7808 raft_consensus.cc:1261] T d9421558f5b144fbb044fd04fd8e535c P 2517723745f74d85afa8cf2236144acc [term 1 FOLLOWER]: Refusing update from remote peer 504756e7feb345afabee92c0deefa926: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:08:12.773191 7950 consensus_queue.cc:1035] T d9421558f5b144fbb044fd04fd8e535c P 504756e7feb345afabee92c0deefa926 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad5f93824f4041b0a3c2b68164a07c41" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 34179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:08:12.773361 7952 consensus_queue.cc:1035] T d9421558f5b144fbb044fd04fd8e535c P 504756e7feb345afabee92c0deefa926 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2517723745f74d85afa8cf2236144acc" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 38865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:08:12.775931 7957 mvcc.cc:205] Tried to move back new op lower bound from 7317196360794345472 to 7317196360648110080. Current Snapshot: MvccSnapshot[applied={T|T < 7317196360794345472}]
I20260811 05:08:12.776032 7959 mvcc.cc:205] Tried to move back new op lower bound from 7317196360794345472 to 7317196360648110080. Current Snapshot: MvccSnapshot[applied={T|T < 7317196360794345472}]
I20260811 05:08:12.776150 7958 mvcc.cc:205] Tried to move back new op lower bound from 7317196360794345472 to 7317196360648110080. Current Snapshot: MvccSnapshot[applied={T|T < 7317196360794345472}]
I20260811 05:08:12.778165 7097 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48096:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:08:12.778281 7097 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48096:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:08:12.779111 7097 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a24399409f294f0f8815ab9516c10f81: Sending DeleteTablet for 3 replicas of tablet d9421558f5b144fbb044fd04fd8e535c
I20260811 05:08:12.779459 7331 tablet_service.cc:1514] Processing DeleteTablet for tablet d9421558f5b144fbb044fd04fd8e535c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:08:12 UTC) from {username='oryx', principal='oryx/127.26.191.254@KRBTEST.COM'} at 127.0.0.1:34744
I20260811 05:08:12.779475 7776 tablet_service.cc:1514] Processing DeleteTablet for tablet d9421558f5b144fbb044fd04fd8e535c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:08:12 UTC) from {username='oryx', principal='oryx/127.26.191.254@KRBTEST.COM'} at 127.0.0.1:46706
I20260811 05:08:12.779660 7570 tablet_service.cc:1514] Processing DeleteTablet for tablet d9421558f5b144fbb044fd04fd8e535c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:08:12 UTC) from {username='oryx', principal='oryx/127.26.191.254@KRBTEST.COM'} at 127.0.0.1:35070
I20260811 05:08:12.779745 7970 tablet_replica.cc:330] T d9421558f5b144fbb044fd04fd8e535c P 2517723745f74d85afa8cf2236144acc: stopping tablet replica
I20260811 05:08:12.779865 7970 raft_consensus.cc:2229] T d9421558f5b144fbb044fd04fd8e535c P 2517723745f74d85afa8cf2236144acc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 05:08:12.779934 7097 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48096:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 05:08:12.780094 7097 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 05:08:12.780267 7970 raft_consensus.cc:2258] T d9421558f5b144fbb044fd04fd8e535c P 2517723745f74d85afa8cf2236144acc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:08:12.780526 7971 tablet_replica.cc:330] T d9421558f5b144fbb044fd04fd8e535c P 504756e7feb345afabee92c0deefa926: stopping tablet replica
I20260811 05:08:12.780635 7971 raft_consensus.cc:2229] T d9421558f5b144fbb044fd04fd8e535c P 504756e7feb345afabee92c0deefa926 [term 1 LEADER]: Raft consensus shutting down.
I20260811 05:08:12.780761 7971 raft_consensus.cc:2258] T d9421558f5b144fbb044fd04fd8e535c P 504756e7feb345afabee92c0deefa926 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:08:12.780942 7970 ts_tablet_manager.cc:1905] T d9421558f5b144fbb044fd04fd8e535c P 2517723745f74d85afa8cf2236144acc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:08:12.781270 7971 ts_tablet_manager.cc:1905] T d9421558f5b144fbb044fd04fd8e535c P 504756e7feb345afabee92c0deefa926: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:08:12.781430 7331 tablet_service.cc:1467] Processing CreateTablet for tablet 04a41e1263014dc3b86e5da908e1fd8a (DEFAULT_TABLE table=test-table [id=6e77725dcb9d4e8e82be8841cc215701]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:08:12.781556 7331 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 04a41e1263014dc3b86e5da908e1fd8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:08:12.782974 7938 tablet_bootstrap.cc:492] T 04a41e1263014dc3b86e5da908e1fd8a P ad5f93824f4041b0a3c2b68164a07c41: Bootstrap starting.
I20260811 05:08:12.782972 7970 ts_tablet_manager.cc:1918] T d9421558f5b144fbb044fd04fd8e535c P 2517723745f74d85afa8cf2236144acc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 05:08:12.782974 7971 ts_tablet_manager.cc:1918] T d9421558f5b144fbb044fd04fd8e535c P 504756e7feb345afabee92c0deefa926: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 05:08:12.783052 7971 log.cc:1196] T d9421558f5b144fbb044fd04fd8e535c P 504756e7feb345afabee92c0deefa926: Deleting WAL directory at /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/minicluster-data/ts-1/wal/wals/d9421558f5b144fbb044fd04fd8e535c
I20260811 05:08:12.783195 7970 log.cc:1196] T d9421558f5b144fbb044fd04fd8e535c P 2517723745f74d85afa8cf2236144acc: Deleting WAL directory at /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/minicluster-data/ts-2/wal/wals/d9421558f5b144fbb044fd04fd8e535c
I20260811 05:08:12.783350 7971 ts_tablet_manager.cc:1939] T d9421558f5b144fbb044fd04fd8e535c P 504756e7feb345afabee92c0deefa926: Deleting consensus metadata
I20260811 05:08:12.783390 7938 tablet_bootstrap.cc:654] T 04a41e1263014dc3b86e5da908e1fd8a P ad5f93824f4041b0a3c2b68164a07c41: Neither blocks nor log segments found. Creating new log.
I20260811 05:08:12.783617 7970 ts_tablet_manager.cc:1939] T d9421558f5b144fbb044fd04fd8e535c P 2517723745f74d85afa8cf2236144acc: Deleting consensus metadata
I20260811 05:08:12.783965 7074 catalog_manager.cc:4841] TS 504756e7feb345afabee92c0deefa926 (127.26.191.194:41189): tablet d9421558f5b144fbb044fd04fd8e535c (table test-table [id=42fae67caa2e4b06a88cc3d51356642b]) successfully deleted
I20260811 05:08:12.784062 7570 tablet_service.cc:1467] Processing CreateTablet for tablet 04a41e1263014dc3b86e5da908e1fd8a (DEFAULT_TABLE table=test-table [id=6e77725dcb9d4e8e82be8841cc215701]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:08:12.784199 7570 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 04a41e1263014dc3b86e5da908e1fd8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:08:12.784181 7080 catalog_manager.cc:4841] TS 2517723745f74d85afa8cf2236144acc (127.26.191.195:38865): tablet d9421558f5b144fbb044fd04fd8e535c (table test-table [id=42fae67caa2e4b06a88cc3d51356642b]) successfully deleted
I20260811 05:08:12.784549 7776 tablet_service.cc:1467] Processing CreateTablet for tablet 04a41e1263014dc3b86e5da908e1fd8a (DEFAULT_TABLE table=test-table [id=6e77725dcb9d4e8e82be8841cc215701]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:08:12.784667 7776 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 04a41e1263014dc3b86e5da908e1fd8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:08:12.785986 7937 tablet_bootstrap.cc:492] T 04a41e1263014dc3b86e5da908e1fd8a P 2517723745f74d85afa8cf2236144acc: Bootstrap starting.
I20260811 05:08:12.786019 7935 tablet_bootstrap.cc:492] T 04a41e1263014dc3b86e5da908e1fd8a P 504756e7feb345afabee92c0deefa926: Bootstrap starting.
I20260811 05:08:12.786442 7937 tablet_bootstrap.cc:654] T 04a41e1263014dc3b86e5da908e1fd8a P 2517723745f74d85afa8cf2236144acc: Neither blocks nor log segments found. Creating new log.
I20260811 05:08:12.786453 7935 tablet_bootstrap.cc:654] T 04a41e1263014dc3b86e5da908e1fd8a P 504756e7feb345afabee92c0deefa926: Neither blocks nor log segments found. Creating new log.
I20260811 05:08:12.787149 7937 tablet_bootstrap.cc:492] T 04a41e1263014dc3b86e5da908e1fd8a P 2517723745f74d85afa8cf2236144acc: No bootstrap required, opened a new log
I20260811 05:08:12.787209 7937 ts_tablet_manager.cc:1397] T 04a41e1263014dc3b86e5da908e1fd8a P 2517723745f74d85afa8cf2236144acc: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 05:08:12.787334 7935 tablet_bootstrap.cc:492] T 04a41e1263014dc3b86e5da908e1fd8a P 504756e7feb345afabee92c0deefa926: No bootstrap required, opened a new log
I20260811 05:08:12.787395 7935 ts_tablet_manager.cc:1397] T 04a41e1263014dc3b86e5da908e1fd8a P 504756e7feb345afabee92c0deefa926: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260811 05:08:12.787375 7937 raft_consensus.cc:348] T 04a41e1263014dc3b86e5da908e1fd8a P 2517723745f74d85afa8cf2236144acc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad5f93824f4041b0a3c2b68164a07c41" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 34179 } } peers { permanent_uuid: "504756e7feb345afabee92c0deefa926" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 41189 } } peers { permanent_uuid: "2517723745f74d85afa8cf2236144acc" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 38865 } }
I20260811 05:08:12.787458 7937 raft_consensus.cc:374] T 04a41e1263014dc3b86e5da908e1fd8a P 2517723745f74d85afa8cf2236144acc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:08:12.787492 7937 raft_consensus.cc:729] T 04a41e1263014dc3b86e5da908e1fd8a P 2517723745f74d85afa8cf2236144acc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2517723745f74d85afa8cf2236144acc, State: Initialized, Role: FOLLOWER
I20260811 05:08:12.787537 7937 consensus_queue.cc:260] T 04a41e1263014dc3b86e5da908e1fd8a P 2517723745f74d85afa8cf2236144acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad5f93824f4041b0a3c2b68164a07c41" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 34179 } } peers { permanent_uuid: "504756e7feb345afabee92c0deefa926" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 41189 } } peers { permanent_uuid: "2517723745f74d85afa8cf2236144acc" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 38865 } }
I20260811 05:08:12.787549 7935 raft_consensus.cc:348] T 04a41e1263014dc3b86e5da908e1fd8a P 504756e7feb345afabee92c0deefa926 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad5f93824f4041b0a3c2b68164a07c41" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 34179 } } peers { permanent_uuid: "504756e7feb345afabee92c0deefa926" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 41189 } } peers { permanent_uuid: "2517723745f74d85afa8cf2236144acc" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 38865 } }
I20260811 05:08:12.787621 7935 raft_consensus.cc:374] T 04a41e1263014dc3b86e5da908e1fd8a P 504756e7feb345afabee92c0deefa926 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:08:12.787642 7935 raft_consensus.cc:729] T 04a41e1263014dc3b86e5da908e1fd8a P 504756e7feb345afabee92c0deefa926 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 504756e7feb345afabee92c0deefa926, State: Initialized, Role: FOLLOWER
I20260811 05:08:12.787642 7937 ts_tablet_manager.cc:1428] T 04a41e1263014dc3b86e5da908e1fd8a P 2517723745f74d85afa8cf2236144acc: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 05:08:12.787689 7935 consensus_queue.cc:260] T 04a41e1263014dc3b86e5da908e1fd8a P 504756e7feb345afabee92c0deefa926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad5f93824f4041b0a3c2b68164a07c41" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 34179 } } peers { permanent_uuid: "504756e7feb345afabee92c0deefa926" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 41189 } } peers { permanent_uuid: "2517723745f74d85afa8cf2236144acc" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 38865 } }
I20260811 05:08:12.787786 7935 ts_tablet_manager.cc:1428] T 04a41e1263014dc3b86e5da908e1fd8a P 504756e7feb345afabee92c0deefa926: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260811 05:08:12.788280 7938 tablet_bootstrap.cc:492] T 04a41e1263014dc3b86e5da908e1fd8a P ad5f93824f4041b0a3c2b68164a07c41: No bootstrap required, opened a new log
I20260811 05:08:12.788341 7938 ts_tablet_manager.cc:1397] T 04a41e1263014dc3b86e5da908e1fd8a P ad5f93824f4041b0a3c2b68164a07c41: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20260811 05:08:12.788528 7938 raft_consensus.cc:348] T 04a41e1263014dc3b86e5da908e1fd8a P ad5f93824f4041b0a3c2b68164a07c41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad5f93824f4041b0a3c2b68164a07c41" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 34179 } } peers { permanent_uuid: "504756e7feb345afabee92c0deefa926" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 41189 } } peers { permanent_uuid: "2517723745f74d85afa8cf2236144acc" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 38865 } }
I20260811 05:08:12.788604 7938 raft_consensus.cc:374] T 04a41e1263014dc3b86e5da908e1fd8a P ad5f93824f4041b0a3c2b68164a07c41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:08:12.788618 7938 raft_consensus.cc:729] T 04a41e1263014dc3b86e5da908e1fd8a P ad5f93824f4041b0a3c2b68164a07c41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad5f93824f4041b0a3c2b68164a07c41, State: Initialized, Role: FOLLOWER
I20260811 05:08:12.788678 7938 consensus_queue.cc:260] T 04a41e1263014dc3b86e5da908e1fd8a P ad5f93824f4041b0a3c2b68164a07c41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad5f93824f4041b0a3c2b68164a07c41" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 34179 } } peers { permanent_uuid: "504756e7feb345afabee92c0deefa926" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 41189 } } peers { permanent_uuid: "2517723745f74d85afa8cf2236144acc" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 38865 } }
I20260811 05:08:12.788911 7938 ts_tablet_manager.cc:1428] T 04a41e1263014dc3b86e5da908e1fd8a P ad5f93824f4041b0a3c2b68164a07c41: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260811 05:08:12.789178 7968 tablet_replica.cc:330] T d9421558f5b144fbb044fd04fd8e535c P ad5f93824f4041b0a3c2b68164a07c41: stopping tablet replica
I20260811 05:08:12.789309 7968 raft_consensus.cc:2229] T d9421558f5b144fbb044fd04fd8e535c P ad5f93824f4041b0a3c2b68164a07c41 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 05:08:12.789439 7968 raft_consensus.cc:2258] T d9421558f5b144fbb044fd04fd8e535c P ad5f93824f4041b0a3c2b68164a07c41 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:08:12.789881 7968 ts_tablet_manager.cc:1905] T d9421558f5b144fbb044fd04fd8e535c P ad5f93824f4041b0a3c2b68164a07c41: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:08:12.791541 7968 ts_tablet_manager.cc:1918] T d9421558f5b144fbb044fd04fd8e535c P ad5f93824f4041b0a3c2b68164a07c41: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 05:08:12.791605 7968 log.cc:1196] T d9421558f5b144fbb044fd04fd8e535c P ad5f93824f4041b0a3c2b68164a07c41: Deleting WAL directory at /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/minicluster-data/ts-0/wal/wals/d9421558f5b144fbb044fd04fd8e535c
I20260811 05:08:12.791848 7968 ts_tablet_manager.cc:1939] T d9421558f5b144fbb044fd04fd8e535c P ad5f93824f4041b0a3c2b68164a07c41: Deleting consensus metadata
I20260811 05:08:12.792240 7079 catalog_manager.cc:4841] TS ad5f93824f4041b0a3c2b68164a07c41 (127.26.191.193:34179): tablet d9421558f5b144fbb044fd04fd8e535c (table test-table [id=42fae67caa2e4b06a88cc3d51356642b]) successfully deleted
W20260811 05:08:12.816452 7895 tablet.cc:2369] T 04a41e1263014dc3b86e5da908e1fd8a P 2517723745f74d85afa8cf2236144acc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 05:08:12.848141 7962 raft_consensus.cc:482] T 04a41e1263014dc3b86e5da908e1fd8a P 504756e7feb345afabee92c0deefa926 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 05:08:12.848254 7962 raft_consensus.cc:504] T 04a41e1263014dc3b86e5da908e1fd8a P 504756e7feb345afabee92c0deefa926 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad5f93824f4041b0a3c2b68164a07c41" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 34179 } } peers { permanent_uuid: "504756e7feb345afabee92c0deefa926" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 41189 } } peers { permanent_uuid: "2517723745f74d85afa8cf2236144acc" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 38865 } }
I20260811 05:08:12.848486 7962 leader_election.cc:288] T 04a41e1263014dc3b86e5da908e1fd8a P 504756e7feb345afabee92c0deefa926 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad5f93824f4041b0a3c2b68164a07c41 (127.26.191.193:34179), 2517723745f74d85afa8cf2236144acc (127.26.191.195:38865)
I20260811 05:08:12.848682 7366 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04a41e1263014dc3b86e5da908e1fd8a" candidate_uuid: "504756e7feb345afabee92c0deefa926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad5f93824f4041b0a3c2b68164a07c41" is_pre_election: true
I20260811 05:08:12.848763 7808 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04a41e1263014dc3b86e5da908e1fd8a" candidate_uuid: "504756e7feb345afabee92c0deefa926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2517723745f74d85afa8cf2236144acc" is_pre_election: true
I20260811 05:08:12.848853 7366 raft_consensus.cc:2454] T 04a41e1263014dc3b86e5da908e1fd8a P ad5f93824f4041b0a3c2b68164a07c41 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 504756e7feb345afabee92c0deefa926 in term 0.
I20260811 05:08:12.848886 7808 raft_consensus.cc:2454] T 04a41e1263014dc3b86e5da908e1fd8a P 2517723745f74d85afa8cf2236144acc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 504756e7feb345afabee92c0deefa926 in term 0.
I20260811 05:08:12.849038 7489 leader_election.cc:302] T 04a41e1263014dc3b86e5da908e1fd8a P 504756e7feb345afabee92c0deefa926 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 504756e7feb345afabee92c0deefa926, ad5f93824f4041b0a3c2b68164a07c41; no voters:
I20260811 05:08:12.849172 7962 raft_consensus.cc:2781] T 04a41e1263014dc3b86e5da908e1fd8a P 504756e7feb345afabee92c0deefa926 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 05:08:12.849233 7962 raft_consensus.cc:482] T 04a41e1263014dc3b86e5da908e1fd8a P 504756e7feb345afabee92c0deefa926 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 05:08:12.849256 7962 raft_consensus.cc:3037] T 04a41e1263014dc3b86e5da908e1fd8a P 504756e7feb345afabee92c0deefa926 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:08:12.850229 7962 raft_consensus.cc:504] T 04a41e1263014dc3b86e5da908e1fd8a P 504756e7feb345afabee92c0deefa926 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad5f93824f4041b0a3c2b68164a07c41" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 34179 } } peers { permanent_uuid: "504756e7feb345afabee92c0deefa926" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 41189 } } peers { permanent_uuid: "2517723745f74d85afa8cf2236144acc" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 38865 } }
I20260811 05:08:12.850387 7962 leader_election.cc:288] T 04a41e1263014dc3b86e5da908e1fd8a P 504756e7feb345afabee92c0deefa926 [CANDIDATE]: Term 1 election: Requested vote from peers ad5f93824f4041b0a3c2b68164a07c41 (127.26.191.193:34179), 2517723745f74d85afa8cf2236144acc (127.26.191.195:38865)
I20260811 05:08:12.850646 7808 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04a41e1263014dc3b86e5da908e1fd8a" candidate_uuid: "504756e7feb345afabee92c0deefa926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2517723745f74d85afa8cf2236144acc"
I20260811 05:08:12.850732 7808 raft_consensus.cc:3037] T 04a41e1263014dc3b86e5da908e1fd8a P 2517723745f74d85afa8cf2236144acc [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:08:12.850858 7366 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04a41e1263014dc3b86e5da908e1fd8a" candidate_uuid: "504756e7feb345afabee92c0deefa926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad5f93824f4041b0a3c2b68164a07c41"
I20260811 05:08:12.850956 7366 raft_consensus.cc:3037] T 04a41e1263014dc3b86e5da908e1fd8a P ad5f93824f4041b0a3c2b68164a07c41 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:08:12.851442 7808 raft_consensus.cc:2454] T 04a41e1263014dc3b86e5da908e1fd8a P 2517723745f74d85afa8cf2236144acc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 504756e7feb345afabee92c0deefa926 in term 1.
I20260811 05:08:12.851624 7490 leader_election.cc:302] T 04a41e1263014dc3b86e5da908e1fd8a P 504756e7feb345afabee92c0deefa926 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2517723745f74d85afa8cf2236144acc, 504756e7feb345afabee92c0deefa926; no voters:
I20260811 05:08:12.851764 7366 raft_consensus.cc:2454] T 04a41e1263014dc3b86e5da908e1fd8a P ad5f93824f4041b0a3c2b68164a07c41 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 504756e7feb345afabee92c0deefa926 in term 1.
I20260811 05:08:12.851780 7962 raft_consensus.cc:2781] T 04a41e1263014dc3b86e5da908e1fd8a P 504756e7feb345afabee92c0deefa926 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:08:12.851853 7962 raft_consensus.cc:686] T 04a41e1263014dc3b86e5da908e1fd8a P 504756e7feb345afabee92c0deefa926 [term 1 LEADER]: Becoming Leader. State: Replica: 504756e7feb345afabee92c0deefa926, State: Running, Role: LEADER
I20260811 05:08:12.851912 7962 consensus_queue.cc:237] T 04a41e1263014dc3b86e5da908e1fd8a P 504756e7feb345afabee92c0deefa926 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad5f93824f4041b0a3c2b68164a07c41" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 34179 } } peers { permanent_uuid: "504756e7feb345afabee92c0deefa926" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 41189 } } peers { permanent_uuid: "2517723745f74d85afa8cf2236144acc" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 38865 } }
I20260811 05:08:12.852622 7100 catalog_manager.cc:5495] T 04a41e1263014dc3b86e5da908e1fd8a P 504756e7feb345afabee92c0deefa926 reported cstate change: term changed from 0 to 1, leader changed from <none> to 504756e7feb345afabee92c0deefa926 (127.26.191.194). New cstate: current_term: 1 leader_uuid: "504756e7feb345afabee92c0deefa926" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad5f93824f4041b0a3c2b68164a07c41" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 34179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "504756e7feb345afabee92c0deefa926" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 41189 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2517723745f74d85afa8cf2236144acc" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 38865 } health_report { overall_health: UNKNOWN } } }
Aug 11 05:08:12 dist-test-slave-x5fp krb5kdc[7022](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424891, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.191.254@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM
I20260811 05:08:12.897663 7990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:12.889577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:45729 (local address 127.0.0.1:48108)
0811 05:08:12.889739 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:12.889751 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:12.889824 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:12.889992 (+ 168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:12.889992 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:12.890297 (+ 305us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:12.890357 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:12.890359 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:12.891382 (+ 1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:12.891383 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:12.891901 (+ 518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:12.891902 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:12.892426 (+ 524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:12.892426 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:12.892470 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:12.893084 (+ 614us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:12.893089 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:12.894722 (+ 1633us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:08:12.896572 (+ 1850us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:12.896580 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:12.896582 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:12.896845 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:12.897065 (+ 220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:12.897066 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:12.897066 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:12.897127 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:12.897379 (+ 252us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:08:12.897386 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:08:12.897431 (+ 45us) client_negotiation.cc:769] Sending connection context
0811 05:08:12.897484 (+ 53us) client_negotiation.cc:240] Negotiation successful
0811 05:08:12.897582 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":95,"threads_started":1}
I20260811 05:08:12.897765 7187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:12.889655 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48108 (local address 127.26.191.254:45729)
0811 05:08:12.889718 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:12.889720 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:12.889834 (+ 114us) server_negotiation.cc:407] Connection header received
0811 05:08:12.889869 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:12.889870 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:12.889881 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:12.889967 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:12.890472 (+ 505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:12.891292 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:12.891998 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:12.892321 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:12.892401 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:12.894806 (+ 2405us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:12.894807 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:12.894808 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:08:12.894815 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:12.896472 (+ 1657us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:12.896931 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:12.896932 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:12.896932 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:12.896996 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:12.897185 (+ 189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:12.897186 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:12.897186 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:12.897318 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:12.897382 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:12.897527 (+ 145us) server_negotiation.cc:299] Negotiation successful
0811 05:08:12.897645 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":33,"server-negotiator.queue_time_us":37}
I20260811 05:08:12.900128 7100 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.26.191.254@KRBTEST.COM'} at 127.0.0.1:48108:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260811 05:08:12.900368 7100 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 05:08:12.902002 7570 tablet_service.cc:1467] Processing CreateTablet for tablet 0279ef6ffce14f17bb93cb8afddb6c1d (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=a2e3461e4a1146f58e431c8383f6cf3d]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 05:08:12.902027 7331 tablet_service.cc:1467] Processing CreateTablet for tablet 0279ef6ffce14f17bb93cb8afddb6c1d (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=a2e3461e4a1146f58e431c8383f6cf3d]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 05:08:12.902076 7776 tablet_service.cc:1467] Processing CreateTablet for tablet 0279ef6ffce14f17bb93cb8afddb6c1d (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=a2e3461e4a1146f58e431c8383f6cf3d]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 05:08:12.902204 7776 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0279ef6ffce14f17bb93cb8afddb6c1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:08:12.902189 7570 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0279ef6ffce14f17bb93cb8afddb6c1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:08:12.902208 7331 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0279ef6ffce14f17bb93cb8afddb6c1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:08:12.903673 7938 tablet_bootstrap.cc:492] T 0279ef6ffce14f17bb93cb8afddb6c1d P ad5f93824f4041b0a3c2b68164a07c41: Bootstrap starting.
I20260811 05:08:12.903812 7935 tablet_bootstrap.cc:492] T 0279ef6ffce14f17bb93cb8afddb6c1d P 504756e7feb345afabee92c0deefa926: Bootstrap starting.
I20260811 05:08:12.904150 7938 tablet_bootstrap.cc:654] T 0279ef6ffce14f17bb93cb8afddb6c1d P ad5f93824f4041b0a3c2b68164a07c41: Neither blocks nor log segments found. Creating new log.
I20260811 05:08:12.904150 7935 tablet_bootstrap.cc:654] T 0279ef6ffce14f17bb93cb8afddb6c1d P 504756e7feb345afabee92c0deefa926: Neither blocks nor log segments found. Creating new log.
I20260811 05:08:12.904484 7937 tablet_bootstrap.cc:492] T 0279ef6ffce14f17bb93cb8afddb6c1d P 2517723745f74d85afa8cf2236144acc: Bootstrap starting.
I20260811 05:08:12.904819 7935 tablet_bootstrap.cc:492] T 0279ef6ffce14f17bb93cb8afddb6c1d P 504756e7feb345afabee92c0deefa926: No bootstrap required, opened a new log
I20260811 05:08:12.904881 7935 ts_tablet_manager.cc:1397] T 0279ef6ffce14f17bb93cb8afddb6c1d P 504756e7feb345afabee92c0deefa926: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260811 05:08:12.904891 7938 tablet_bootstrap.cc:492] T 0279ef6ffce14f17bb93cb8afddb6c1d P ad5f93824f4041b0a3c2b68164a07c41: No bootstrap required, opened a new log
I20260811 05:08:12.904944 7938 ts_tablet_manager.cc:1397] T 0279ef6ffce14f17bb93cb8afddb6c1d P ad5f93824f4041b0a3c2b68164a07c41: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 05:08:12.904997 7937 tablet_bootstrap.cc:654] T 0279ef6ffce14f17bb93cb8afddb6c1d P 2517723745f74d85afa8cf2236144acc: Neither blocks nor log segments found. Creating new log.
I20260811 05:08:12.905004 7935 raft_consensus.cc:348] T 0279ef6ffce14f17bb93cb8afddb6c1d P 504756e7feb345afabee92c0deefa926 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad5f93824f4041b0a3c2b68164a07c41" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 34179 } } peers { permanent_uuid: "504756e7feb345afabee92c0deefa926" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 41189 } } peers { permanent_uuid: "2517723745f74d85afa8cf2236144acc" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 38865 } }
I20260811 05:08:12.905084 7935 raft_consensus.cc:374] T 0279ef6ffce14f17bb93cb8afddb6c1d P 504756e7feb345afabee92c0deefa926 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:08:12.905104 7935 raft_consensus.cc:729] T 0279ef6ffce14f17bb93cb8afddb6c1d P 504756e7feb345afabee92c0deefa926 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 504756e7feb345afabee92c0deefa926, State: Initialized, Role: FOLLOWER
I20260811 05:08:12.905151 7935 consensus_queue.cc:260] T 0279ef6ffce14f17bb93cb8afddb6c1d P 504756e7feb345afabee92c0deefa926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad5f93824f4041b0a3c2b68164a07c41" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 34179 } } peers { permanent_uuid: "504756e7feb345afabee92c0deefa926" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 41189 } } peers { permanent_uuid: "2517723745f74d85afa8cf2236144acc" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 38865 } }
I20260811 05:08:12.905138 7938 raft_consensus.cc:348] T 0279ef6ffce14f17bb93cb8afddb6c1d P ad5f93824f4041b0a3c2b68164a07c41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad5f93824f4041b0a3c2b68164a07c41" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 34179 } } peers { permanent_uuid: "504756e7feb345afabee92c0deefa926" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 41189 } } peers { permanent_uuid: "2517723745f74d85afa8cf2236144acc" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 38865 } }
I20260811 05:08:12.905222 7938 raft_consensus.cc:374] T 0279ef6ffce14f17bb93cb8afddb6c1d P ad5f93824f4041b0a3c2b68164a07c41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:08:12.905238 7935 ts_tablet_manager.cc:1428] T 0279ef6ffce14f17bb93cb8afddb6c1d P 504756e7feb345afabee92c0deefa926: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:12.905247 7938 raft_consensus.cc:729] T 0279ef6ffce14f17bb93cb8afddb6c1d P ad5f93824f4041b0a3c2b68164a07c41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad5f93824f4041b0a3c2b68164a07c41, State: Initialized, Role: FOLLOWER
I20260811 05:08:12.905252 7962 tablet_replica.cc:439] T 0279ef6ffce14f17bb93cb8afddb6c1d P 504756e7feb345afabee92c0deefa926: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad5f93824f4041b0a3c2b68164a07c41" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 34179 } } peers { permanent_uuid: "504756e7feb345afabee92c0deefa926" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 41189 } } peers { permanent_uuid: "2517723745f74d85afa8cf2236144acc" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 38865 } } }
I20260811 05:08:12.905331 7962 tablet_replica.cc:442] T 0279ef6ffce14f17bb93cb8afddb6c1d P 504756e7feb345afabee92c0deefa926: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 05:08:12.905324 7938 consensus_queue.cc:260] T 0279ef6ffce14f17bb93cb8afddb6c1d P ad5f93824f4041b0a3c2b68164a07c41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad5f93824f4041b0a3c2b68164a07c41" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 34179 } } peers { permanent_uuid: "504756e7feb345afabee92c0deefa926" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 41189 } } peers { permanent_uuid: "2517723745f74d85afa8cf2236144acc" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 38865 } }
I20260811 05:08:12.905437 7938 ts_tablet_manager.cc:1428] T 0279ef6ffce14f17bb93cb8afddb6c1d P ad5f93824f4041b0a3c2b68164a07c41: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260811 05:08:12.905637 7937 tablet_bootstrap.cc:492] T 0279ef6ffce14f17bb93cb8afddb6c1d P 2517723745f74d85afa8cf2236144acc: No bootstrap required, opened a new log
I20260811 05:08:12.905694 7937 ts_tablet_manager.cc:1397] T 0279ef6ffce14f17bb93cb8afddb6c1d P 2517723745f74d85afa8cf2236144acc: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260811 05:08:12.905679 7946 tablet_replica.cc:439] T 0279ef6ffce14f17bb93cb8afddb6c1d P ad5f93824f4041b0a3c2b68164a07c41: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad5f93824f4041b0a3c2b68164a07c41" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 34179 } } peers { permanent_uuid: "504756e7feb345afabee92c0deefa926" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 41189 } } peers { permanent_uuid: "2517723745f74d85afa8cf2236144acc" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 38865 } } }
I20260811 05:08:12.905766 7946 tablet_replica.cc:442] T 0279ef6ffce14f17bb93cb8afddb6c1d P ad5f93824f4041b0a3c2b68164a07c41: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 05:08:12.905876 7937 raft_consensus.cc:348] T 0279ef6ffce14f17bb93cb8afddb6c1d P 2517723745f74d85afa8cf2236144acc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad5f93824f4041b0a3c2b68164a07c41" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 34179 } } peers { permanent_uuid: "504756e7feb345afabee92c0deefa926" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 41189 } } peers { permanent_uuid: "2517723745f74d85afa8cf2236144acc" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 38865 } }
I20260811 05:08:12.905987 7937 raft_consensus.cc:374] T 0279ef6ffce14f17bb93cb8afddb6c1d P 2517723745f74d85afa8cf2236144acc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:08:12.906019 7937 raft_consensus.cc:729] T 0279ef6ffce14f17bb93cb8afddb6c1d P 2517723745f74d85afa8cf2236144acc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2517723745f74d85afa8cf2236144acc, State: Initialized, Role: FOLLOWER
I20260811 05:08:12.906072 7937 consensus_queue.cc:260] T 0279ef6ffce14f17bb93cb8afddb6c1d P 2517723745f74d85afa8cf2236144acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad5f93824f4041b0a3c2b68164a07c41" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 34179 } } peers { permanent_uuid: "504756e7feb345afabee92c0deefa926" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 41189 } } peers { permanent_uuid: "2517723745f74d85afa8cf2236144acc" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 38865 } }
I20260811 05:08:12.906172 7937 ts_tablet_manager.cc:1428] T 0279ef6ffce14f17bb93cb8afddb6c1d P 2517723745f74d85afa8cf2236144acc: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:12.906265 7948 tablet_replica.cc:439] T 0279ef6ffce14f17bb93cb8afddb6c1d P 2517723745f74d85afa8cf2236144acc: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad5f93824f4041b0a3c2b68164a07c41" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 34179 } } peers { permanent_uuid: "504756e7feb345afabee92c0deefa926" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 41189 } } peers { permanent_uuid: "2517723745f74d85afa8cf2236144acc" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 38865 } } }
I20260811 05:08:12.906399 7948 tablet_replica.cc:442] T 0279ef6ffce14f17bb93cb8afddb6c1d P 2517723745f74d85afa8cf2236144acc: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 05:08:12.931355 7948 raft_consensus.cc:482] T 0279ef6ffce14f17bb93cb8afddb6c1d P 2517723745f74d85afa8cf2236144acc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 05:08:12.931459 7948 raft_consensus.cc:504] T 0279ef6ffce14f17bb93cb8afddb6c1d P 2517723745f74d85afa8cf2236144acc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad5f93824f4041b0a3c2b68164a07c41" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 34179 } } peers { permanent_uuid: "504756e7feb345afabee92c0deefa926" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 41189 } } peers { permanent_uuid: "2517723745f74d85afa8cf2236144acc" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 38865 } }
I20260811 05:08:12.931908 7948 leader_election.cc:288] T 0279ef6ffce14f17bb93cb8afddb6c1d P 2517723745f74d85afa8cf2236144acc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad5f93824f4041b0a3c2b68164a07c41 (127.26.191.193:34179), 504756e7feb345afabee92c0deefa926 (127.26.191.194:41189)
I20260811 05:08:12.935802 7932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:12.932150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.195:52401 (local address 127.26.191.193:34179)
0811 05:08:12.932218 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:12.932220 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:12.932637 (+ 417us) server_negotiation.cc:407] Connection header received
0811 05:08:12.932671 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:12.932672 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:12.932683 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:12.932760 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:08:12.932963 (+ 203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:12.933660 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:12.934867 (+ 1207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:12.935421 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:12.935497 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:12.935506 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:12.935677 (+ 171us) server_negotiation.cc:299] Negotiation successful
0811 05:08:12.935724 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 05:08:12.935822 7995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:12.932095 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.193:34179 (local address 127.26.191.195:52401)
0811 05:08:12.932478 (+ 383us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:12.932489 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:12.932553 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:12.932802 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:12.932803 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:12.932805 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:08:12.932883 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:12.932885 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:12.933722 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:12.933723 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:12.934772 (+ 1049us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:12.934775 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:12.935518 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:12.935519 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:12.935583 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:12.935587 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 05:08:12.935644 (+ 57us) client_negotiation.cc:240] Negotiation successful
0811 05:08:12.935712 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":364,"mutex_wait_us":131,"thread_start_us":148,"threads_started":1}
I20260811 05:08:12.935995 7721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:12.932089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.194:41189 (local address 127.26.191.195:49455)
0811 05:08:12.932158 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:12.932171 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:12.932240 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:12.932455 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:12.932457 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:12.932459 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:08:12.932539 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:12.932541 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:12.933551 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:12.933552 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:12.934970 (+ 1418us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:12.934974 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:12.935724 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:12.935725 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:12.935804 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:12.935807 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 05:08:12.935870 (+ 63us) client_negotiation.cc:240] Negotiation successful
0811 05:08:12.935920 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49}
I20260811 05:08:12.936002 7931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:12.932232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.195:49455 (local address 127.26.191.194:41189)
0811 05:08:12.932285 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:12.932287 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:12.932297 (+ 10us) server_negotiation.cc:407] Connection header received
0811 05:08:12.932331 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:12.932333 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:12.932346 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:12.932437 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:08:12.932646 (+ 209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:12.933427 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:12.935061 (+ 1634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:12.935610 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:12.935696 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:12.935704 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:12.935887 (+ 183us) server_negotiation.cc:299] Negotiation successful
0811 05:08:12.935938 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 05:08:12.936298 7366 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0279ef6ffce14f17bb93cb8afddb6c1d" candidate_uuid: "2517723745f74d85afa8cf2236144acc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad5f93824f4041b0a3c2b68164a07c41" is_pre_election: true
I20260811 05:08:12.936322 7597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0279ef6ffce14f17bb93cb8afddb6c1d" candidate_uuid: "2517723745f74d85afa8cf2236144acc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "504756e7feb345afabee92c0deefa926" is_pre_election: true
I20260811 05:08:12.936414 7366 raft_consensus.cc:2454] T 0279ef6ffce14f17bb93cb8afddb6c1d P ad5f93824f4041b0a3c2b68164a07c41 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2517723745f74d85afa8cf2236144acc in term 0.
I20260811 05:08:12.936467 7597 raft_consensus.cc:2454] T 0279ef6ffce14f17bb93cb8afddb6c1d P 504756e7feb345afabee92c0deefa926 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2517723745f74d85afa8cf2236144acc in term 0.
I20260811 05:08:12.936632 7712 leader_election.cc:302] T 0279ef6ffce14f17bb93cb8afddb6c1d P 2517723745f74d85afa8cf2236144acc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2517723745f74d85afa8cf2236144acc, ad5f93824f4041b0a3c2b68164a07c41; no voters:
I20260811 05:08:12.936825 7948 raft_consensus.cc:2781] T 0279ef6ffce14f17bb93cb8afddb6c1d P 2517723745f74d85afa8cf2236144acc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 05:08:12.936867 7948 raft_consensus.cc:482] T 0279ef6ffce14f17bb93cb8afddb6c1d P 2517723745f74d85afa8cf2236144acc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 05:08:12.936913 7948 raft_consensus.cc:3037] T 0279ef6ffce14f17bb93cb8afddb6c1d P 2517723745f74d85afa8cf2236144acc [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:08:12.937619 7948 raft_consensus.cc:504] T 0279ef6ffce14f17bb93cb8afddb6c1d P 2517723745f74d85afa8cf2236144acc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad5f93824f4041b0a3c2b68164a07c41" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 34179 } } peers { permanent_uuid: "504756e7feb345afabee92c0deefa926" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 41189 } } peers { permanent_uuid: "2517723745f74d85afa8cf2236144acc" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 38865 } }
I20260811 05:08:12.937783 7948 leader_election.cc:288] T 0279ef6ffce14f17bb93cb8afddb6c1d P 2517723745f74d85afa8cf2236144acc [CANDIDATE]: Term 1 election: Requested vote from peers ad5f93824f4041b0a3c2b68164a07c41 (127.26.191.193:34179), 504756e7feb345afabee92c0deefa926 (127.26.191.194:41189)
I20260811 05:08:12.937947 7366 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0279ef6ffce14f17bb93cb8afddb6c1d" candidate_uuid: "2517723745f74d85afa8cf2236144acc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad5f93824f4041b0a3c2b68164a07c41"
I20260811 05:08:12.937947 7597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0279ef6ffce14f17bb93cb8afddb6c1d" candidate_uuid: "2517723745f74d85afa8cf2236144acc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "504756e7feb345afabee92c0deefa926"
I20260811 05:08:12.938028 7366 raft_consensus.cc:3037] T 0279ef6ffce14f17bb93cb8afddb6c1d P ad5f93824f4041b0a3c2b68164a07c41 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:08:12.938028 7597 raft_consensus.cc:3037] T 0279ef6ffce14f17bb93cb8afddb6c1d P 504756e7feb345afabee92c0deefa926 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:08:12.938853 7366 raft_consensus.cc:2454] T 0279ef6ffce14f17bb93cb8afddb6c1d P ad5f93824f4041b0a3c2b68164a07c41 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2517723745f74d85afa8cf2236144acc in term 1.
I20260811 05:08:12.938843 7597 raft_consensus.cc:2454] T 0279ef6ffce14f17bb93cb8afddb6c1d P 504756e7feb345afabee92c0deefa926 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2517723745f74d85afa8cf2236144acc in term 1.
I20260811 05:08:12.939035 7709 leader_election.cc:302] T 0279ef6ffce14f17bb93cb8afddb6c1d P 2517723745f74d85afa8cf2236144acc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2517723745f74d85afa8cf2236144acc, 504756e7feb345afabee92c0deefa926; no voters:
I20260811 05:08:12.939210 7948 raft_consensus.cc:2781] T 0279ef6ffce14f17bb93cb8afddb6c1d P 2517723745f74d85afa8cf2236144acc [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:08:12.939370 7948 raft_consensus.cc:686] T 0279ef6ffce14f17bb93cb8afddb6c1d P 2517723745f74d85afa8cf2236144acc [term 1 LEADER]: Becoming Leader. State: Replica: 2517723745f74d85afa8cf2236144acc, State: Running, Role: LEADER
I20260811 05:08:12.939458 7948 consensus_queue.cc:237] T 0279ef6ffce14f17bb93cb8afddb6c1d P 2517723745f74d85afa8cf2236144acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad5f93824f4041b0a3c2b68164a07c41" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 34179 } } peers { permanent_uuid: "504756e7feb345afabee92c0deefa926" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 41189 } } peers { permanent_uuid: "2517723745f74d85afa8cf2236144acc" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 38865 } }
I20260811 05:08:12.939805 8000 tablet_replica.cc:439] T 0279ef6ffce14f17bb93cb8afddb6c1d P 2517723745f74d85afa8cf2236144acc: TxnStatusTablet state changed. Reason: New leader 2517723745f74d85afa8cf2236144acc. Latest consensus state: current_term: 1 leader_uuid: "2517723745f74d85afa8cf2236144acc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad5f93824f4041b0a3c2b68164a07c41" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 34179 } } peers { permanent_uuid: "504756e7feb345afabee92c0deefa926" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 41189 } } peers { permanent_uuid: "2517723745f74d85afa8cf2236144acc" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 38865 } } }
I20260811 05:08:12.939916 8000 tablet_replica.cc:442] T 0279ef6ffce14f17bb93cb8afddb6c1d P 2517723745f74d85afa8cf2236144acc: This TxnStatusTablet replica's current role is: LEADER
I20260811 05:08:12.940102 8003 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260811 05:08:12.940250 8003 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260811 05:08:12.940194 7100 catalog_manager.cc:5495] T 0279ef6ffce14f17bb93cb8afddb6c1d P 2517723745f74d85afa8cf2236144acc reported cstate change: term changed from 0 to 1, leader changed from <none> to 2517723745f74d85afa8cf2236144acc (127.26.191.195). New cstate: current_term: 1 leader_uuid: "2517723745f74d85afa8cf2236144acc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad5f93824f4041b0a3c2b68164a07c41" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 34179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "504756e7feb345afabee92c0deefa926" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 41189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2517723745f74d85afa8cf2236144acc" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 38865 } health_report { overall_health: HEALTHY } } }
I20260811 05:08:12.946719 7933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:12.944145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46720 (local address 127.26.191.195:38865)
0811 05:08:12.944200 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:12.944202 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:12.944212 (+ 10us) server_negotiation.cc:407] Connection header received
0811 05:08:12.944293 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:12.944294 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:12.944321 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:12.944385 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:08:12.944547 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:12.945107 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:12.945879 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:12.946097 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:12.946175 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:12.946379 (+ 204us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:08:12.946490 (+ 111us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:08:12.946575 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:12.946625 (+ 50us) server_negotiation.cc:299] Negotiation successful
0811 05:08:12.946644 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 05:08:12.946765 7990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:12.944067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.195:38865 (local address 127.0.0.1:46720)
0811 05:08:12.944142 (+ 75us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:12.944155 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:12.944209 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:12.944396 (+ 187us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:12.944396 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:12.944397 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 05:08:12.944463 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:12.944465 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:12.945191 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:12.945192 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:12.945789 (+ 597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:12.945791 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:12.946173 (+ 382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:12.946174 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:12.946245 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:12.946263 (+ 18us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 05:08:12.946560 (+ 297us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 05:08:12.946572 (+ 12us) client_negotiation.cc:769] Sending connection context
0811 05:08:12.946622 (+ 50us) client_negotiation.cc:240] Negotiation successful
0811 05:08:12.946673 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260811 05:08:12.947942 7366 raft_consensus.cc:1261] T 0279ef6ffce14f17bb93cb8afddb6c1d P ad5f93824f4041b0a3c2b68164a07c41 [term 1 FOLLOWER]: Refusing update from remote peer 2517723745f74d85afa8cf2236144acc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:08:12.948103 7597 raft_consensus.cc:1261] T 0279ef6ffce14f17bb93cb8afddb6c1d P 504756e7feb345afabee92c0deefa926 [term 1 FOLLOWER]: Refusing update from remote peer 2517723745f74d85afa8cf2236144acc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:08:12.948254 8000 consensus_queue.cc:1035] T 0279ef6ffce14f17bb93cb8afddb6c1d P 2517723745f74d85afa8cf2236144acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad5f93824f4041b0a3c2b68164a07c41" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 34179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:08:12.948396 7948 consensus_queue.cc:1035] T 0279ef6ffce14f17bb93cb8afddb6c1d P 2517723745f74d85afa8cf2236144acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "504756e7feb345afabee92c0deefa926" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 41189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:08:12.949096 7962 tablet_replica.cc:439] T 0279ef6ffce14f17bb93cb8afddb6c1d P 504756e7feb345afabee92c0deefa926: TxnStatusTablet state changed. Reason: New leader 2517723745f74d85afa8cf2236144acc. Latest consensus state: current_term: 1 leader_uuid: "2517723745f74d85afa8cf2236144acc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad5f93824f4041b0a3c2b68164a07c41" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 34179 } } peers { permanent_uuid: "504756e7feb345afabee92c0deefa926" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 41189 } } peers { permanent_uuid: "2517723745f74d85afa8cf2236144acc" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 38865 } } }
I20260811 05:08:12.949199 7962 tablet_replica.cc:442] T 0279ef6ffce14f17bb93cb8afddb6c1d P 504756e7feb345afabee92c0deefa926: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 05:08:12.949128 7946 tablet_replica.cc:439] T 0279ef6ffce14f17bb93cb8afddb6c1d P ad5f93824f4041b0a3c2b68164a07c41: TxnStatusTablet state changed. Reason: New leader 2517723745f74d85afa8cf2236144acc. Latest consensus state: current_term: 1 leader_uuid: "2517723745f74d85afa8cf2236144acc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad5f93824f4041b0a3c2b68164a07c41" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 34179 } } peers { permanent_uuid: "504756e7feb345afabee92c0deefa926" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 41189 } } peers { permanent_uuid: "2517723745f74d85afa8cf2236144acc" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 38865 } } }
I20260811 05:08:12.949268 7946 tablet_replica.cc:442] T 0279ef6ffce14f17bb93cb8afddb6c1d P ad5f93824f4041b0a3c2b68164a07c41: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 05:08:12.950146 7948 tablet_replica.cc:439] T 0279ef6ffce14f17bb93cb8afddb6c1d P 2517723745f74d85afa8cf2236144acc: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "2517723745f74d85afa8cf2236144acc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad5f93824f4041b0a3c2b68164a07c41" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 34179 } } peers { permanent_uuid: "504756e7feb345afabee92c0deefa926" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 41189 } } peers { permanent_uuid: "2517723745f74d85afa8cf2236144acc" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 38865 } } }
I20260811 05:08:12.950233 7948 tablet_replica.cc:442] T 0279ef6ffce14f17bb93cb8afddb6c1d P 2517723745f74d85afa8cf2236144acc: This TxnStatusTablet replica's current role is: LEADER
I20260811 05:08:12.950634 7962 tablet_replica.cc:439] T 0279ef6ffce14f17bb93cb8afddb6c1d P 504756e7feb345afabee92c0deefa926: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "2517723745f74d85afa8cf2236144acc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad5f93824f4041b0a3c2b68164a07c41" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 34179 } } peers { permanent_uuid: "504756e7feb345afabee92c0deefa926" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 41189 } } peers { permanent_uuid: "2517723745f74d85afa8cf2236144acc" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 38865 } } }
I20260811 05:08:12.950726 7962 tablet_replica.cc:442] T 0279ef6ffce14f17bb93cb8afddb6c1d P 504756e7feb345afabee92c0deefa926: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 05:08:12.951795 8000 tablet_replica.cc:439] T 0279ef6ffce14f17bb93cb8afddb6c1d P 2517723745f74d85afa8cf2236144acc: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "2517723745f74d85afa8cf2236144acc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad5f93824f4041b0a3c2b68164a07c41" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 34179 } } peers { permanent_uuid: "504756e7feb345afabee92c0deefa926" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 41189 } } peers { permanent_uuid: "2517723745f74d85afa8cf2236144acc" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 38865 } } }
I20260811 05:08:12.951879 8000 tablet_replica.cc:442] T 0279ef6ffce14f17bb93cb8afddb6c1d P 2517723745f74d85afa8cf2236144acc: This TxnStatusTablet replica's current role is: LEADER
I20260811 05:08:12.952113 7946 tablet_replica.cc:439] T 0279ef6ffce14f17bb93cb8afddb6c1d P ad5f93824f4041b0a3c2b68164a07c41: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "2517723745f74d85afa8cf2236144acc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad5f93824f4041b0a3c2b68164a07c41" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 34179 } } peers { permanent_uuid: "504756e7feb345afabee92c0deefa926" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 41189 } } peers { permanent_uuid: "2517723745f74d85afa8cf2236144acc" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 38865 } } }
I20260811 05:08:12.952217 7946 tablet_replica.cc:442] T 0279ef6ffce14f17bb93cb8afddb6c1d P ad5f93824f4041b0a3c2b68164a07c41: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 05:08:12.957126 7933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:12.954572 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.194:45243 (local address 127.26.191.195:38865)
0811 05:08:12.954619 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:12.954621 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:12.954712 (+ 91us) server_negotiation.cc:407] Connection header received
0811 05:08:12.954854 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:12.954855 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:12.954866 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:12.954923 (+ 57us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:08:12.955052 (+ 129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:12.955549 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:12.956330 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:12.956530 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:12.956619 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:12.956859 (+ 240us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:08:12.956901 (+ 42us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:08:12.956967 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:12.957029 (+ 62us) server_negotiation.cc:299] Negotiation successful
0811 05:08:12.957050 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 05:08:12.957167 8013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:12.954459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.195:38865 (local address 127.26.191.194:45243)
0811 05:08:12.954640 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:12.954652 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:12.954743 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:12.954927 (+ 184us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:12.954928 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:12.954929 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 05:08:12.954982 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:12.954984 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:12.955646 (+ 662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:12.955647 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:12.956238 (+ 591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:12.956240 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:12.956623 (+ 383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:12.956625 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:12.956686 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:12.956710 (+ 24us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 05:08:12.956969 (+ 259us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 05:08:12.956972 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 05:08:12.957025 (+ 53us) client_negotiation.cc:240] Negotiation successful
0811 05:08:12.957082 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":87,"threads_started":1}
I20260811 05:08:12.960561 7808 raft_consensus.cc:1261] T 04a41e1263014dc3b86e5da908e1fd8a P 2517723745f74d85afa8cf2236144acc [term 1 FOLLOWER]: Refusing update from remote peer 504756e7feb345afabee92c0deefa926: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:08:12.960566 7366 raft_consensus.cc:1261] T 04a41e1263014dc3b86e5da908e1fd8a P ad5f93824f4041b0a3c2b68164a07c41 [term 1 FOLLOWER]: Refusing update from remote peer 504756e7feb345afabee92c0deefa926: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:08:12.960807 7952 consensus_queue.cc:1035] T 04a41e1263014dc3b86e5da908e1fd8a P 504756e7feb345afabee92c0deefa926 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad5f93824f4041b0a3c2b68164a07c41" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 34179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:08:12.960913 7962 consensus_queue.cc:1035] T 04a41e1263014dc3b86e5da908e1fd8a P 504756e7feb345afabee92c0deefa926 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2517723745f74d85afa8cf2236144acc" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 38865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:08:12.972101 7931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:12.968975 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.195:56593 (local address 127.26.191.194:41189)
0811 05:08:12.969031 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:12.969033 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:12.969044 (+ 11us) server_negotiation.cc:407] Connection header received
0811 05:08:12.969107 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:12.969108 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:12.969118 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:12.969212 (+ 94us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:08:12.969453 (+ 241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:12.970195 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:12.971191 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:12.971430 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:12.971534 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:12.971768 (+ 234us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:08:12.971813 (+ 45us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:08:12.971901 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:12.971975 (+ 74us) server_negotiation.cc:299] Negotiation successful
0811 05:08:12.972002 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 05:08:12.972101 7903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:12.968914 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.194:41189 (local address 127.26.191.195:56593)
0811 05:08:12.968989 (+ 75us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:12.969003 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:12.969051 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:12.969219 (+ 168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:12.969220 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:12.969222 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 05:08:12.969295 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:12.969297 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:12.970389 (+ 1092us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:12.970390 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:12.971078 (+ 688us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:12.971080 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:12.971537 (+ 457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:12.971538 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:12.971617 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:12.971641 (+ 24us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 05:08:12.971900 (+ 259us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 05:08:12.971903 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 05:08:12.971971 (+ 68us) client_negotiation.cc:240] Negotiation successful
0811 05:08:12.972018 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260811 05:08:12.980623 7097 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48096:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:08:12.980804 7097 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48096:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:08:12.981603 7097 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a24399409f294f0f8815ab9516c10f81: Sending DeleteTablet for 3 replicas of tablet 04a41e1263014dc3b86e5da908e1fd8a
I20260811 05:08:12.981876 7331 tablet_service.cc:1514] Processing DeleteTablet for tablet 04a41e1263014dc3b86e5da908e1fd8a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:08:12 UTC) from {username='oryx', principal='oryx/127.26.191.254@KRBTEST.COM'} at 127.0.0.1:34744
I20260811 05:08:12.981976 7968 tablet_replica.cc:330] T 04a41e1263014dc3b86e5da908e1fd8a P ad5f93824f4041b0a3c2b68164a07c41: stopping tablet replica
I20260811 05:08:12.981945 7776 tablet_service.cc:1514] Processing DeleteTablet for tablet 04a41e1263014dc3b86e5da908e1fd8a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:08:12 UTC) from {username='oryx', principal='oryx/127.26.191.254@KRBTEST.COM'} at 127.0.0.1:46706
I20260811 05:08:12.982017 7968 raft_consensus.cc:2229] T 04a41e1263014dc3b86e5da908e1fd8a P ad5f93824f4041b0a3c2b68164a07c41 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 05:08:12.982053 7970 tablet_replica.cc:330] T 04a41e1263014dc3b86e5da908e1fd8a P 2517723745f74d85afa8cf2236144acc: stopping tablet replica
I20260811 05:08:12.982069 7968 raft_consensus.cc:2258] T 04a41e1263014dc3b86e5da908e1fd8a P ad5f93824f4041b0a3c2b68164a07c41 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:08:12.982100 7970 raft_consensus.cc:2229] T 04a41e1263014dc3b86e5da908e1fd8a P 2517723745f74d85afa8cf2236144acc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 05:08:12.982127 7970 raft_consensus.cc:2258] T 04a41e1263014dc3b86e5da908e1fd8a P 2517723745f74d85afa8cf2236144acc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:08:12.982487 7968 ts_tablet_manager.cc:1905] T 04a41e1263014dc3b86e5da908e1fd8a P ad5f93824f4041b0a3c2b68164a07c41: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:08:12.982487 7970 ts_tablet_manager.cc:1905] T 04a41e1263014dc3b86e5da908e1fd8a P 2517723745f74d85afa8cf2236144acc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:08:12.984237 7968 ts_tablet_manager.cc:1918] T 04a41e1263014dc3b86e5da908e1fd8a P ad5f93824f4041b0a3c2b68164a07c41: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 05:08:12.984232 7970 ts_tablet_manager.cc:1918] T 04a41e1263014dc3b86e5da908e1fd8a P 2517723745f74d85afa8cf2236144acc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 05:08:12.984298 7970 log.cc:1196] T 04a41e1263014dc3b86e5da908e1fd8a P 2517723745f74d85afa8cf2236144acc: Deleting WAL directory at /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/minicluster-data/ts-2/wal/wals/04a41e1263014dc3b86e5da908e1fd8a
I20260811 05:08:12.984308 7968 log.cc:1196] T 04a41e1263014dc3b86e5da908e1fd8a P ad5f93824f4041b0a3c2b68164a07c41: Deleting WAL directory at /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/minicluster-data/ts-0/wal/wals/04a41e1263014dc3b86e5da908e1fd8a
I20260811 05:08:12.984534 7970 ts_tablet_manager.cc:1939] T 04a41e1263014dc3b86e5da908e1fd8a P 2517723745f74d85afa8cf2236144acc: Deleting consensus metadata
I20260811 05:08:12.984539 7968 ts_tablet_manager.cc:1939] T 04a41e1263014dc3b86e5da908e1fd8a P ad5f93824f4041b0a3c2b68164a07c41: Deleting consensus metadata
I20260811 05:08:12.984925 7080 catalog_manager.cc:4841] TS 2517723745f74d85afa8cf2236144acc (127.26.191.195:38865): tablet 04a41e1263014dc3b86e5da908e1fd8a (table test-table [id=6e77725dcb9d4e8e82be8841cc215701]) successfully deleted
I20260811 05:08:12.985164 7079 catalog_manager.cc:4841] TS ad5f93824f4041b0a3c2b68164a07c41 (127.26.191.193:34179): tablet 04a41e1263014dc3b86e5da908e1fd8a (table test-table [id=6e77725dcb9d4e8e82be8841cc215701]) successfully deleted
I20260811 05:08:12.986089 7570 tablet_service.cc:1514] Processing DeleteTablet for tablet 04a41e1263014dc3b86e5da908e1fd8a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:08:12 UTC) from {username='oryx', principal='oryx/127.26.191.254@KRBTEST.COM'} at 127.0.0.1:35070
I20260811 05:08:12.986207 7971 tablet_replica.cc:330] T 04a41e1263014dc3b86e5da908e1fd8a P 504756e7feb345afabee92c0deefa926: stopping tablet replica
I20260811 05:08:12.986272 7971 raft_consensus.cc:2229] T 04a41e1263014dc3b86e5da908e1fd8a P 504756e7feb345afabee92c0deefa926 [term 1 LEADER]: Raft consensus shutting down.
I20260811 05:08:12.986356 7971 raft_consensus.cc:2258] T 04a41e1263014dc3b86e5da908e1fd8a P 504756e7feb345afabee92c0deefa926 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:08:12.986698 7971 ts_tablet_manager.cc:1905] T 04a41e1263014dc3b86e5da908e1fd8a P 504756e7feb345afabee92c0deefa926: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:08:12.988039 7971 ts_tablet_manager.cc:1918] T 04a41e1263014dc3b86e5da908e1fd8a P 504756e7feb345afabee92c0deefa926: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 05:08:12.988119 7971 log.cc:1196] T 04a41e1263014dc3b86e5da908e1fd8a P 504756e7feb345afabee92c0deefa926: Deleting WAL directory at /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/minicluster-data/ts-1/wal/wals/04a41e1263014dc3b86e5da908e1fd8a
I20260811 05:08:12.988355 7971 ts_tablet_manager.cc:1939] T 04a41e1263014dc3b86e5da908e1fd8a P 504756e7feb345afabee92c0deefa926: Deleting consensus metadata
I20260811 05:08:12.988687 7074 catalog_manager.cc:4841] TS 504756e7feb345afabee92c0deefa926 (127.26.191.194:41189): tablet 04a41e1263014dc3b86e5da908e1fd8a (table test-table [id=6e77725dcb9d4e8e82be8841cc215701]) successfully deleted
Aug 11 05:08:12 dist-test-slave-x5fp krb5kdc[7022](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424892, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 05:08:13 dist-test-slave-x5fp krb5kdc[7022](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:08:13 dist-test-slave-x5fp krb5kdc[7022](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
W20260811 05:08:13.016992 7187 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:08:13.005652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48120 (local address 127.26.191.254:45729)
0811 05:08:13.005726 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:13.005728 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:13.005879 (+ 151us) server_negotiation.cc:407] Connection header received
0811 05:08:13.005987 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:13.005989 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:13.006004 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:13.006064 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:13.006836 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:13.007358 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:13.008163 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:13.008370 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:13.008449 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:13.016936 (+ 8487us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48120: BlockingRecv error: recv got EOF from 127.0.0.1:48120 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Aug 11 05:08:13 dist-test-slave-x5fp krb5kdc[7022](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424892, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM
I20260811 05:08:13.026557 7187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:13.017926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48122 (local address 127.26.191.254:45729)
0811 05:08:13.017996 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:13.017998 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:13.018009 (+ 11us) server_negotiation.cc:407] Connection header received
0811 05:08:13.018085 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:13.018086 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:13.018096 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:13.018149 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:13.018854 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:13.019363 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:13.020380 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:13.020571 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:13.020629 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:13.023391 (+ 2762us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:13.023393 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:13.023393 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:08:13.023403 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:13.025272 (+ 1869us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:13.025677 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:13.025678 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:13.025679 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:13.025753 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:13.025979 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:13.025980 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:13.025980 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:13.026139 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:13.026256 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:13.026365 (+ 109us) server_negotiation.cc:299] Negotiation successful
0811 05:08:13.026454 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 05:08:13.028610 7097 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48122:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 05:08:13.028842 7097 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 05:08:13.030558 7331 tablet_service.cc:1467] Processing CreateTablet for tablet 08f00d43a006421399ca1db668ccd4e3 (DEFAULT_TABLE table=test-table [id=c67675164abe480ea7855da49b2826c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:08:13.030642 7570 tablet_service.cc:1467] Processing CreateTablet for tablet 08f00d43a006421399ca1db668ccd4e3 (DEFAULT_TABLE table=test-table [id=c67675164abe480ea7855da49b2826c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:08:13.030719 7331 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 08f00d43a006421399ca1db668ccd4e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:08:13.030761 7570 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 08f00d43a006421399ca1db668ccd4e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:08:13.032095 7938 tablet_bootstrap.cc:492] T 08f00d43a006421399ca1db668ccd4e3 P ad5f93824f4041b0a3c2b68164a07c41: Bootstrap starting.
I20260811 05:08:13.032138 7776 tablet_service.cc:1467] Processing CreateTablet for tablet 08f00d43a006421399ca1db668ccd4e3 (DEFAULT_TABLE table=test-table [id=c67675164abe480ea7855da49b2826c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:08:13.032270 7776 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 08f00d43a006421399ca1db668ccd4e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:08:13.032595 7938 tablet_bootstrap.cc:654] T 08f00d43a006421399ca1db668ccd4e3 P ad5f93824f4041b0a3c2b68164a07c41: Neither blocks nor log segments found. Creating new log.
I20260811 05:08:13.033442 7938 tablet_bootstrap.cc:492] T 08f00d43a006421399ca1db668ccd4e3 P ad5f93824f4041b0a3c2b68164a07c41: No bootstrap required, opened a new log
I20260811 05:08:13.033490 7938 ts_tablet_manager.cc:1397] T 08f00d43a006421399ca1db668ccd4e3 P ad5f93824f4041b0a3c2b68164a07c41: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260811 05:08:13.033646 7938 raft_consensus.cc:348] T 08f00d43a006421399ca1db668ccd4e3 P ad5f93824f4041b0a3c2b68164a07c41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad5f93824f4041b0a3c2b68164a07c41" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 34179 } } peers { permanent_uuid: "504756e7feb345afabee92c0deefa926" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 41189 } } peers { permanent_uuid: "2517723745f74d85afa8cf2236144acc" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 38865 } }
I20260811 05:08:13.033679 7937 tablet_bootstrap.cc:492] T 08f00d43a006421399ca1db668ccd4e3 P 2517723745f74d85afa8cf2236144acc: Bootstrap starting.
I20260811 05:08:13.033716 7938 raft_consensus.cc:374] T 08f00d43a006421399ca1db668ccd4e3 P ad5f93824f4041b0a3c2b68164a07c41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:08:13.033739 7938 raft_consensus.cc:729] T 08f00d43a006421399ca1db668ccd4e3 P ad5f93824f4041b0a3c2b68164a07c41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad5f93824f4041b0a3c2b68164a07c41, State: Initialized, Role: FOLLOWER
I20260811 05:08:13.033725 7935 tablet_bootstrap.cc:492] T 08f00d43a006421399ca1db668ccd4e3 P 504756e7feb345afabee92c0deefa926: Bootstrap starting.
I20260811 05:08:13.033787 7938 consensus_queue.cc:260] T 08f00d43a006421399ca1db668ccd4e3 P ad5f93824f4041b0a3c2b68164a07c41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad5f93824f4041b0a3c2b68164a07c41" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 34179 } } peers { permanent_uuid: "504756e7feb345afabee92c0deefa926" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 41189 } } peers { permanent_uuid: "2517723745f74d85afa8cf2236144acc" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 38865 } }
I20260811 05:08:13.033876 7938 ts_tablet_manager.cc:1428] T 08f00d43a006421399ca1db668ccd4e3 P ad5f93824f4041b0a3c2b68164a07c41: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260811 05:08:13.034085 7937 tablet_bootstrap.cc:654] T 08f00d43a006421399ca1db668ccd4e3 P 2517723745f74d85afa8cf2236144acc: Neither blocks nor log segments found. Creating new log.
I20260811 05:08:13.034085 7935 tablet_bootstrap.cc:654] T 08f00d43a006421399ca1db668ccd4e3 P 504756e7feb345afabee92c0deefa926: Neither blocks nor log segments found. Creating new log.
I20260811 05:08:13.035074 7935 tablet_bootstrap.cc:492] T 08f00d43a006421399ca1db668ccd4e3 P 504756e7feb345afabee92c0deefa926: No bootstrap required, opened a new log
I20260811 05:08:13.035137 7935 ts_tablet_manager.cc:1397] T 08f00d43a006421399ca1db668ccd4e3 P 504756e7feb345afabee92c0deefa926: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 05:08:13.035259 7935 raft_consensus.cc:348] T 08f00d43a006421399ca1db668ccd4e3 P 504756e7feb345afabee92c0deefa926 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad5f93824f4041b0a3c2b68164a07c41" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 34179 } } peers { permanent_uuid: "504756e7feb345afabee92c0deefa926" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 41189 } } peers { permanent_uuid: "2517723745f74d85afa8cf2236144acc" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 38865 } }
I20260811 05:08:13.035337 7935 raft_consensus.cc:374] T 08f00d43a006421399ca1db668ccd4e3 P 504756e7feb345afabee92c0deefa926 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:08:13.035352 7935 raft_consensus.cc:729] T 08f00d43a006421399ca1db668ccd4e3 P 504756e7feb345afabee92c0deefa926 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 504756e7feb345afabee92c0deefa926, State: Initialized, Role: FOLLOWER
I20260811 05:08:13.035414 7935 consensus_queue.cc:260] T 08f00d43a006421399ca1db668ccd4e3 P 504756e7feb345afabee92c0deefa926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad5f93824f4041b0a3c2b68164a07c41" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 34179 } } peers { permanent_uuid: "504756e7feb345afabee92c0deefa926" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 41189 } } peers { permanent_uuid: "2517723745f74d85afa8cf2236144acc" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 38865 } }
I20260811 05:08:13.035516 7935 ts_tablet_manager.cc:1428] T 08f00d43a006421399ca1db668ccd4e3 P 504756e7feb345afabee92c0deefa926: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:13.036036 7937 tablet_bootstrap.cc:492] T 08f00d43a006421399ca1db668ccd4e3 P 2517723745f74d85afa8cf2236144acc: No bootstrap required, opened a new log
I20260811 05:08:13.036095 7937 ts_tablet_manager.cc:1397] T 08f00d43a006421399ca1db668ccd4e3 P 2517723745f74d85afa8cf2236144acc: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260811 05:08:13.036262 7937 raft_consensus.cc:348] T 08f00d43a006421399ca1db668ccd4e3 P 2517723745f74d85afa8cf2236144acc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad5f93824f4041b0a3c2b68164a07c41" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 34179 } } peers { permanent_uuid: "504756e7feb345afabee92c0deefa926" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 41189 } } peers { permanent_uuid: "2517723745f74d85afa8cf2236144acc" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 38865 } }
I20260811 05:08:13.036324 7937 raft_consensus.cc:374] T 08f00d43a006421399ca1db668ccd4e3 P 2517723745f74d85afa8cf2236144acc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:08:13.036336 7937 raft_consensus.cc:729] T 08f00d43a006421399ca1db668ccd4e3 P 2517723745f74d85afa8cf2236144acc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2517723745f74d85afa8cf2236144acc, State: Initialized, Role: FOLLOWER
I20260811 05:08:13.036405 7937 consensus_queue.cc:260] T 08f00d43a006421399ca1db668ccd4e3 P 2517723745f74d85afa8cf2236144acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad5f93824f4041b0a3c2b68164a07c41" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 34179 } } peers { permanent_uuid: "504756e7feb345afabee92c0deefa926" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 41189 } } peers { permanent_uuid: "2517723745f74d85afa8cf2236144acc" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 38865 } }
I20260811 05:08:13.036518 7937 ts_tablet_manager.cc:1428] T 08f00d43a006421399ca1db668ccd4e3 P 2517723745f74d85afa8cf2236144acc: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:13.096916 8009 raft_consensus.cc:482] T 08f00d43a006421399ca1db668ccd4e3 P 2517723745f74d85afa8cf2236144acc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 05:08:13.097045 8009 raft_consensus.cc:504] T 08f00d43a006421399ca1db668ccd4e3 P 2517723745f74d85afa8cf2236144acc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad5f93824f4041b0a3c2b68164a07c41" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 34179 } } peers { permanent_uuid: "504756e7feb345afabee92c0deefa926" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 41189 } } peers { permanent_uuid: "2517723745f74d85afa8cf2236144acc" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 38865 } }
I20260811 05:08:13.097235 8009 leader_election.cc:288] T 08f00d43a006421399ca1db668ccd4e3 P 2517723745f74d85afa8cf2236144acc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad5f93824f4041b0a3c2b68164a07c41 (127.26.191.193:34179), 504756e7feb345afabee92c0deefa926 (127.26.191.194:41189)
I20260811 05:08:13.097527 7366 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08f00d43a006421399ca1db668ccd4e3" candidate_uuid: "2517723745f74d85afa8cf2236144acc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad5f93824f4041b0a3c2b68164a07c41" is_pre_election: true
I20260811 05:08:13.097539 7597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08f00d43a006421399ca1db668ccd4e3" candidate_uuid: "2517723745f74d85afa8cf2236144acc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "504756e7feb345afabee92c0deefa926" is_pre_election: true
I20260811 05:08:13.097654 7366 raft_consensus.cc:2454] T 08f00d43a006421399ca1db668ccd4e3 P ad5f93824f4041b0a3c2b68164a07c41 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2517723745f74d85afa8cf2236144acc in term 0.
I20260811 05:08:13.097675 7597 raft_consensus.cc:2454] T 08f00d43a006421399ca1db668ccd4e3 P 504756e7feb345afabee92c0deefa926 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2517723745f74d85afa8cf2236144acc in term 0.
I20260811 05:08:13.097853 7712 leader_election.cc:302] T 08f00d43a006421399ca1db668ccd4e3 P 2517723745f74d85afa8cf2236144acc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2517723745f74d85afa8cf2236144acc, ad5f93824f4041b0a3c2b68164a07c41; no voters:
I20260811 05:08:13.097965 8009 raft_consensus.cc:2781] T 08f00d43a006421399ca1db668ccd4e3 P 2517723745f74d85afa8cf2236144acc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 05:08:13.098006 8009 raft_consensus.cc:482] T 08f00d43a006421399ca1db668ccd4e3 P 2517723745f74d85afa8cf2236144acc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 05:08:13.098024 8009 raft_consensus.cc:3037] T 08f00d43a006421399ca1db668ccd4e3 P 2517723745f74d85afa8cf2236144acc [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:08:13.098912 8009 raft_consensus.cc:504] T 08f00d43a006421399ca1db668ccd4e3 P 2517723745f74d85afa8cf2236144acc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad5f93824f4041b0a3c2b68164a07c41" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 34179 } } peers { permanent_uuid: "504756e7feb345afabee92c0deefa926" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 41189 } } peers { permanent_uuid: "2517723745f74d85afa8cf2236144acc" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 38865 } }
I20260811 05:08:13.099087 8009 leader_election.cc:288] T 08f00d43a006421399ca1db668ccd4e3 P 2517723745f74d85afa8cf2236144acc [CANDIDATE]: Term 1 election: Requested vote from peers ad5f93824f4041b0a3c2b68164a07c41 (127.26.191.193:34179), 504756e7feb345afabee92c0deefa926 (127.26.191.194:41189)
I20260811 05:08:13.099280 7366 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08f00d43a006421399ca1db668ccd4e3" candidate_uuid: "2517723745f74d85afa8cf2236144acc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad5f93824f4041b0a3c2b68164a07c41"
I20260811 05:08:13.099289 7597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08f00d43a006421399ca1db668ccd4e3" candidate_uuid: "2517723745f74d85afa8cf2236144acc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "504756e7feb345afabee92c0deefa926"
I20260811 05:08:13.099370 7366 raft_consensus.cc:3037] T 08f00d43a006421399ca1db668ccd4e3 P ad5f93824f4041b0a3c2b68164a07c41 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:08:13.099401 7597 raft_consensus.cc:3037] T 08f00d43a006421399ca1db668ccd4e3 P 504756e7feb345afabee92c0deefa926 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:08:13.100106 7597 raft_consensus.cc:2454] T 08f00d43a006421399ca1db668ccd4e3 P 504756e7feb345afabee92c0deefa926 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2517723745f74d85afa8cf2236144acc in term 1.
I20260811 05:08:13.100107 7366 raft_consensus.cc:2454] T 08f00d43a006421399ca1db668ccd4e3 P ad5f93824f4041b0a3c2b68164a07c41 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2517723745f74d85afa8cf2236144acc in term 1.
I20260811 05:08:13.100327 7709 leader_election.cc:302] T 08f00d43a006421399ca1db668ccd4e3 P 2517723745f74d85afa8cf2236144acc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2517723745f74d85afa8cf2236144acc, 504756e7feb345afabee92c0deefa926; no voters:
I20260811 05:08:13.100430 8009 raft_consensus.cc:2781] T 08f00d43a006421399ca1db668ccd4e3 P 2517723745f74d85afa8cf2236144acc [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:08:13.100474 8009 raft_consensus.cc:686] T 08f00d43a006421399ca1db668ccd4e3 P 2517723745f74d85afa8cf2236144acc [term 1 LEADER]: Becoming Leader. State: Replica: 2517723745f74d85afa8cf2236144acc, State: Running, Role: LEADER
I20260811 05:08:13.100517 8009 consensus_queue.cc:237] T 08f00d43a006421399ca1db668ccd4e3 P 2517723745f74d85afa8cf2236144acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad5f93824f4041b0a3c2b68164a07c41" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 34179 } } peers { permanent_uuid: "504756e7feb345afabee92c0deefa926" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 41189 } } peers { permanent_uuid: "2517723745f74d85afa8cf2236144acc" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 38865 } }
I20260811 05:08:13.101140 7097 catalog_manager.cc:5495] T 08f00d43a006421399ca1db668ccd4e3 P 2517723745f74d85afa8cf2236144acc reported cstate change: term changed from 0 to 1, leader changed from <none> to 2517723745f74d85afa8cf2236144acc (127.26.191.195). New cstate: current_term: 1 leader_uuid: "2517723745f74d85afa8cf2236144acc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad5f93824f4041b0a3c2b68164a07c41" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 34179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "504756e7feb345afabee92c0deefa926" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 41189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2517723745f74d85afa8cf2236144acc" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 38865 } health_report { overall_health: HEALTHY } } }
I20260811 05:08:13.109663 7933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:13.107237 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46728 (local address 127.26.191.195:38865)
0811 05:08:13.107312 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:13.107315 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:13.107324 (+ 9us) server_negotiation.cc:407] Connection header received
0811 05:08:13.107417 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:13.107418 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:13.107431 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:13.107476 (+ 45us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:08:13.107621 (+ 145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:13.108100 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:13.108921 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:13.109140 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:13.109221 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:13.109382 (+ 161us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:08:13.109418 (+ 36us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:08:13.109488 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:13.109552 (+ 64us) server_negotiation.cc:299] Negotiation successful
0811 05:08:13.109571 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 05:08:13.110563 7597 raft_consensus.cc:1261] T 08f00d43a006421399ca1db668ccd4e3 P 504756e7feb345afabee92c0deefa926 [term 1 FOLLOWER]: Refusing update from remote peer 2517723745f74d85afa8cf2236144acc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:08:13.110597 7366 raft_consensus.cc:1261] T 08f00d43a006421399ca1db668ccd4e3 P ad5f93824f4041b0a3c2b68164a07c41 [term 1 FOLLOWER]: Refusing update from remote peer 2517723745f74d85afa8cf2236144acc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:08:13.110896 7948 consensus_queue.cc:1035] T 08f00d43a006421399ca1db668ccd4e3 P 2517723745f74d85afa8cf2236144acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad5f93824f4041b0a3c2b68164a07c41" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 34179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:08:13.111025 8009 consensus_queue.cc:1035] T 08f00d43a006421399ca1db668ccd4e3 P 2517723745f74d85afa8cf2236144acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "504756e7feb345afabee92c0deefa926" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 41189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:08:13.114588 7099 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48122:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:08:13.114712 7099 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48122:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:08:13.115723 7099 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a24399409f294f0f8815ab9516c10f81: Sending DeleteTablet for 3 replicas of tablet 08f00d43a006421399ca1db668ccd4e3
I20260811 05:08:13.116067 7331 tablet_service.cc:1514] Processing DeleteTablet for tablet 08f00d43a006421399ca1db668ccd4e3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:08:13 UTC) from {username='oryx', principal='oryx/127.26.191.254@KRBTEST.COM'} at 127.0.0.1:34744
I20260811 05:08:13.116137 7570 tablet_service.cc:1514] Processing DeleteTablet for tablet 08f00d43a006421399ca1db668ccd4e3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:08:13 UTC) from {username='oryx', principal='oryx/127.26.191.254@KRBTEST.COM'} at 127.0.0.1:35070
I20260811 05:08:13.116235 7971 tablet_replica.cc:330] T 08f00d43a006421399ca1db668ccd4e3 P 504756e7feb345afabee92c0deefa926: stopping tablet replica
I20260811 05:08:13.116222 7968 tablet_replica.cc:330] T 08f00d43a006421399ca1db668ccd4e3 P ad5f93824f4041b0a3c2b68164a07c41: stopping tablet replica
I20260811 05:08:13.116292 7968 raft_consensus.cc:2229] T 08f00d43a006421399ca1db668ccd4e3 P ad5f93824f4041b0a3c2b68164a07c41 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 05:08:13.116294 7971 raft_consensus.cc:2229] T 08f00d43a006421399ca1db668ccd4e3 P 504756e7feb345afabee92c0deefa926 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 05:08:13.116340 7971 raft_consensus.cc:2258] T 08f00d43a006421399ca1db668ccd4e3 P 504756e7feb345afabee92c0deefa926 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:08:13.116343 7968 raft_consensus.cc:2258] T 08f00d43a006421399ca1db668ccd4e3 P ad5f93824f4041b0a3c2b68164a07c41 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:08:13.116459 7776 tablet_service.cc:1514] Processing DeleteTablet for tablet 08f00d43a006421399ca1db668ccd4e3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:08:13 UTC) from {username='oryx', principal='oryx/127.26.191.254@KRBTEST.COM'} at 127.0.0.1:46706
I20260811 05:08:13.116575 7970 tablet_replica.cc:330] T 08f00d43a006421399ca1db668ccd4e3 P 2517723745f74d85afa8cf2236144acc: stopping tablet replica
I20260811 05:08:13.116626 7970 raft_consensus.cc:2229] T 08f00d43a006421399ca1db668ccd4e3 P 2517723745f74d85afa8cf2236144acc [term 1 LEADER]: Raft consensus shutting down.
I20260811 05:08:13.116763 7968 ts_tablet_manager.cc:1905] T 08f00d43a006421399ca1db668ccd4e3 P ad5f93824f4041b0a3c2b68164a07c41: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:08:13.116808 7970 raft_consensus.cc:2258] T 08f00d43a006421399ca1db668ccd4e3 P 2517723745f74d85afa8cf2236144acc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:08:13.117374 7970 ts_tablet_manager.cc:1905] T 08f00d43a006421399ca1db668ccd4e3 P 2517723745f74d85afa8cf2236144acc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:08:13.118518 7968 ts_tablet_manager.cc:1918] T 08f00d43a006421399ca1db668ccd4e3 P ad5f93824f4041b0a3c2b68164a07c41: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 05:08:13.118593 7968 log.cc:1196] T 08f00d43a006421399ca1db668ccd4e3 P ad5f93824f4041b0a3c2b68164a07c41: Deleting WAL directory at /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/minicluster-data/ts-0/wal/wals/08f00d43a006421399ca1db668ccd4e3
I20260811 05:08:13.118754 7970 ts_tablet_manager.cc:1918] T 08f00d43a006421399ca1db668ccd4e3 P 2517723745f74d85afa8cf2236144acc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 05:08:13.118831 7970 log.cc:1196] T 08f00d43a006421399ca1db668ccd4e3 P 2517723745f74d85afa8cf2236144acc: Deleting WAL directory at /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/minicluster-data/ts-2/wal/wals/08f00d43a006421399ca1db668ccd4e3
I20260811 05:08:13.118854 7968 ts_tablet_manager.cc:1939] T 08f00d43a006421399ca1db668ccd4e3 P ad5f93824f4041b0a3c2b68164a07c41: Deleting consensus metadata
I20260811 05:08:13.119072 7970 ts_tablet_manager.cc:1939] T 08f00d43a006421399ca1db668ccd4e3 P 2517723745f74d85afa8cf2236144acc: Deleting consensus metadata
I20260811 05:08:13.119235 7079 catalog_manager.cc:4841] TS ad5f93824f4041b0a3c2b68164a07c41 (127.26.191.193:34179): tablet 08f00d43a006421399ca1db668ccd4e3 (table test-table [id=c67675164abe480ea7855da49b2826c8]) successfully deleted
I20260811 05:08:13.119289 7099 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48122:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 05:08:13.119467 7099 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 05:08:13.119649 7080 catalog_manager.cc:4841] TS 2517723745f74d85afa8cf2236144acc (127.26.191.195:38865): tablet 08f00d43a006421399ca1db668ccd4e3 (table test-table [id=c67675164abe480ea7855da49b2826c8]) successfully deleted
I20260811 05:08:13.119760 7971 ts_tablet_manager.cc:1905] T 08f00d43a006421399ca1db668ccd4e3 P 504756e7feb345afabee92c0deefa926: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:08:13.120934 7331 tablet_service.cc:1467] Processing CreateTablet for tablet 68e0c6b7058f4ba89c346dd366b74fd7 (DEFAULT_TABLE table=test-table [id=c880dc45b3a44df8b70293d3d0602832]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:08:13.120970 7570 tablet_service.cc:1467] Processing CreateTablet for tablet 68e0c6b7058f4ba89c346dd366b74fd7 (DEFAULT_TABLE table=test-table [id=c880dc45b3a44df8b70293d3d0602832]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:08:13.121053 7331 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 68e0c6b7058f4ba89c346dd366b74fd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:08:13.121089 7570 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 68e0c6b7058f4ba89c346dd366b74fd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:08:13.121472 7971 ts_tablet_manager.cc:1918] T 08f00d43a006421399ca1db668ccd4e3 P 504756e7feb345afabee92c0deefa926: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 05:08:13.121531 7971 log.cc:1196] T 08f00d43a006421399ca1db668ccd4e3 P 504756e7feb345afabee92c0deefa926: Deleting WAL directory at /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/minicluster-data/ts-1/wal/wals/08f00d43a006421399ca1db668ccd4e3
I20260811 05:08:13.121790 7971 ts_tablet_manager.cc:1939] T 08f00d43a006421399ca1db668ccd4e3 P 504756e7feb345afabee92c0deefa926: Deleting consensus metadata
I20260811 05:08:13.122409 7935 tablet_bootstrap.cc:492] T 68e0c6b7058f4ba89c346dd366b74fd7 P 504756e7feb345afabee92c0deefa926: Bootstrap starting.
I20260811 05:08:13.122498 7938 tablet_bootstrap.cc:492] T 68e0c6b7058f4ba89c346dd366b74fd7 P ad5f93824f4041b0a3c2b68164a07c41: Bootstrap starting.
I20260811 05:08:13.122750 7935 tablet_bootstrap.cc:654] T 68e0c6b7058f4ba89c346dd366b74fd7 P 504756e7feb345afabee92c0deefa926: Neither blocks nor log segments found. Creating new log.
I20260811 05:08:13.122975 7938 tablet_bootstrap.cc:654] T 68e0c6b7058f4ba89c346dd366b74fd7 P ad5f93824f4041b0a3c2b68164a07c41: Neither blocks nor log segments found. Creating new log.
I20260811 05:08:13.123394 7935 tablet_bootstrap.cc:492] T 68e0c6b7058f4ba89c346dd366b74fd7 P 504756e7feb345afabee92c0deefa926: No bootstrap required, opened a new log
I20260811 05:08:13.123466 7935 ts_tablet_manager.cc:1397] T 68e0c6b7058f4ba89c346dd366b74fd7 P 504756e7feb345afabee92c0deefa926: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 05:08:13.123590 7935 raft_consensus.cc:348] T 68e0c6b7058f4ba89c346dd366b74fd7 P 504756e7feb345afabee92c0deefa926 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad5f93824f4041b0a3c2b68164a07c41" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 34179 } } peers { permanent_uuid: "504756e7feb345afabee92c0deefa926" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 41189 } } peers { permanent_uuid: "2517723745f74d85afa8cf2236144acc" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 38865 } }
I20260811 05:08:13.123684 7935 raft_consensus.cc:374] T 68e0c6b7058f4ba89c346dd366b74fd7 P 504756e7feb345afabee92c0deefa926 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:08:13.123677 7074 catalog_manager.cc:4841] TS 504756e7feb345afabee92c0deefa926 (127.26.191.194:41189): tablet 08f00d43a006421399ca1db668ccd4e3 (table test-table [id=c67675164abe480ea7855da49b2826c8]) successfully deleted
I20260811 05:08:13.123718 7935 raft_consensus.cc:729] T 68e0c6b7058f4ba89c346dd366b74fd7 P 504756e7feb345afabee92c0deefa926 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 504756e7feb345afabee92c0deefa926, State: Initialized, Role: FOLLOWER
I20260811 05:08:13.123773 7935 consensus_queue.cc:260] T 68e0c6b7058f4ba89c346dd366b74fd7 P 504756e7feb345afabee92c0deefa926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad5f93824f4041b0a3c2b68164a07c41" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 34179 } } peers { permanent_uuid: "504756e7feb345afabee92c0deefa926" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 41189 } } peers { permanent_uuid: "2517723745f74d85afa8cf2236144acc" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 38865 } }
I20260811 05:08:13.123883 7935 ts_tablet_manager.cc:1428] T 68e0c6b7058f4ba89c346dd366b74fd7 P 504756e7feb345afabee92c0deefa926: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 05:08:13.124163 7776 tablet_service.cc:1467] Processing CreateTablet for tablet 68e0c6b7058f4ba89c346dd366b74fd7 (DEFAULT_TABLE table=test-table [id=c880dc45b3a44df8b70293d3d0602832]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:08:13.124317 7776 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 68e0c6b7058f4ba89c346dd366b74fd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:08:13.124469 7938 tablet_bootstrap.cc:492] T 68e0c6b7058f4ba89c346dd366b74fd7 P ad5f93824f4041b0a3c2b68164a07c41: No bootstrap required, opened a new log
I20260811 05:08:13.124531 7938 ts_tablet_manager.cc:1397] T 68e0c6b7058f4ba89c346dd366b74fd7 P ad5f93824f4041b0a3c2b68164a07c41: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260811 05:08:13.124677 7938 raft_consensus.cc:348] T 68e0c6b7058f4ba89c346dd366b74fd7 P ad5f93824f4041b0a3c2b68164a07c41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad5f93824f4041b0a3c2b68164a07c41" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 34179 } } peers { permanent_uuid: "504756e7feb345afabee92c0deefa926" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 41189 } } peers { permanent_uuid: "2517723745f74d85afa8cf2236144acc" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 38865 } }
I20260811 05:08:13.124796 7938 raft_consensus.cc:374] T 68e0c6b7058f4ba89c346dd366b74fd7 P ad5f93824f4041b0a3c2b68164a07c41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:08:13.124828 7938 raft_consensus.cc:729] T 68e0c6b7058f4ba89c346dd366b74fd7 P ad5f93824f4041b0a3c2b68164a07c41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad5f93824f4041b0a3c2b68164a07c41, State: Initialized, Role: FOLLOWER
I20260811 05:08:13.124869 7938 consensus_queue.cc:260] T 68e0c6b7058f4ba89c346dd366b74fd7 P ad5f93824f4041b0a3c2b68164a07c41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad5f93824f4041b0a3c2b68164a07c41" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 34179 } } peers { permanent_uuid: "504756e7feb345afabee92c0deefa926" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 41189 } } peers { permanent_uuid: "2517723745f74d85afa8cf2236144acc" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 38865 } }
I20260811 05:08:13.124964 7938 ts_tablet_manager.cc:1428] T 68e0c6b7058f4ba89c346dd366b74fd7 P ad5f93824f4041b0a3c2b68164a07c41: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260811 05:08:13.125746 7937 tablet_bootstrap.cc:492] T 68e0c6b7058f4ba89c346dd366b74fd7 P 2517723745f74d85afa8cf2236144acc: Bootstrap starting.
I20260811 05:08:13.126076 7937 tablet_bootstrap.cc:654] T 68e0c6b7058f4ba89c346dd366b74fd7 P 2517723745f74d85afa8cf2236144acc: Neither blocks nor log segments found. Creating new log.
I20260811 05:08:13.126720 7937 tablet_bootstrap.cc:492] T 68e0c6b7058f4ba89c346dd366b74fd7 P 2517723745f74d85afa8cf2236144acc: No bootstrap required, opened a new log
I20260811 05:08:13.126792 7937 ts_tablet_manager.cc:1397] T 68e0c6b7058f4ba89c346dd366b74fd7 P 2517723745f74d85afa8cf2236144acc: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260811 05:08:13.126905 7937 raft_consensus.cc:348] T 68e0c6b7058f4ba89c346dd366b74fd7 P 2517723745f74d85afa8cf2236144acc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad5f93824f4041b0a3c2b68164a07c41" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 34179 } } peers { permanent_uuid: "504756e7feb345afabee92c0deefa926" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 41189 } } peers { permanent_uuid: "2517723745f74d85afa8cf2236144acc" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 38865 } }
I20260811 05:08:13.126993 7937 raft_consensus.cc:374] T 68e0c6b7058f4ba89c346dd366b74fd7 P 2517723745f74d85afa8cf2236144acc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:08:13.127030 7937 raft_consensus.cc:729] T 68e0c6b7058f4ba89c346dd366b74fd7 P 2517723745f74d85afa8cf2236144acc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2517723745f74d85afa8cf2236144acc, State: Initialized, Role: FOLLOWER
I20260811 05:08:13.127084 7937 consensus_queue.cc:260] T 68e0c6b7058f4ba89c346dd366b74fd7 P 2517723745f74d85afa8cf2236144acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad5f93824f4041b0a3c2b68164a07c41" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 34179 } } peers { permanent_uuid: "504756e7feb345afabee92c0deefa926" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 41189 } } peers { permanent_uuid: "2517723745f74d85afa8cf2236144acc" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 38865 } }
I20260811 05:08:13.127187 7937 ts_tablet_manager.cc:1428] T 68e0c6b7058f4ba89c346dd366b74fd7 P 2517723745f74d85afa8cf2236144acc: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:13.176983 7946 raft_consensus.cc:482] T 68e0c6b7058f4ba89c346dd366b74fd7 P ad5f93824f4041b0a3c2b68164a07c41 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 05:08:13.177129 7946 raft_consensus.cc:504] T 68e0c6b7058f4ba89c346dd366b74fd7 P ad5f93824f4041b0a3c2b68164a07c41 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad5f93824f4041b0a3c2b68164a07c41" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 34179 } } peers { permanent_uuid: "504756e7feb345afabee92c0deefa926" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 41189 } } peers { permanent_uuid: "2517723745f74d85afa8cf2236144acc" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 38865 } }
I20260811 05:08:13.177577 7946 leader_election.cc:288] T 68e0c6b7058f4ba89c346dd366b74fd7 P ad5f93824f4041b0a3c2b68164a07c41 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 504756e7feb345afabee92c0deefa926 (127.26.191.194:41189), 2517723745f74d85afa8cf2236144acc (127.26.191.195:38865)
I20260811 05:08:13.181288 7933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:13.177969 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.193:54953 (local address 127.26.191.195:38865)
0811 05:08:13.178014 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:13.178016 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:13.178026 (+ 10us) server_negotiation.cc:407] Connection header received
0811 05:08:13.178117 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:13.178119 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:13.178130 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:13.178168 (+ 38us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:08:13.178441 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:13.179207 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:13.180436 (+ 1229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:13.180917 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:13.180993 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:13.181003 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:13.181180 (+ 177us) server_negotiation.cc:299] Negotiation successful
0811 05:08:13.181217 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 05:08:13.181315 8064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:13.177763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.195:38865 (local address 127.26.191.193:54953)
0811 05:08:13.177957 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:13.177967 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:13.178017 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:13.178255 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:13.178256 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:13.178257 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:08:13.178358 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:13.178360 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:13.179318 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:13.179319 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:13.180342 (+ 1023us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:13.180346 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:13.181022 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:13.181024 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:13.181097 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:13.181102 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 05:08:13.181165 (+ 63us) client_negotiation.cc:240] Negotiation successful
0811 05:08:13.181205 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":177,"mutex_wait_us":3,"thread_start_us":106,"threads_started":1}
I20260811 05:08:13.181623 7808 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "68e0c6b7058f4ba89c346dd366b74fd7" candidate_uuid: "ad5f93824f4041b0a3c2b68164a07c41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2517723745f74d85afa8cf2236144acc" is_pre_election: true
I20260811 05:08:13.181711 7808 raft_consensus.cc:2454] T 68e0c6b7058f4ba89c346dd366b74fd7 P 2517723745f74d85afa8cf2236144acc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad5f93824f4041b0a3c2b68164a07c41 in term 0.
I20260811 05:08:13.181869 7931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:13.177817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.193:53011 (local address 127.26.191.194:41189)
0811 05:08:13.177871 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:13.177873 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:13.178004 (+ 131us) server_negotiation.cc:407] Connection header received
0811 05:08:13.178144 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:13.178146 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:13.178164 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:13.178235 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:08:13.178925 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:13.179476 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:13.180895 (+ 1419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:13.181442 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:13.181532 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:13.181542 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:13.181742 (+ 200us) server_negotiation.cc:299] Negotiation successful
0811 05:08:13.181800 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 05:08:13.181914 7246 leader_election.cc:302] T 68e0c6b7058f4ba89c346dd366b74fd7 P ad5f93824f4041b0a3c2b68164a07c41 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2517723745f74d85afa8cf2236144acc, ad5f93824f4041b0a3c2b68164a07c41; no voters:
I20260811 05:08:13.182077 8062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:13.177759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.194:41189 (local address 127.26.191.193:53011)
0811 05:08:13.177926 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:13.177940 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:13.178027 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:13.178253 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:13.178254 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:13.178256 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:08:13.178370 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:13.178372 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:13.179613 (+ 1241us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:13.179614 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:13.180795 (+ 1181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:13.180799 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:13.181531 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:13.181532 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:13.181604 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:13.181608 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 05:08:13.181957 (+ 349us) client_negotiation.cc:240] Negotiation successful
0811 05:08:13.182001 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"mutex_wait_us":2,"thread_start_us":85,"threads_started":1}
I20260811 05:08:13.182097 7946 raft_consensus.cc:2781] T 68e0c6b7058f4ba89c346dd366b74fd7 P ad5f93824f4041b0a3c2b68164a07c41 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 05:08:13.182132 7946 raft_consensus.cc:482] T 68e0c6b7058f4ba89c346dd366b74fd7 P ad5f93824f4041b0a3c2b68164a07c41 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 05:08:13.182155 7946 raft_consensus.cc:3037] T 68e0c6b7058f4ba89c346dd366b74fd7 P ad5f93824f4041b0a3c2b68164a07c41 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:08:13.182446 7597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "68e0c6b7058f4ba89c346dd366b74fd7" candidate_uuid: "ad5f93824f4041b0a3c2b68164a07c41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "504756e7feb345afabee92c0deefa926" is_pre_election: true
I20260811 05:08:13.182546 7597 raft_consensus.cc:2454] T 68e0c6b7058f4ba89c346dd366b74fd7 P 504756e7feb345afabee92c0deefa926 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad5f93824f4041b0a3c2b68164a07c41 in term 0.
I20260811 05:08:13.183167 7946 raft_consensus.cc:504] T 68e0c6b7058f4ba89c346dd366b74fd7 P ad5f93824f4041b0a3c2b68164a07c41 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad5f93824f4041b0a3c2b68164a07c41" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 34179 } } peers { permanent_uuid: "504756e7feb345afabee92c0deefa926" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 41189 } } peers { permanent_uuid: "2517723745f74d85afa8cf2236144acc" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 38865 } }
I20260811 05:08:13.183357 7946 leader_election.cc:288] T 68e0c6b7058f4ba89c346dd366b74fd7 P ad5f93824f4041b0a3c2b68164a07c41 [CANDIDATE]: Term 1 election: Requested vote from peers 504756e7feb345afabee92c0deefa926 (127.26.191.194:41189), 2517723745f74d85afa8cf2236144acc (127.26.191.195:38865)
I20260811 05:08:13.183591 7597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "68e0c6b7058f4ba89c346dd366b74fd7" candidate_uuid: "ad5f93824f4041b0a3c2b68164a07c41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "504756e7feb345afabee92c0deefa926"
I20260811 05:08:13.183611 7808 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "68e0c6b7058f4ba89c346dd366b74fd7" candidate_uuid: "ad5f93824f4041b0a3c2b68164a07c41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2517723745f74d85afa8cf2236144acc"
I20260811 05:08:13.183676 7808 raft_consensus.cc:3037] T 68e0c6b7058f4ba89c346dd366b74fd7 P 2517723745f74d85afa8cf2236144acc [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:08:13.183676 7597 raft_consensus.cc:3037] T 68e0c6b7058f4ba89c346dd366b74fd7 P 504756e7feb345afabee92c0deefa926 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:08:13.184405 7597 raft_consensus.cc:2454] T 68e0c6b7058f4ba89c346dd366b74fd7 P 504756e7feb345afabee92c0deefa926 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad5f93824f4041b0a3c2b68164a07c41 in term 1.
I20260811 05:08:13.184406 7808 raft_consensus.cc:2454] T 68e0c6b7058f4ba89c346dd366b74fd7 P 2517723745f74d85afa8cf2236144acc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad5f93824f4041b0a3c2b68164a07c41 in term 1.
I20260811 05:08:13.184582 7246 leader_election.cc:302] T 68e0c6b7058f4ba89c346dd366b74fd7 P ad5f93824f4041b0a3c2b68164a07c41 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2517723745f74d85afa8cf2236144acc, ad5f93824f4041b0a3c2b68164a07c41; no voters:
I20260811 05:08:13.184675 7946 raft_consensus.cc:2781] T 68e0c6b7058f4ba89c346dd366b74fd7 P ad5f93824f4041b0a3c2b68164a07c41 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:08:13.184868 7946 raft_consensus.cc:686] T 68e0c6b7058f4ba89c346dd366b74fd7 P ad5f93824f4041b0a3c2b68164a07c41 [term 1 LEADER]: Becoming Leader. State: Replica: ad5f93824f4041b0a3c2b68164a07c41, State: Running, Role: LEADER
I20260811 05:08:13.184952 7946 consensus_queue.cc:237] T 68e0c6b7058f4ba89c346dd366b74fd7 P ad5f93824f4041b0a3c2b68164a07c41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad5f93824f4041b0a3c2b68164a07c41" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 34179 } } peers { permanent_uuid: "504756e7feb345afabee92c0deefa926" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 41189 } } peers { permanent_uuid: "2517723745f74d85afa8cf2236144acc" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 38865 } }
I20260811 05:08:13.185719 7099 catalog_manager.cc:5495] T 68e0c6b7058f4ba89c346dd366b74fd7 P ad5f93824f4041b0a3c2b68164a07c41 reported cstate change: term changed from 0 to 1, leader changed from <none> to ad5f93824f4041b0a3c2b68164a07c41 (127.26.191.193). New cstate: current_term: 1 leader_uuid: "ad5f93824f4041b0a3c2b68164a07c41" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad5f93824f4041b0a3c2b68164a07c41" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 34179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "504756e7feb345afabee92c0deefa926" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 41189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2517723745f74d85afa8cf2236144acc" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 38865 } health_report { overall_health: UNKNOWN } } }
I20260811 05:08:13.205754 7932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:13.202941 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34756 (local address 127.26.191.193:34179)
0811 05:08:13.203002 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:13.203004 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:13.203031 (+ 27us) server_negotiation.cc:407] Connection header received
0811 05:08:13.203124 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:13.203125 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:13.203148 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:13.203269 (+ 121us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:08:13.203361 (+ 92us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:13.203901 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:13.204964 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:13.205151 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:13.205213 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:13.205382 (+ 169us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:08:13.205496 (+ 114us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:08:13.205555 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:13.205623 (+ 68us) server_negotiation.cc:299] Negotiation successful
0811 05:08:13.205645 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 05:08:13.211247 8073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:13.208482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.195:38865 (local address 127.26.191.193:39075)
0811 05:08:13.208703 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:13.208748 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:13.208833 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:13.208998 (+ 165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:13.208999 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:13.209000 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 05:08:13.209075 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:13.209077 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:13.209718 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:13.209719 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:13.210354 (+ 635us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:13.210356 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:13.210720 (+ 364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:13.210721 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:13.210796 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:13.210820 (+ 24us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 05:08:13.211031 (+ 211us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 05:08:13.211034 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 05:08:13.211077 (+ 43us) client_negotiation.cc:240] Negotiation successful
0811 05:08:13.211126 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":83,"threads_started":1}
I20260811 05:08:13.211206 7933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:13.208588 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.193:39075 (local address 127.26.191.195:38865)
0811 05:08:13.208636 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:13.208638 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:13.208819 (+ 181us) server_negotiation.cc:407] Connection header received
0811 05:08:13.208891 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:13.208892 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:13.208906 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:13.208993 (+ 87us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:08:13.209158 (+ 165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:13.209632 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:13.210450 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:13.210642 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:13.210721 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:13.210937 (+ 216us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:08:13.210968 (+ 31us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:08:13.211030 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:13.211090 (+ 60us) server_negotiation.cc:299] Negotiation successful
0811 05:08:13.211112 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 05:08:13.213392 7808 raft_consensus.cc:1261] T 68e0c6b7058f4ba89c346dd366b74fd7 P 2517723745f74d85afa8cf2236144acc [term 1 FOLLOWER]: Refusing update from remote peer ad5f93824f4041b0a3c2b68164a07c41: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:08:13.213581 7597 raft_consensus.cc:1261] T 68e0c6b7058f4ba89c346dd366b74fd7 P 504756e7feb345afabee92c0deefa926 [term 1 FOLLOWER]: Refusing update from remote peer ad5f93824f4041b0a3c2b68164a07c41: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:08:13.213713 8068 consensus_queue.cc:1035] T 68e0c6b7058f4ba89c346dd366b74fd7 P ad5f93824f4041b0a3c2b68164a07c41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2517723745f74d85afa8cf2236144acc" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 38865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:08:13.213840 7946 consensus_queue.cc:1035] T 68e0c6b7058f4ba89c346dd366b74fd7 P ad5f93824f4041b0a3c2b68164a07c41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "504756e7feb345afabee92c0deefa926" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 41189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:08:13.221859 7932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:13.219446 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.195:49723 (local address 127.26.191.193:34179)
0811 05:08:13.219483 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:13.219485 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:13.219493 (+ 8us) server_negotiation.cc:407] Connection header received
0811 05:08:13.219569 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:13.219570 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:13.219582 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:13.219632 (+ 50us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:08:13.219790 (+ 158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:13.220300 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:13.221107 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:13.221395 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:13.221462 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:13.221597 (+ 135us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:08:13.221638 (+ 41us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:08:13.221686 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:13.221759 (+ 73us) server_negotiation.cc:299] Negotiation successful
0811 05:08:13.221782 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 05:08:13.221876 7903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:13.219398 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.193:34179 (local address 127.26.191.195:49723)
0811 05:08:13.219436 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:13.219447 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:13.219484 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:13.219677 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:13.219678 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:13.219679 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 05:08:13.219736 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:13.219738 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:13.220392 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:13.220393 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:13.221021 (+ 628us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:13.221023 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:13.221460 (+ 437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:13.221461 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:13.221519 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:13.221525 (+ 6us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 05:08:13.221688 (+ 163us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 05:08:13.221690 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 05:08:13.221756 (+ 66us) client_negotiation.cc:240] Negotiation successful
0811 05:08:13.221803 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17}
I20260811 05:08:13.231200 7099 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48122:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:08:13.231328 7099 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48122:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:08:13.231998 7099 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a24399409f294f0f8815ab9516c10f81: Sending DeleteTablet for 3 replicas of tablet 68e0c6b7058f4ba89c346dd366b74fd7
I20260811 05:08:13.232257 7776 tablet_service.cc:1514] Processing DeleteTablet for tablet 68e0c6b7058f4ba89c346dd366b74fd7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:08:13 UTC) from {username='oryx', principal='oryx/127.26.191.254@KRBTEST.COM'} at 127.0.0.1:46706
I20260811 05:08:13.232360 7970 tablet_replica.cc:330] T 68e0c6b7058f4ba89c346dd366b74fd7 P 2517723745f74d85afa8cf2236144acc: stopping tablet replica
I20260811 05:08:13.232403 7970 raft_consensus.cc:2229] T 68e0c6b7058f4ba89c346dd366b74fd7 P 2517723745f74d85afa8cf2236144acc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 05:08:13.232391 7331 tablet_service.cc:1514] Processing DeleteTablet for tablet 68e0c6b7058f4ba89c346dd366b74fd7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:08:13 UTC) from {username='oryx', principal='oryx/127.26.191.254@KRBTEST.COM'} at 127.0.0.1:34744
I20260811 05:08:13.232456 7970 raft_consensus.cc:2258] T 68e0c6b7058f4ba89c346dd366b74fd7 P 2517723745f74d85afa8cf2236144acc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:08:13.232527 7968 tablet_replica.cc:330] T 68e0c6b7058f4ba89c346dd366b74fd7 P ad5f93824f4041b0a3c2b68164a07c41: stopping tablet replica
I20260811 05:08:13.232583 7968 raft_consensus.cc:2229] T 68e0c6b7058f4ba89c346dd366b74fd7 P ad5f93824f4041b0a3c2b68164a07c41 [term 1 LEADER]: Raft consensus shutting down.
I20260811 05:08:13.232671 7968 raft_consensus.cc:2258] T 68e0c6b7058f4ba89c346dd366b74fd7 P ad5f93824f4041b0a3c2b68164a07c41 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:08:13.233052 7570 tablet_service.cc:1514] Processing DeleteTablet for tablet 68e0c6b7058f4ba89c346dd366b74fd7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:08:13 UTC) from {username='oryx', principal='oryx/127.26.191.254@KRBTEST.COM'} at 127.0.0.1:35070
I20260811 05:08:13.233145 7971 tablet_replica.cc:330] T 68e0c6b7058f4ba89c346dd366b74fd7 P 504756e7feb345afabee92c0deefa926: stopping tablet replica
I20260811 05:08:13.233193 7971 raft_consensus.cc:2229] T 68e0c6b7058f4ba89c346dd366b74fd7 P 504756e7feb345afabee92c0deefa926 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 05:08:13.233214 7970 ts_tablet_manager.cc:1905] T 68e0c6b7058f4ba89c346dd366b74fd7 P 2517723745f74d85afa8cf2236144acc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:08:13.233239 7971 raft_consensus.cc:2258] T 68e0c6b7058f4ba89c346dd366b74fd7 P 504756e7feb345afabee92c0deefa926 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:08:13.233583 7968 ts_tablet_manager.cc:1905] T 68e0c6b7058f4ba89c346dd366b74fd7 P ad5f93824f4041b0a3c2b68164a07c41: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:08:13.234675 7970 ts_tablet_manager.cc:1918] T 68e0c6b7058f4ba89c346dd366b74fd7 P 2517723745f74d85afa8cf2236144acc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 05:08:13.234735 7970 log.cc:1196] T 68e0c6b7058f4ba89c346dd366b74fd7 P 2517723745f74d85afa8cf2236144acc: Deleting WAL directory at /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/minicluster-data/ts-2/wal/wals/68e0c6b7058f4ba89c346dd366b74fd7
I20260811 05:08:13.234959 7970 ts_tablet_manager.cc:1939] T 68e0c6b7058f4ba89c346dd366b74fd7 P 2517723745f74d85afa8cf2236144acc: Deleting consensus metadata
I20260811 05:08:13.235112 7968 ts_tablet_manager.cc:1918] T 68e0c6b7058f4ba89c346dd366b74fd7 P ad5f93824f4041b0a3c2b68164a07c41: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 05:08:13.235172 7968 log.cc:1196] T 68e0c6b7058f4ba89c346dd366b74fd7 P ad5f93824f4041b0a3c2b68164a07c41: Deleting WAL directory at /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/minicluster-data/ts-0/wal/wals/68e0c6b7058f4ba89c346dd366b74fd7
I20260811 05:08:13.235348 7080 catalog_manager.cc:4841] TS 2517723745f74d85afa8cf2236144acc (127.26.191.195:38865): tablet 68e0c6b7058f4ba89c346dd366b74fd7 (table test-table [id=c880dc45b3a44df8b70293d3d0602832]) successfully deleted
I20260811 05:08:13.235402 7968 ts_tablet_manager.cc:1939] T 68e0c6b7058f4ba89c346dd366b74fd7 P ad5f93824f4041b0a3c2b68164a07c41: Deleting consensus metadata
I20260811 05:08:13.235724 7079 catalog_manager.cc:4841] TS ad5f93824f4041b0a3c2b68164a07c41 (127.26.191.193:34179): tablet 68e0c6b7058f4ba89c346dd366b74fd7 (table test-table [id=c880dc45b3a44df8b70293d3d0602832]) successfully deleted
I20260811 05:08:13.235980 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 7221
I20260811 05:08:13.249107 7971 ts_tablet_manager.cc:1905] T 68e0c6b7058f4ba89c346dd366b74fd7 P 504756e7feb345afabee92c0deefa926: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:08:13.250579 7971 ts_tablet_manager.cc:1918] T 68e0c6b7058f4ba89c346dd366b74fd7 P 504756e7feb345afabee92c0deefa926: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 05:08:13.250639 7971 log.cc:1196] T 68e0c6b7058f4ba89c346dd366b74fd7 P 504756e7feb345afabee92c0deefa926: Deleting WAL directory at /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424853995437-27391-0/minicluster-data/ts-1/wal/wals/68e0c6b7058f4ba89c346dd366b74fd7
I20260811 05:08:13.250865 7971 ts_tablet_manager.cc:1939] T 68e0c6b7058f4ba89c346dd366b74fd7 P 504756e7feb345afabee92c0deefa926: Deleting consensus metadata
I20260811 05:08:13.251561 7074 catalog_manager.cc:4841] TS 504756e7feb345afabee92c0deefa926 (127.26.191.194:41189): tablet 68e0c6b7058f4ba89c346dd366b74fd7 (table test-table [id=c880dc45b3a44df8b70293d3d0602832]) successfully deleted
I20260811 05:08:13.252975 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 7455
I20260811 05:08:13.269331 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 7678
I20260811 05:08:13.287089 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 7044
2026-08-11T05:08:13Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (2879 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786424853995437-27391-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 05:08:13 dist-test-slave-x5fp krb5kdc[8086](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 05:08:13 dist-test-slave-x5fp krb5kdc[8086](info): set up 2 sockets
Aug 11 05:08:13 dist-test-slave-x5fp krb5kdc[8086](info): commencing operation
krb5kdc: starting...
W20260811 05:08:14.589262 27391 mini_kdc.cc:121] Time spent starting KDC: real 1.275s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786424853995437-27391-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786424853995437-27391-0/krb5kdc/test-user.keytab.
Aug 11 05:08:14 dist-test-slave-x5fp krb5kdc[8086](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424894, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T05:08:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:08:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.191.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.191.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.191.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab.
Entry for principal kudu/127.26.191.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab.
I20260811 05:08:14.727870 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786424853995437-27391-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786424853995437-27391-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786424853995437-27391-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.254:34409
--webserver_interface=127.26.191.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab
--principal=kudu/127.26.191.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:42667
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.191.254:34409
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:08:14.817967 8110 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:08:14.818212 8110 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:08:14.818238 8110 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:08:14.819597 8110 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:08:14.819653 8110 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:08:14.819669 8110 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:08:14.819682 8110 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:08:14.819694 8110 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:08:14.821353 8110 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:42667
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786424853995437-27391-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786424853995437-27391-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.191.254:34409
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.254:34409
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.191.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8110
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786424853995437-27391-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:08:14.821651 8110 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:08:14.821930 8110 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:08:14.827486 8119 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:14.827486 8122 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:14.827504 8120 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:08:14.827986 8110 server_base.cc:1034] running on GCE node
I20260811 05:08:14.828241 8110 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:08:14.828512 8110 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:08:14.829668 8110 hybrid_clock.cc:648] HybridClock initialized: now 1786424894829641 us; error 53 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-11T05:08:14Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1543 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 05:08:14 dist-test-slave-x5fp krb5kdc[8131](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 05:08:14 dist-test-slave-x5fp krb5kdc[8131](info): set up 2 sockets
Aug 11 05:08:14 dist-test-slave-x5fp krb5kdc[8131](info): commencing operation
krb5kdc: starting...
W20260811 05:08:16.099013 27391 mini_kdc.cc:121] Time spent starting KDC: real 1.241s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/krb5kdc/test-user.keytab.
Aug 11 05:08:16 dist-test-slave-x5fp krb5kdc[8131](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424896, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T05:08:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:08:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.191.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.191.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.191.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab.
Entry for principal kudu/127.26.191.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab.
I20260811 05:08:16.233786 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.254:39591
--webserver_interface=127.26.191.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab
--principal=kudu/127.26.191.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:38787
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.191.254:39591
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:08:16.324147 8153 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:08:16.324433 8153 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:08:16.324476 8153 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:08:16.325699 8153 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:08:16.325774 8153 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:08:16.325800 8153 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:08:16.325824 8153 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:08:16.325851 8153 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:08:16.327445 8153 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:38787
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.191.254:39591
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab
--principal=kudu/127.26.191.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.254:39591
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.191.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8153
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:08:16.327768 8153 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:08:16.328022 8153 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:08:16.333441 8160 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:16.333455 8159 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:16.333446 8163 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:08:16.333946 8153 server_base.cc:1034] running on GCE node
I20260811 05:08:16.334300 8153 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:08:16.334638 8153 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:08:16.335875 8153 hybrid_clock.cc:648] HybridClock initialized: now 1786424896335858 us; error 33 us; skew 500 ppm
Aug 11 05:08:16 dist-test-slave-x5fp krb5kdc[8131](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424896, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:08:16.339099 8153 init.cc:377] Logged in from keytab as kudu/127.26.191.254@KRBTEST.COM (short username kudu)
I20260811 05:08:16.339653 8153 webserver.cc:460] Webserver started at http://127.26.191.254:35485/ using document root <none> and password file <none>
I20260811 05:08:16.339910 8153 fs_manager.cc:359] Metadata directory not provided
I20260811 05:08:16.339986 8153 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:08:16.340147 8153 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:08:16.341365 8153 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/master-0/data/instance:
uuid: "6a2089c3ca5946e681ebd0d619c76c59"
format_stamp: "Formatted at 2026-08-11 05:08:16 on dist-test-slave-x5fp"
server_key: "9064b8612eda8ed3839a8e747a994d00"
server_key_iv: "d3434d73b13e77334e655388b531ffda"
server_key_version: "encryptionkey@0"
I20260811 05:08:16.341763 8153 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/master-0/wal/instance:
uuid: "6a2089c3ca5946e681ebd0d619c76c59"
format_stamp: "Formatted at 2026-08-11 05:08:16 on dist-test-slave-x5fp"
server_key: "9064b8612eda8ed3839a8e747a994d00"
server_key_iv: "d3434d73b13e77334e655388b531ffda"
server_key_version: "encryptionkey@0"
I20260811 05:08:16.343278 8153 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 05:08:16.344262 8172 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:16.344507 8153 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:08:16.344632 8153 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/master-0/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/master-0/wal
uuid: "6a2089c3ca5946e681ebd0d619c76c59"
format_stamp: "Formatted at 2026-08-11 05:08:16 on dist-test-slave-x5fp"
server_key: "9064b8612eda8ed3839a8e747a994d00"
server_key_iv: "d3434d73b13e77334e655388b531ffda"
server_key_version: "encryptionkey@0"
I20260811 05:08:16.344718 8153 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:08:16.357398 8153 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:08:16.359879 8153 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:08:16.360055 8153 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:08:16.364522 8153 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.254:39591
I20260811 05:08:16.364573 8264 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.254:39591 every 8 connection(s)
I20260811 05:08:16.365008 8153 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
I20260811 05:08:16.365958 8265 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:08:16.368381 8265 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6a2089c3ca5946e681ebd0d619c76c59: Bootstrap starting.
I20260811 05:08:16.369091 8265 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6a2089c3ca5946e681ebd0d619c76c59: Neither blocks nor log segments found. Creating new log.
I20260811 05:08:16.369414 8265 log.cc:824] T 00000000000000000000000000000000 P 6a2089c3ca5946e681ebd0d619c76c59: Log is configured to *not* fsync() on all Append() calls
I20260811 05:08:16.370203 8265 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6a2089c3ca5946e681ebd0d619c76c59: No bootstrap required, opened a new log
I20260811 05:08:16.370621 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 8153
I20260811 05:08:16.370800 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/master-0/wal/instance
I20260811 05:08:16.371017 27391 external_mini_cluster.cc:1428] Setting key ba4e924b04f0a4f9a9b0a45e50b3672a
I20260811 05:08:16.372682 8265 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6a2089c3ca5946e681ebd0d619c76c59 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a2089c3ca5946e681ebd0d619c76c59" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 39591 } }
I20260811 05:08:16.372898 8265 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6a2089c3ca5946e681ebd0d619c76c59 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:08:16.372941 8265 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6a2089c3ca5946e681ebd0d619c76c59 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a2089c3ca5946e681ebd0d619c76c59, State: Initialized, Role: FOLLOWER
I20260811 05:08:16.373078 8265 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6a2089c3ca5946e681ebd0d619c76c59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a2089c3ca5946e681ebd0d619c76c59" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 39591 } }
I20260811 05:08:16.373186 8265 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6a2089c3ca5946e681ebd0d619c76c59 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:08:16.373234 8265 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6a2089c3ca5946e681ebd0d619c76c59 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:08:16.373284 8265 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6a2089c3ca5946e681ebd0d619c76c59 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:08:16.374469 8265 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6a2089c3ca5946e681ebd0d619c76c59 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a2089c3ca5946e681ebd0d619c76c59" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 39591 } }
I20260811 05:08:16.374595 8265 leader_election.cc:302] T 00000000000000000000000000000000 P 6a2089c3ca5946e681ebd0d619c76c59 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6a2089c3ca5946e681ebd0d619c76c59; no voters:
I20260811 05:08:16.374760 8265 leader_election.cc:288] T 00000000000000000000000000000000 P 6a2089c3ca5946e681ebd0d619c76c59 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 05:08:16.374984 8271 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6a2089c3ca5946e681ebd0d619c76c59 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:08:16.375036 8265 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6a2089c3ca5946e681ebd0d619c76c59 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:08:16.375221 8271 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6a2089c3ca5946e681ebd0d619c76c59 [term 1 LEADER]: Becoming Leader. State: Replica: 6a2089c3ca5946e681ebd0d619c76c59, State: Running, Role: LEADER
I20260811 05:08:16.375411 8271 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6a2089c3ca5946e681ebd0d619c76c59 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a2089c3ca5946e681ebd0d619c76c59" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 39591 } }
I20260811 05:08:16.376376 8272 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6a2089c3ca5946e681ebd0d619c76c59 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6a2089c3ca5946e681ebd0d619c76c59" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a2089c3ca5946e681ebd0d619c76c59" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 39591 } } }
I20260811 05:08:16.376497 8272 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6a2089c3ca5946e681ebd0d619c76c59 [sys.catalog]: This master's current role is: LEADER
I20260811 05:08:16.376387 8273 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6a2089c3ca5946e681ebd0d619c76c59 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6a2089c3ca5946e681ebd0d619c76c59. Latest consensus state: current_term: 1 leader_uuid: "6a2089c3ca5946e681ebd0d619c76c59" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a2089c3ca5946e681ebd0d619c76c59" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 39591 } } }
I20260811 05:08:16.376612 8273 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6a2089c3ca5946e681ebd0d619c76c59 [sys.catalog]: This master's current role is: LEADER
I20260811 05:08:16.376801 8282 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:08:16.377472 8282 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:08:16.379324 8282 catalog_manager.cc:1347] Generated new cluster ID: 42fad7ca5887422db40e58e00ee03554
I20260811 05:08:16.379383 8282 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 05:08:16 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424896, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
I20260811 05:08:16.385087 8270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:16.371671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35648 (local address 127.26.191.254:39591)
0811 05:08:16.371949 (+ 278us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:16.371960 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:16.371996 (+ 36us) server_negotiation.cc:407] Connection header received
0811 05:08:16.372639 (+ 643us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:16.372650 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:16.372753 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:16.372925 (+ 172us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:16.373861 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:16.375350 (+ 1489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:16.376502 (+ 1152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:16.377222 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:16.380095 (+ 2873us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:16.380572 (+ 477us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:16.380577 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:16.380578 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:08:16.380590 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:16.383021 (+ 2431us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:16.383487 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:16.383491 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:16.383491 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:16.383630 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:16.383861 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:16.383862 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:16.383862 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:16.384244 (+ 382us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:16.384411 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:16.384542 (+ 131us) server_negotiation.cc:299] Negotiation successful
0811 05:08:16.384763 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":221,"thread_start_us":141,"threads_started":1}
I20260811 05:08:16.408429 8282 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:08:16.409276 8282 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:08:16.419014 8282 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6a2089c3ca5946e681ebd0d619c76c59: Generated new TSK 0
I20260811 05:08:16.419248 8282 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.191.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.191.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.191.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.193.keytab.
Entry for principal kudu/127.26.191.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.193.keytab.
I20260811 05:08:16.456497 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.191.193:0
--local_ip_for_outbound_sockets=127.26.191.193
--webserver_interface=127.26.191.193
--webserver_port=0
--tserver_master_addrs=127.26.191.254:39591
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.193.keytab
--principal=kudu/127.26.191.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:38787
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:08:16.546854 8302 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:08:16.547094 8302 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:08:16.547122 8302 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:08:16.548581 8302 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:08:16.548676 8302 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:08:16.548782 8302 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.191.193
I20260811 05:08:16.550319 8302 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:38787
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.193.keytab
--principal=kudu/127.26.191.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.191.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.191.193
--webserver_port=0
--tserver_master_addrs=127.26.191.254:39591
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8302
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.191.193
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:08:16.550518 8302 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:08:16.550709 8302 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:08:16.556030 8315 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:16.556049 8309 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:16.556066 8311 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:08:16.556269 8302 server_base.cc:1034] running on GCE node
I20260811 05:08:16.556648 8302 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:08:16.556955 8302 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:08:16.558108 8302 hybrid_clock.cc:648] HybridClock initialized: now 1786424896558097 us; error 33 us; skew 500 ppm
Aug 11 05:08:16 dist-test-slave-x5fp krb5kdc[8131](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424896, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:08:16.560998 8302 init.cc:377] Logged in from keytab as kudu/127.26.191.193@KRBTEST.COM (short username kudu)
I20260811 05:08:16.561523 8302 webserver.cc:460] Webserver started at http://127.26.191.193:42597/ using document root <none> and password file <none>
I20260811 05:08:16.561789 8302 fs_manager.cc:359] Metadata directory not provided
I20260811 05:08:16.561849 8302 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:08:16.562150 8302 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:08:16.563488 8302 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/ts-0/data/instance:
uuid: "457ee76c9f12454e9f99f08989c6e38a"
format_stamp: "Formatted at 2026-08-11 05:08:16 on dist-test-slave-x5fp"
server_key: "1bba63d8304b0d06108cf0c3ad3ae9a9"
server_key_iv: "793004aa19322c42cb96adfcf091e12d"
server_key_version: "encryptionkey@0"
I20260811 05:08:16.563874 8302 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/ts-0/wal/instance:
uuid: "457ee76c9f12454e9f99f08989c6e38a"
format_stamp: "Formatted at 2026-08-11 05:08:16 on dist-test-slave-x5fp"
server_key: "1bba63d8304b0d06108cf0c3ad3ae9a9"
server_key_iv: "793004aa19322c42cb96adfcf091e12d"
server_key_version: "encryptionkey@0"
I20260811 05:08:16.565412 8302 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.004s sys 0.000s
I20260811 05:08:16.566305 8330 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:16.566525 8302 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:08:16.566648 8302 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/ts-0/wal
uuid: "457ee76c9f12454e9f99f08989c6e38a"
format_stamp: "Formatted at 2026-08-11 05:08:16 on dist-test-slave-x5fp"
server_key: "1bba63d8304b0d06108cf0c3ad3ae9a9"
server_key_iv: "793004aa19322c42cb96adfcf091e12d"
server_key_version: "encryptionkey@0"
I20260811 05:08:16.566733 8302 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:08:16.581405 8302 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:08:16.584196 8302 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:08:16.584437 8302 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:08:16.584851 8302 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:08:16.585245 8302 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:08:16.585312 8302 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:16.585363 8302 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:08:16.585393 8302 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:16.592494 8302 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.193:33501
I20260811 05:08:16.592547 8502 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.193:33501 every 8 connection(s)
I20260811 05:08:16.593025 8302 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/ts-0/data/info.pb
I20260811 05:08:16.593442 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 8302
I20260811 05:08:16.593550 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/ts-0/wal/instance
I20260811 05:08:16.593726 27391 external_mini_cluster.cc:1428] Setting key 319049f21a61272c3aa6dae98710c383
Aug 11 05:08:16 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424896, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.193@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.26.191.194@KRBTEST.COM; defaulting to no policy
I20260811 05:08:16.604900 8270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:16.593991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.193:48385 (local address 127.26.191.254:39591)
0811 05:08:16.594064 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:16.594066 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:16.594356 (+ 290us) server_negotiation.cc:407] Connection header received
0811 05:08:16.594994 (+ 638us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:16.594995 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:16.595014 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:16.595085 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:16.596146 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:16.596988 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:16.598403 (+ 1415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:16.598650 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:16.598770 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:16.601690 (+ 2920us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:16.601693 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:16.601693 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:08:16.601706 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:16.603286 (+ 1580us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:16.603778 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:16.603780 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:16.603780 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:16.603853 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:16.604137 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:16.604138 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:16.604138 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:16.604274 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:16.604347 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:16.604661 (+ 314us) server_negotiation.cc:299] Negotiation successful
0811 05:08:16.604801 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260811 05:08:16.605121 8507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:16.593987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:39591 (local address 127.26.191.193:48385)
0811 05:08:16.594191 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:16.594247 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:16.594863 (+ 616us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:16.595164 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:16.595168 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:16.595780 (+ 612us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:16.596030 (+ 250us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:16.596035 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:16.597099 (+ 1064us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:16.597101 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:16.598278 (+ 1177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:16.598282 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:16.598803 (+ 521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:16.598805 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:16.598983 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:16.599630 (+ 647us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:16.599641 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:16.601557 (+ 1916us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:08:16.603410 (+ 1853us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:16.603419 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:16.603422 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:16.603676 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:16.603931 (+ 255us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:16.603932 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:16.603933 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:16.604058 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:16.604349 (+ 291us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:08:16.604357 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:08:16.604518 (+ 161us) client_negotiation.cc:769] Sending connection context
0811 05:08:16.604636 (+ 118us) client_negotiation.cc:240] Negotiation successful
0811 05:08:16.604840 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":109,"threads_started":1}
I20260811 05:08:16.605706 8503 heartbeater.cc:347] Connected to a master server at 127.26.191.254:39591
I20260811 05:08:16.605813 8503 heartbeater.cc:464] Registering TS with master...
I20260811 05:08:16.606053 8503 heartbeater.cc:511] Master 127.26.191.254:39591 requested a full tablet report, sending...
I20260811 05:08:16.606698 8201 ts_manager.cc:194] Registered new tserver with Master: 457ee76c9f12454e9f99f08989c6e38a (127.26.191.193:33501)
I20260811 05:08:16.607448 8201 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.191.193@KRBTEST.COM'} at 127.26.191.193:48385
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.191.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.191.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.194.keytab.
Entry for principal kudu/127.26.191.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.194.keytab.
I20260811 05:08:16.626132 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.191.194:0
--local_ip_for_outbound_sockets=127.26.191.194
--webserver_interface=127.26.191.194
--webserver_port=0
--tserver_master_addrs=127.26.191.254:39591
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.194.keytab
--principal=kudu/127.26.191.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:38787
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:08:16.714102 8511 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:08:16.714359 8511 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:08:16.714399 8511 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:08:16.715596 8511 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:08:16.715672 8511 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:08:16.715718 8511 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.191.194
I20260811 05:08:16.717329 8511 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:38787
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.194.keytab
--principal=kudu/127.26.191.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.191.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.191.194
--webserver_port=0
--tserver_master_addrs=127.26.191.254:39591
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8511
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.191.194
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:08:16.717612 8511 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:08:16.717869 8511 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:08:16.723205 8519 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:16.723219 8520 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:16.723215 8525 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:08:16.723493 8511 server_base.cc:1034] running on GCE node
I20260811 05:08:16.723714 8511 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:08:16.724013 8511 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:08:16.725189 8511 hybrid_clock.cc:648] HybridClock initialized: now 1786424896725184 us; error 40 us; skew 500 ppm
Aug 11 05:08:16 dist-test-slave-x5fp krb5kdc[8131](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424896, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:08:16.727898 8511 init.cc:377] Logged in from keytab as kudu/127.26.191.194@KRBTEST.COM (short username kudu)
I20260811 05:08:16.728451 8511 webserver.cc:460] Webserver started at http://127.26.191.194:43693/ using document root <none> and password file <none>
I20260811 05:08:16.728695 8511 fs_manager.cc:359] Metadata directory not provided
I20260811 05:08:16.728801 8511 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:08:16.728960 8511 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:08:16.730101 8511 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/ts-1/data/instance:
uuid: "0f57f18ede044d5bafa0eb64034d544e"
format_stamp: "Formatted at 2026-08-11 05:08:16 on dist-test-slave-x5fp"
server_key: "91356e7315ee96204b3fa6230087210a"
server_key_iv: "0eb7d519cc598fe98fbe63362be182b1"
server_key_version: "encryptionkey@0"
I20260811 05:08:16.730499 8511 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/ts-1/wal/instance:
uuid: "0f57f18ede044d5bafa0eb64034d544e"
format_stamp: "Formatted at 2026-08-11 05:08:16 on dist-test-slave-x5fp"
server_key: "91356e7315ee96204b3fa6230087210a"
server_key_iv: "0eb7d519cc598fe98fbe63362be182b1"
server_key_version: "encryptionkey@0"
I20260811 05:08:16.732013 8511 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 05:08:16.732967 8540 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:16.733156 8511 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:08:16.733278 8511 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/ts-1/wal
uuid: "0f57f18ede044d5bafa0eb64034d544e"
format_stamp: "Formatted at 2026-08-11 05:08:16 on dist-test-slave-x5fp"
server_key: "91356e7315ee96204b3fa6230087210a"
server_key_iv: "0eb7d519cc598fe98fbe63362be182b1"
server_key_version: "encryptionkey@0"
I20260811 05:08:16.733371 8511 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:08:16.751968 8511 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:08:16.754544 8511 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:08:16.754788 8511 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:08:16.755116 8511 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:08:16.755505 8511 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:08:16.755571 8511 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:16.755620 8511 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:08:16.755652 8511 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:16.762727 8511 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.194:32965
I20260811 05:08:16.762775 8710 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.194:32965 every 8 connection(s)
I20260811 05:08:16.763152 8511 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/ts-1/data/info.pb
Aug 11 05:08:16 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424896, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.194@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
I20260811 05:08:16.773069 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 8511
I20260811 05:08:16.773211 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/ts-1/wal/instance
I20260811 05:08:16.773422 27391 external_mini_cluster.cc:1428] Setting key bb1f44593fc4bc0a61158c092aad0b20
I20260811 05:08:16.774510 8270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:16.764222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.194:34531 (local address 127.26.191.254:39591)
0811 05:08:16.764330 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:16.764333 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:16.764499 (+ 166us) server_negotiation.cc:407] Connection header received
0811 05:08:16.765118 (+ 619us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:16.765120 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:16.765132 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:16.765209 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:16.766288 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:16.766892 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:16.768066 (+ 1174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:16.768280 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:16.768348 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:16.771006 (+ 2658us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:16.771007 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:16.771008 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:08:16.771015 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:16.772537 (+ 1522us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:16.773229 (+ 692us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:16.773231 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:16.773231 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:16.773331 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:16.773686 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:16.773687 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:16.773688 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:16.773869 (+ 181us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:16.773952 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:16.774312 (+ 360us) server_negotiation.cc:299] Negotiation successful
0811 05:08:16.774420 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260811 05:08:16.774705 8713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:16.764128 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:39591 (local address 127.26.191.194:34531)
0811 05:08:16.764345 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:16.764394 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:16.765012 (+ 618us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:16.765273 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:16.765276 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:16.765954 (+ 678us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:16.766177 (+ 223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:16.766183 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:16.767030 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:16.767032 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:16.767962 (+ 930us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:16.767965 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:16.768389 (+ 424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:16.768390 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:16.768514 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:16.769106 (+ 592us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:16.769115 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:16.770844 (+ 1729us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:08:16.772649 (+ 1805us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:16.772658 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:16.772660 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:16.773105 (+ 445us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:16.773439 (+ 334us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:16.773440 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:16.773440 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:16.773605 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:16.773953 (+ 348us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:08:16.773962 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:08:16.774160 (+ 198us) client_negotiation.cc:769] Sending connection context
0811 05:08:16.774275 (+ 115us) client_negotiation.cc:240] Negotiation successful
0811 05:08:16.774451 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":109,"threads_started":1}
I20260811 05:08:16.775241 8711 heartbeater.cc:347] Connected to a master server at 127.26.191.254:39591
I20260811 05:08:16.775368 8711 heartbeater.cc:464] Registering TS with master...
I20260811 05:08:16.775626 8711 heartbeater.cc:511] Master 127.26.191.254:39591 requested a full tablet report, sending...
I20260811 05:08:16.776032 8201 ts_manager.cc:194] Registered new tserver with Master: 0f57f18ede044d5bafa0eb64034d544e (127.26.191.194:32965)
I20260811 05:08:16.776616 8201 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.191.194@KRBTEST.COM'} at 127.26.191.194:34531
WARNING: no policy specified for kudu/127.26.191.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.191.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.191.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.195.keytab.
Entry for principal kudu/127.26.191.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.195.keytab.
I20260811 05:08:16.805764 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.191.195:0
--local_ip_for_outbound_sockets=127.26.191.195
--webserver_interface=127.26.191.195
--webserver_port=0
--tserver_master_addrs=127.26.191.254:39591
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.195.keytab
--principal=kudu/127.26.191.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:38787
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:08:16.895965 8718 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:08:16.896253 8718 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:08:16.896298 8718 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:08:16.897622 8718 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:08:16.897699 8718 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:08:16.897745 8718 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.191.195
I20260811 05:08:16.899290 8718 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:38787
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.195.keytab
--principal=kudu/127.26.191.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.191.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.191.195
--webserver_port=0
--tserver_master_addrs=127.26.191.254:39591
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8718
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.191.195
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:08:16.899587 8718 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:08:16.899834 8718 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 05:08:16.905665 8718 server_base.cc:1034] running on GCE node
W20260811 05:08:16.905614 8725 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:16.905622 8734 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:16.905614 8737 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:08:16.906132 8718 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:08:16.906456 8718 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:08:16.907644 8718 hybrid_clock.cc:648] HybridClock initialized: now 1786424896907636 us; error 38 us; skew 500 ppm
Aug 11 05:08:16 dist-test-slave-x5fp krb5kdc[8131](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424896, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:08:16.910475 8718 init.cc:377] Logged in from keytab as kudu/127.26.191.195@KRBTEST.COM (short username kudu)
I20260811 05:08:16.910976 8718 webserver.cc:460] Webserver started at http://127.26.191.195:36597/ using document root <none> and password file <none>
I20260811 05:08:16.911234 8718 fs_manager.cc:359] Metadata directory not provided
I20260811 05:08:16.911309 8718 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:08:16.911468 8718 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:08:16.912643 8718 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/ts-2/data/instance:
uuid: "bae71d87a4c94a70ad3af5d5fda3f968"
format_stamp: "Formatted at 2026-08-11 05:08:16 on dist-test-slave-x5fp"
server_key: "4673deff9be08e54ffcdfc04d5b5d665"
server_key_iv: "edcaf4de236e8ab7f7038e3fce9ebea2"
server_key_version: "encryptionkey@0"
I20260811 05:08:16.913115 8718 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/ts-2/wal/instance:
uuid: "bae71d87a4c94a70ad3af5d5fda3f968"
format_stamp: "Formatted at 2026-08-11 05:08:16 on dist-test-slave-x5fp"
server_key: "4673deff9be08e54ffcdfc04d5b5d665"
server_key_iv: "edcaf4de236e8ab7f7038e3fce9ebea2"
server_key_version: "encryptionkey@0"
I20260811 05:08:16.914606 8718 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 05:08:16.915548 8747 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:16.915759 8718 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:08:16.915925 8718 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/ts-2/wal
uuid: "bae71d87a4c94a70ad3af5d5fda3f968"
format_stamp: "Formatted at 2026-08-11 05:08:16 on dist-test-slave-x5fp"
server_key: "4673deff9be08e54ffcdfc04d5b5d665"
server_key_iv: "edcaf4de236e8ab7f7038e3fce9ebea2"
server_key_version: "encryptionkey@0"
I20260811 05:08:16.916013 8718 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:08:16.935715 8718 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:08:16.938381 8718 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:08:16.938582 8718 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:08:16.938874 8718 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:08:16.939324 8718 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:08:16.939368 8718 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:16.939412 8718 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:08:16.939426 8718 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:16.946388 8718 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.195:36333
I20260811 05:08:16.946437 8920 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.195:36333 every 8 connection(s)
I20260811 05:08:16.946816 8718 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/ts-2/data/info.pb
I20260811 05:08:16.952941 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 8718
I20260811 05:08:16.953053 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/ts-2/wal/instance
I20260811 05:08:16.953258 27391 external_mini_cluster.cc:1428] Setting key 6c59f4d5b1caa47ed5e7d62eff9ffc4f
Aug 11 05:08:16 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424896, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.195@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
I20260811 05:08:16.957769 8270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:16.947798 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.195:38147 (local address 127.26.191.254:39591)
0811 05:08:16.947884 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:16.947885 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:16.948056 (+ 171us) server_negotiation.cc:407] Connection header received
0811 05:08:16.948816 (+ 760us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:16.948817 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:16.948830 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:16.948896 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:16.949945 (+ 1049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:16.950469 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:16.951531 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:16.951729 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:16.951789 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:16.954776 (+ 2987us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:16.954777 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:16.954778 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:08:16.954787 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:16.956230 (+ 1443us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:16.956709 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:16.956710 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:16.956711 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:16.956802 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:16.957073 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:16.957074 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:16.957075 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:16.957208 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:16.957297 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:16.957582 (+ 285us) server_negotiation.cc:299] Negotiation successful
0811 05:08:16.957675 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 05:08:16.958012 8923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:16.947739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:39591 (local address 127.26.191.195:38147)
0811 05:08:16.947921 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:16.947970 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:16.948615 (+ 645us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:16.948970 (+ 355us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:16.948973 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:16.949618 (+ 645us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:16.949839 (+ 221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:16.949844 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:16.950561 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:16.950562 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:16.951437 (+ 875us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:16.951439 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:16.951840 (+ 401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:16.951841 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:16.951961 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:16.952502 (+ 541us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:16.952511 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:16.954640 (+ 2129us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:08:16.956364 (+ 1724us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:16.956373 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:16.956375 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:16.956622 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:16.956875 (+ 253us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:16.956876 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:16.956876 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:16.956995 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:16.957284 (+ 289us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:08:16.957291 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:08:16.957441 (+ 150us) client_negotiation.cc:769] Sending connection context
0811 05:08:16.957558 (+ 117us) client_negotiation.cc:240] Negotiation successful
0811 05:08:16.957729 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":98,"threads_started":1}
I20260811 05:08:16.958580 8921 heartbeater.cc:347] Connected to a master server at 127.26.191.254:39591
I20260811 05:08:16.958671 8921 heartbeater.cc:464] Registering TS with master...
I20260811 05:08:16.958871 8921 heartbeater.cc:511] Master 127.26.191.254:39591 requested a full tablet report, sending...
I20260811 05:08:16.959285 8201 ts_manager.cc:194] Registered new tserver with Master: bae71d87a4c94a70ad3af5d5fda3f968 (127.26.191.195:36333)
I20260811 05:08:16.959757 8201 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.191.195@KRBTEST.COM'} at 127.26.191.195:38147
I20260811 05:08:16.965507 27391 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.26.191.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.191.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.191.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/krb5kdc/oryx_127.26.191.193.keytab.
Entry for principal oryx/127.26.191.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/krb5kdc/oryx_127.26.191.193.keytab.
WARNING: no policy specified for oryx/127.26.191.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.191.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.191.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/krb5kdc/oryx_127.26.191.194.keytab.
Entry for principal oryx/127.26.191.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/krb5kdc/oryx_127.26.191.194.keytab.
WARNING: no policy specified for oryx/127.26.191.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.191.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.191.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/krb5kdc/oryx_127.26.191.195.keytab.
Entry for principal oryx/127.26.191.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/krb5kdc/oryx_127.26.191.195.keytab.
I20260811 05:08:17.053952 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 8302
I20260811 05:08:17.076417 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 8511
I20260811 05:08:17.086084 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 8718
I20260811 05:08:17.096009 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 8153
I20260811 05:08:17.115984 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.254:39591
--webserver_interface=127.26.191.254
--webserver_port=35485
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab
--principal=kudu/127.26.191.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:38787
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.191.254:39591
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:08:17.208480 8931 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:08:17.208832 8931 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:08:17.208918 8931 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:08:17.210300 8931 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:08:17.210379 8931 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:08:17.210412 8931 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:08:17.210448 8931 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:08:17.210479 8931 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:08:17.212153 8931 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:38787
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.191.254:39591
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab
--principal=kudu/127.26.191.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.254:39591
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.191.254
--webserver_port=35485
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8931
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:08:17.212481 8931 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:08:17.212803 8931 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:08:17.218447 8945 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:17.218470 8939 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:17.218449 8940 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:08:17.218818 8931 server_base.cc:1034] running on GCE node
I20260811 05:08:17.219098 8931 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:08:17.219403 8931 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:08:17.220579 8931 hybrid_clock.cc:648] HybridClock initialized: now 1786424897220579 us; error 44 us; skew 500 ppm
Aug 11 05:08:17 dist-test-slave-x5fp krb5kdc[8131](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424897, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:08:17.223374 8931 init.cc:377] Logged in from keytab as kudu/127.26.191.254@KRBTEST.COM (short username kudu)
I20260811 05:08:17.223837 8931 webserver.cc:460] Webserver started at http://127.26.191.254:35485/ using document root <none> and password file <none>
I20260811 05:08:17.224083 8931 fs_manager.cc:359] Metadata directory not provided
I20260811 05:08:17.224180 8931 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:08:17.225807 8931 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:08:17.226619 8958 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:17.226914 8931 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:08:17.227042 8931 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/master-0/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/master-0/wal
uuid: "6a2089c3ca5946e681ebd0d619c76c59"
format_stamp: "Formatted at 2026-08-11 05:08:16 on dist-test-slave-x5fp"
server_key: "9064b8612eda8ed3839a8e747a994d00"
server_key_iv: "d3434d73b13e77334e655388b531ffda"
server_key_version: "encryptionkey@0"
I20260811 05:08:17.227427 8931 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:08:17.235014 8931 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:08:17.237727 8931 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:08:17.237942 8931 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:08:17.242902 8931 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.254:39591
I20260811 05:08:17.242964 9045 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.254:39591 every 8 connection(s)
I20260811 05:08:17.243410 8931 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
I20260811 05:08:17.245167 9046 sys_catalog.cc:263] Verifying existing consensus state
I20260811 05:08:17.245934 9046 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6a2089c3ca5946e681ebd0d619c76c59: Bootstrap starting.
I20260811 05:08:17.252408 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 8931
I20260811 05:08:17.252851 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.191.193:33501
--local_ip_for_outbound_sockets=127.26.191.193
--tserver_master_addrs=127.26.191.254:39591
--webserver_port=42597
--webserver_interface=127.26.191.193
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.193.keytab
--principal=kudu/127.26.191.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:38787
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.26.191.193
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/krb5kdc/oryx_127.26.191.193.keytab with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 05:08:17.256331 9046 log.cc:824] T 00000000000000000000000000000000 P 6a2089c3ca5946e681ebd0d619c76c59: Log is configured to *not* fsync() on all Append() calls
I20260811 05:08:17.258496 9046 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6a2089c3ca5946e681ebd0d619c76c59: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 05:08:17.258852 9046 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6a2089c3ca5946e681ebd0d619c76c59: Bootstrap complete.
I20260811 05:08:17.261651 9046 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6a2089c3ca5946e681ebd0d619c76c59 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a2089c3ca5946e681ebd0d619c76c59" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 39591 } }
I20260811 05:08:17.261909 9046 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6a2089c3ca5946e681ebd0d619c76c59 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a2089c3ca5946e681ebd0d619c76c59, State: Initialized, Role: FOLLOWER
I20260811 05:08:17.262102 9046 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6a2089c3ca5946e681ebd0d619c76c59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a2089c3ca5946e681ebd0d619c76c59" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 39591 } }
I20260811 05:08:17.262188 9046 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6a2089c3ca5946e681ebd0d619c76c59 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:08:17.262244 9046 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6a2089c3ca5946e681ebd0d619c76c59 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:08:17.262310 9046 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6a2089c3ca5946e681ebd0d619c76c59 [term 1 FOLLOWER]: Advancing to term 2
I20260811 05:08:17.263450 9046 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6a2089c3ca5946e681ebd0d619c76c59 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a2089c3ca5946e681ebd0d619c76c59" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 39591 } }
I20260811 05:08:17.263553 9046 leader_election.cc:302] T 00000000000000000000000000000000 P 6a2089c3ca5946e681ebd0d619c76c59 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6a2089c3ca5946e681ebd0d619c76c59; no voters:
I20260811 05:08:17.263803 9046 leader_election.cc:288] T 00000000000000000000000000000000 P 6a2089c3ca5946e681ebd0d619c76c59 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 05:08:17.263860 9050 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6a2089c3ca5946e681ebd0d619c76c59 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 05:08:17.264106 9050 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6a2089c3ca5946e681ebd0d619c76c59 [term 2 LEADER]: Becoming Leader. State: Replica: 6a2089c3ca5946e681ebd0d619c76c59, State: Running, Role: LEADER
I20260811 05:08:17.264132 9046 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6a2089c3ca5946e681ebd0d619c76c59 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:08:17.264286 9050 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6a2089c3ca5946e681ebd0d619c76c59 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a2089c3ca5946e681ebd0d619c76c59" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 39591 } }
I20260811 05:08:17.264693 9051 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6a2089c3ca5946e681ebd0d619c76c59 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "6a2089c3ca5946e681ebd0d619c76c59" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a2089c3ca5946e681ebd0d619c76c59" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 39591 } } }
I20260811 05:08:17.264737 9053 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6a2089c3ca5946e681ebd0d619c76c59 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6a2089c3ca5946e681ebd0d619c76c59. Latest consensus state: current_term: 2 leader_uuid: "6a2089c3ca5946e681ebd0d619c76c59" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a2089c3ca5946e681ebd0d619c76c59" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 39591 } } }
I20260811 05:08:17.264817 9051 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6a2089c3ca5946e681ebd0d619c76c59 [sys.catalog]: This master's current role is: LEADER
I20260811 05:08:17.264843 9053 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6a2089c3ca5946e681ebd0d619c76c59 [sys.catalog]: This master's current role is: LEADER
I20260811 05:08:17.265200 9059 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:08:17.265858 9059 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:08:17.266016 9059 catalog_manager.cc:1259] Loaded cluster ID: 42fad7ca5887422db40e58e00ee03554
I20260811 05:08:17.266148 9059 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:08:17.267246 9059 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:08:17.267462 9059 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 6a2089c3ca5946e681ebd0d619c76c59: Loaded TSK: 0
I20260811 05:08:17.267738 9059 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 05:08:17.364584 9048 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:08:17.365020 9048 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:08:17.365072 9048 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:08:17.366618 9048 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:08:17.366695 9048 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:08:17.366748 9048 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.191.193
I20260811 05:08:17.368408 9048 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:38787
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/krb5kdc/oryx_127.26.191.193.keytab
--principal=oryx/127.26.191.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.191.193:33501
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.191.193
--webserver_port=42597
--tserver_master_addrs=127.26.191.254:39591
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9048
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.191.193
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:08:17.368783 9048 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:08:17.369055 9048 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:08:17.374784 9091 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:17.374755 9085 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:17.374774 9084 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:08:17.375312 9048 server_base.cc:1034] running on GCE node
I20260811 05:08:17.375567 9048 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:08:17.375862 9048 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:08:17.377070 9048 hybrid_clock.cc:648] HybridClock initialized: now 1786424897377053 us; error 36 us; skew 500 ppm
Aug 11 05:08:17 dist-test-slave-x5fp krb5kdc[8131](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424897, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.191.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:08:17.380157 9048 init.cc:377] Logged in from keytab as oryx/127.26.191.193@KRBTEST.COM (short username oryx)
I20260811 05:08:17.380802 9048 webserver.cc:460] Webserver started at http://127.26.191.193:42597/ using document root <none> and password file <none>
I20260811 05:08:17.381084 9048 fs_manager.cc:359] Metadata directory not provided
I20260811 05:08:17.381222 9048 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:08:17.382838 9048 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 05:08:17.383687 9103 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:17.383931 9048 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:08:17.384052 9048 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/ts-0/wal
uuid: "457ee76c9f12454e9f99f08989c6e38a"
format_stamp: "Formatted at 2026-08-11 05:08:16 on dist-test-slave-x5fp"
server_key: "1bba63d8304b0d06108cf0c3ad3ae9a9"
server_key_iv: "793004aa19322c42cb96adfcf091e12d"
server_key_version: "encryptionkey@0"
I20260811 05:08:17.384486 9048 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:08:17.396791 9048 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:08:17.399399 9048 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:08:17.399600 9048 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:08:17.399895 9048 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:08:17.400324 9048 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:08:17.400382 9048 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:17.400420 9048 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:08:17.400450 9048 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:17.408674 9048 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.193:33501
I20260811 05:08:17.408739 9288 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.193:33501 every 8 connection(s)
I20260811 05:08:17.409205 9048 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/ts-0/data/info.pb
I20260811 05:08:17.410226 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 9048
I20260811 05:08:17.410612 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.191.194:32965
--local_ip_for_outbound_sockets=127.26.191.194
--tserver_master_addrs=127.26.191.254:39591
--webserver_port=43693
--webserver_interface=127.26.191.194
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.194.keytab
--principal=kudu/127.26.191.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:38787
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.26.191.194
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/krb5kdc/oryx_127.26.191.194.keytab with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 05:08:17 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.193@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:08:17 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.193@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:08:17.420234 9291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:17.410384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:39591 (local address 127.26.191.193:47675)
0811 05:08:17.410810 (+ 426us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:17.410865 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:17.411620 (+ 755us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:17.412306 (+ 686us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:17.412311 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:17.413195 (+ 884us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:17.413433 (+ 238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:17.413439 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:17.414884 (+ 1445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:17.414886 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:17.415790 (+ 904us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:17.415793 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:17.416605 (+ 812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:17.416606 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:17.416816 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:17.417478 (+ 662us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:17.417488 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:17.419977 (+ 2489us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.191.254:39591: Server oryx/127.26.191.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":362,"thread_start_us":117,"threads_started":1}
W20260811 05:08:17.420701 9293 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:08:17.410461 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.193:47675 (local address 127.26.191.254:39591)
0811 05:08:17.410701 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:17.410712 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:17.411030 (+ 318us) server_negotiation.cc:407] Connection header received
0811 05:08:17.411880 (+ 850us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:17.411889 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:17.411956 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:17.412118 (+ 162us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:17.413585 (+ 1467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:17.414762 (+ 1177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:17.416003 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:17.416489 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:17.416635 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:17.420143 (+ 3508us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.191.193:47675: BlockingRecv error: recv got EOF from 127.26.191.193:47675 (error 108)
Metrics: {"server-negotiator.queue_time_us":184,"thread_start_us":104,"threads_started":1}
W20260811 05:08:17.420714 9289 heartbeater.cc:644] Failed to heartbeat to 127.26.191.254:39591 (0 consecutive failures): Not authorized: Failed to ping master at 127.26.191.254:39591: Client connection negotiation failed: client connection to 127.26.191.254:39591: Server oryx/127.26.191.254@KRBTEST.COM not found in Kerberos database
Aug 11 05:08:17 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.193@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:08:17 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.193@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:08:17.426331 9291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:17.421112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:39591 (local address 127.26.191.193:47305)
0811 05:08:17.421441 (+ 329us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:17.421452 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:17.421527 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:17.421708 (+ 181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:17.421709 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:17.421870 (+ 161us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:17.421919 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:17.421920 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:17.422676 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:17.422678 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:17.423233 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:17.423235 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:17.423645 (+ 410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:17.423646 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:17.423730 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:17.424260 (+ 530us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:17.424265 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:17.426234 (+ 1969us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.191.254:39591: Server oryx/127.26.191.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":313}
W20260811 05:08:17.426462 9295 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:08:17.421178 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.193:47305 (local address 127.26.191.254:39591)
0811 05:08:17.421375 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:17.421378 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:17.421509 (+ 131us) server_negotiation.cc:407] Connection header received
0811 05:08:17.421598 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:17.421599 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:17.421618 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:17.421703 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:17.422015 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:17.422586 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:17.423326 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:17.423562 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:17.423647 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:17.426319 (+ 2672us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.191.193:47305: BlockingRecv error: recv got EOF from 127.26.191.193:47305 (error 108)
Metrics: {"server-negotiator.queue_time_us":168,"thread_start_us":136,"threads_started":1}
Aug 11 05:08:17 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.193@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:08:17 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.193@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:08:17.431836 9291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:17.426937 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:39591 (local address 127.26.191.193:46065)
0811 05:08:17.426984 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:17.426994 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:17.427055 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:17.427204 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:17.427205 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:17.427350 (+ 145us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:17.427379 (+ 29us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:17.427381 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:17.428102 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:17.428103 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:17.428643 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:17.428645 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:17.429103 (+ 458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:17.429105 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:17.429173 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:17.429689 (+ 516us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:17.429696 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:17.431737 (+ 2041us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.191.254:39591: Server oryx/127.26.191.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":30}
W20260811 05:08:17.431913 9295 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:08:17.427013 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.193:46065 (local address 127.26.191.254:39591)
0811 05:08:17.427086 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:17.427088 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:17.427097 (+ 9us) server_negotiation.cc:407] Connection header received
0811 05:08:17.427120 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:17.427121 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:17.427132 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:17.427194 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:17.427470 (+ 276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:17.427999 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:17.428764 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:17.429003 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:17.429100 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:17.431832 (+ 2732us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.191.193:46065: BlockingRecv error: recv got EOF from 127.26.191.193:46065 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
W20260811 05:08:17.432292 9289 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 05:08:17.509296 9294 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:08:17.509507 9294 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:08:17.509531 9294 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:08:17.510628 9294 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:08:17.510661 9294 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:08:17.510686 9294 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.191.194
I20260811 05:08:17.512053 9294 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:38787
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/krb5kdc/oryx_127.26.191.194.keytab
--principal=oryx/127.26.191.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.191.194:32965
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.191.194
--webserver_port=43693
--tserver_master_addrs=127.26.191.254:39591
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9294
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.191.194
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:08:17.512251 9294 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:08:17.512463 9294 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:08:17.518121 9306 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:08:17.518275 9294 server_base.cc:1034] running on GCE node
W20260811 05:08:17.518253 9305 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:17.518126 9308 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:08:17.518750 9294 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:08:17.519037 9294 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:08:17.520224 9294 hybrid_clock.cc:648] HybridClock initialized: now 1786424897520199 us; error 45 us; skew 500 ppm
Aug 11 05:08:17 dist-test-slave-x5fp krb5kdc[8131](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424897, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.191.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:08:17.523102 9294 init.cc:377] Logged in from keytab as oryx/127.26.191.194@KRBTEST.COM (short username oryx)
I20260811 05:08:17.523643 9294 webserver.cc:460] Webserver started at http://127.26.191.194:43693/ using document root <none> and password file <none>
I20260811 05:08:17.523916 9294 fs_manager.cc:359] Metadata directory not provided
I20260811 05:08:17.524015 9294 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:08:17.525655 9294 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.000s
I20260811 05:08:17.526419 9319 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:17.526873 9294 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:08:17.527015 9294 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/ts-1/wal
uuid: "0f57f18ede044d5bafa0eb64034d544e"
format_stamp: "Formatted at 2026-08-11 05:08:16 on dist-test-slave-x5fp"
server_key: "91356e7315ee96204b3fa6230087210a"
server_key_iv: "0eb7d519cc598fe98fbe63362be182b1"
server_key_version: "encryptionkey@0"
I20260811 05:08:17.527418 9294 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:08:17.554708 9294 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:08:17.557578 9294 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:08:17.557950 9294 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:08:17.558269 9294 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:08:17.558636 9294 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:08:17.558696 9294 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:17.558754 9294 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:08:17.558782 9294 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:17.565448 9294 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.194:32965
I20260811 05:08:17.565529 9496 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.194:32965 every 8 connection(s)
I20260811 05:08:17.565896 9294 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/ts-1/data/info.pb
I20260811 05:08:17.568871 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 9294
I20260811 05:08:17.569252 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.191.195:36333
--local_ip_for_outbound_sockets=127.26.191.195
--tserver_master_addrs=127.26.191.254:39591
--webserver_port=36597
--webserver_interface=127.26.191.195
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.195.keytab
--principal=kudu/127.26.191.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:38787
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.26.191.195
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/krb5kdc/oryx_127.26.191.195.keytab with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 05:08:17 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.194@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:08:17 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.194@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:08:17.575776 9499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:17.566742 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:39591 (local address 127.26.191.194:38631)
0811 05:08:17.566998 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:17.567041 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:17.567560 (+ 519us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:17.568200 (+ 640us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:17.568204 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:17.569224 (+ 1020us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:17.569596 (+ 372us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:17.569605 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:17.570714 (+ 1109us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:17.570715 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:17.571700 (+ 985us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:17.571704 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:17.572282 (+ 578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:17.572283 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:17.572407 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:17.573031 (+ 624us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:17.573041 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:17.575612 (+ 2571us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.191.254:39591: Server oryx/127.26.191.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":102,"threads_started":1}
W20260811 05:08:17.575856 9295 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:08:17.566751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.194:38631 (local address 127.26.191.254:39591)
0811 05:08:17.566832 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:17.566835 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:17.567143 (+ 308us) server_negotiation.cc:407] Connection header received
0811 05:08:17.567853 (+ 710us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:17.567855 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:17.567871 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:17.567938 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:17.569717 (+ 1779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:17.570584 (+ 867us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:17.571816 (+ 1232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:17.572180 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:17.572268 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:17.575757 (+ 3489us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.191.194:38631: BlockingRecv error: recv got EOF from 127.26.191.194:38631 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
W20260811 05:08:17.576066 9497 heartbeater.cc:644] Failed to heartbeat to 127.26.191.254:39591 (0 consecutive failures): Not authorized: Failed to ping master at 127.26.191.254:39591: Client connection negotiation failed: client connection to 127.26.191.254:39591: Server oryx/127.26.191.254@KRBTEST.COM not found in Kerberos database
Aug 11 05:08:17 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.194@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:08:17 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.194@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:08:17.580960 9499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:17.576292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:39591 (local address 127.26.191.194:56073)
0811 05:08:17.576345 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:17.576356 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:17.576419 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:17.576579 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:17.576580 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:17.576756 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:17.576819 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:17.576821 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:17.577469 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:17.577470 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:17.577995 (+ 525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:17.577997 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:17.578360 (+ 363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:17.578361 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:17.578429 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:17.578959 (+ 530us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:17.578964 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:17.580845 (+ 1881us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.191.254:39591: Server oryx/127.26.191.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":34}
W20260811 05:08:17.581084 9295 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:08:17.576386 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.194:56073 (local address 127.26.191.254:39591)
0811 05:08:17.576452 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:17.576454 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:17.576464 (+ 10us) server_negotiation.cc:407] Connection header received
0811 05:08:17.576489 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:17.576490 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:17.576504 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:17.576573 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:17.576898 (+ 325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:17.577386 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:17.578081 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:17.578285 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:17.578363 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:17.580974 (+ 2611us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.191.194:56073: BlockingRecv error: recv got EOF from 127.26.191.194:56073 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Aug 11 05:08:17 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.194@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:08:17 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.194@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:08:17.585992 9499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:17.581518 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:39591 (local address 127.26.191.194:55685)
0811 05:08:17.581579 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:17.581590 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:17.581660 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:17.581853 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:17.581854 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:17.581999 (+ 145us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:17.582031 (+ 32us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:17.582032 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:17.582715 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:17.582715 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:17.583220 (+ 505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:17.583221 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:17.583611 (+ 390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:17.583612 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:17.583666 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:17.584163 (+ 497us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:17.584168 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:17.585905 (+ 1737us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.191.254:39591: Server oryx/127.26.191.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":40}
W20260811 05:08:17.586050 9295 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:08:17.581609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.194:55685 (local address 127.26.191.254:39591)
0811 05:08:17.581713 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:17.581715 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:17.581724 (+ 9us) server_negotiation.cc:407] Connection header received
0811 05:08:17.581757 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:17.581758 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:17.581769 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:17.581834 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:17.582120 (+ 286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:17.582600 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:17.583326 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:17.583521 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:17.583611 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:17.585986 (+ 2375us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.191.194:55685: BlockingRecv error: recv got EOF from 127.26.191.194:55685 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
W20260811 05:08:17.586140 9497 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 05:08:17.662642 9505 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:08:17.662890 9505 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:08:17.662917 9505 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:08:17.664222 9505 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:08:17.664271 9505 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:08:17.664301 9505 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.191.195
I20260811 05:08:17.666225 9505 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:38787
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/krb5kdc/oryx_127.26.191.195.keytab
--principal=oryx/127.26.191.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.191.195:36333
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.191.195
--webserver_port=36597
--tserver_master_addrs=127.26.191.254:39591
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9505
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.191.195
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:08:17.666512 9505 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:08:17.666780 9505 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:08:17.672163 9513 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:17.672142 9521 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:17.672132 9514 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:08:17.672608 9505 server_base.cc:1034] running on GCE node
I20260811 05:08:17.672887 9505 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:08:17.673106 9505 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:08:17.674258 9505 hybrid_clock.cc:648] HybridClock initialized: now 1786424897674244 us; error 30 us; skew 500 ppm
Aug 11 05:08:17 dist-test-slave-x5fp krb5kdc[8131](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424897, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.191.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:08:17.677299 9505 init.cc:377] Logged in from keytab as oryx/127.26.191.195@KRBTEST.COM (short username oryx)
I20260811 05:08:17.677800 9505 webserver.cc:460] Webserver started at http://127.26.191.195:36597/ using document root <none> and password file <none>
I20260811 05:08:17.678108 9505 fs_manager.cc:359] Metadata directory not provided
I20260811 05:08:17.678208 9505 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:08:17.679716 9505 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:08:17.680424 9532 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:17.680629 9505 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:08:17.680758 9505 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/ts-2/wal
uuid: "bae71d87a4c94a70ad3af5d5fda3f968"
format_stamp: "Formatted at 2026-08-11 05:08:16 on dist-test-slave-x5fp"
server_key: "4673deff9be08e54ffcdfc04d5b5d665"
server_key_iv: "edcaf4de236e8ab7f7038e3fce9ebea2"
server_key_version: "encryptionkey@0"
I20260811 05:08:17.681162 9505 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:08:17.707248 9505 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:08:17.709702 9505 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:08:17.709890 9505 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:08:17.710170 9505 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:08:17.710522 9505 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:08:17.710580 9505 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:17.710618 9505 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:08:17.710666 9505 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:17.717187 9505 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.195:36333
I20260811 05:08:17.717298 9705 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.195:36333 every 8 connection(s)
I20260811 05:08:17.717698 9505 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424853995437-27391-0/minicluster-data/ts-2/data/info.pb
Aug 11 05:08:17 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.195@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:08:17 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.195@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
W20260811 05:08:17.726550 9295 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:08:17.718704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.195:55355 (local address 127.26.191.254:39591)
0811 05:08:17.718832 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:17.718835 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:17.719036 (+ 201us) server_negotiation.cc:407] Connection header received
0811 05:08:17.719647 (+ 611us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:17.719649 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:17.719664 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:17.719716 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:17.720901 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:17.721452 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:17.722590 (+ 1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:17.722823 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:17.722911 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:17.726482 (+ 3571us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.191.195:55355: BlockingRecv error: recv got EOF from 127.26.191.195:55355 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
I20260811 05:08:17.726634 9708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:17.718695 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:39591 (local address 127.26.191.195:55355)
0811 05:08:17.718899 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:17.718942 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:17.719513 (+ 571us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:17.719817 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:17.719821 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:17.720479 (+ 658us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:17.720702 (+ 223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:17.720708 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:17.721561 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:17.721562 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:17.722480 (+ 918us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:17.722483 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:17.722920 (+ 437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:17.722921 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:17.723067 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:17.723717 (+ 650us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:17.723727 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:17.726392 (+ 2665us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.191.254:39591: Server oryx/127.26.191.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":79,"threads_started":1}
W20260811 05:08:17.726923 9706 heartbeater.cc:644] Failed to heartbeat to 127.26.191.254:39591 (0 consecutive failures): Not authorized: Failed to ping master at 127.26.191.254:39591: Client connection negotiation failed: client connection to 127.26.191.254:39591: Server oryx/127.26.191.254@KRBTEST.COM not found in Kerberos database
I20260811 05:08:17.727138 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 9505
Aug 11 05:08:17 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.195@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:08:17 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.195@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:08:17.732801 9708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:17.727215 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:39591 (local address 127.26.191.195:58575)
0811 05:08:17.727289 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:17.727305 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:17.727360 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:17.727578 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:17.727579 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:17.727760 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:17.727828 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:17.727831 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:17.728604 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:17.728605 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:17.729279 (+ 674us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:17.729282 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:17.729693 (+ 411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:17.729694 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:17.729774 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:17.730293 (+ 519us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:17.730300 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:17.732688 (+ 2388us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.191.254:39591: Server oryx/127.26.191.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":50}
W20260811 05:08:17.732969 9295 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:08:17.727398 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.195:58575 (local address 127.26.191.254:39591)
0811 05:08:17.727459 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:17.727461 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:17.727469 (+ 8us) server_negotiation.cc:407] Connection header received
0811 05:08:17.727490 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:17.727491 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:17.727500 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:17.727574 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:17.727924 (+ 350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:17.728517 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:17.729388 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:17.729612 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:17.729677 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:17.732880 (+ 3203us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.191.195:58575: BlockingRecv error: recv got EOF from 127.26.191.195:58575 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 05:08:17.736624 9293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:17.727646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35662 (local address 127.26.191.254:39591)
0811 05:08:17.727705 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:17.727707 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:17.727976 (+ 269us) server_negotiation.cc:407] Connection header received
0811 05:08:17.728027 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:17.728027 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:17.728042 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:17.728114 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:17.728818 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:17.729272 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:17.730456 (+ 1184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:17.730777 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:17.730878 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:17.732359 (+ 1481us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:17.732366 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:17.732367 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:08:17.732382 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:17.734704 (+ 2322us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:17.735204 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:17.735208 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:17.735208 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:17.735320 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:17.735580 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:17.735582 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:17.735582 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:17.735962 (+ 380us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:17.736142 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:17.736368 (+ 226us) server_negotiation.cc:299] Negotiation successful
0811 05:08:17.736505 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
Aug 11 05:08:17 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.195@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:08:17 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.195@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:08:17.738741 9708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:17.733564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:39591 (local address 127.26.191.195:44089)
0811 05:08:17.733671 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:17.733681 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:17.733734 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:17.733868 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:17.733869 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:17.733988 (+ 119us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:17.734019 (+ 31us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:17.734020 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:17.734876 (+ 856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:17.734877 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:17.735665 (+ 788us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:17.735668 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:17.736128 (+ 460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:17.736130 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:17.736201 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:17.736632 (+ 431us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:17.736637 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:17.738655 (+ 2018us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.191.254:39591: Server oryx/127.26.191.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":90}
W20260811 05:08:17.738788 9295 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:08:17.733613 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.195:44089 (local address 127.26.191.254:39591)
0811 05:08:17.733660 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:17.733662 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:17.733723 (+ 61us) server_negotiation.cc:407] Connection header received
0811 05:08:17.733794 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:17.733795 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:17.733805 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:17.733863 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:17.734090 (+ 227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:17.734793 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:17.735755 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:17.736035 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:17.736099 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:17.738728 (+ 2629us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.191.195:44089: BlockingRecv error: recv got EOF from 127.26.191.195:44089 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
W20260811 05:08:17.738937 9706 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 11 05:08:18 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.193@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:08:18 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.193@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:08:18.443051 9711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:18.432877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:39591 (local address 127.26.191.193:50079)
0811 05:08:18.433053 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:18.433070 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:18.433151 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:18.433342 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:18.433343 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:18.433534 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:18.433586 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:18.433587 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:18.434299 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:18.434301 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:18.434857 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:18.434859 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:18.435284 (+ 425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:18.435285 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:18.435355 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:18.440507 (+ 5152us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:18.440513 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:18.442914 (+ 2401us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.191.254:39591: Server oryx/127.26.191.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":77,"threads_started":1}
W20260811 05:08:18.443138 9713 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:08:18.433020 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.193:50079 (local address 127.26.191.254:39591)
0811 05:08:18.433155 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:18.433157 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:18.433168 (+ 11us) server_negotiation.cc:407] Connection header received
0811 05:08:18.433228 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:18.433228 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:18.433241 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:18.433333 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:18.433678 (+ 345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:18.434202 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:18.434951 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:18.435168 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:18.435275 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:18.443047 (+ 7772us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.191.193:50079: BlockingRecv error: recv got EOF from 127.26.191.193:50079 (error 108)
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":77,"threads_started":1}
Aug 11 05:08:18 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.194@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:08:18 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.194@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:08:18.591961 9714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:18.586595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:39591 (local address 127.26.191.194:45619)
0811 05:08:18.586729 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:18.586744 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:18.586833 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:18.587040 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:18.587042 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:18.587225 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:18.587311 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:18.587313 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:18.588141 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:18.588142 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:18.588867 (+ 725us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:18.588870 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:18.589242 (+ 372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:18.589243 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:18.589322 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:18.589916 (+ 594us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:18.589921 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:18.591896 (+ 1975us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.191.254:39591: Server oryx/127.26.191.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":61,"threads_started":1}
W20260811 05:08:18.592185 9713 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:08:18.586703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.194:45619 (local address 127.26.191.254:39591)
0811 05:08:18.586852 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:18.586854 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:18.586868 (+ 14us) server_negotiation.cc:407] Connection header received
0811 05:08:18.586893 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:18.586894 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:18.586905 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:18.586973 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:18.587397 (+ 424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:18.588051 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:18.588949 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:18.589164 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:18.589227 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:18.592103 (+ 2876us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.191.194:45619: BlockingRecv error: recv got EOF from 127.26.191.194:45619 (error 108)
Metrics: {"server-negotiator.queue_time_us":113}
Aug 11 05:08:18 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.195@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:08:18 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.195@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:08:18.745118 9715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:18.739519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:39591 (local address 127.26.191.195:37807)
0811 05:08:18.739822 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:18.739841 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:18.739933 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:18.740132 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:18.740133 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:18.740338 (+ 205us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:18.740407 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:18.740409 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:18.741167 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:18.741168 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:18.741764 (+ 596us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:18.741767 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:18.742151 (+ 384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:18.742153 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:18.742211 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:18.742758 (+ 547us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:18.742763 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:18.745033 (+ 2270us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.191.254:39591: Server oryx/127.26.191.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":283,"thread_start_us":130,"threads_started":1}
W20260811 05:08:18.745316 9713 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:08:18.739656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.195:37807 (local address 127.26.191.254:39591)
0811 05:08:18.739783 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:18.739786 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:18.739911 (+ 125us) server_negotiation.cc:407] Connection header received
0811 05:08:18.740026 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:18.740028 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:18.740042 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:18.740124 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:18.740497 (+ 373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:18.741082 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:18.741860 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:18.742061 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:18.742150 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:18.745197 (+ 3047us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.191.195:37807: BlockingRecv error: recv got EOF from 127.26.191.195:37807 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
Aug 11 05:08:19 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.193@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:08:19 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.193@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:08:19.448851 9717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:19.443576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:39591 (local address 127.26.191.193:53637)
0811 05:08:19.443766 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:19.443802 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:19.443857 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:19.444013 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:19.444014 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:19.444193 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:19.444245 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:19.444247 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:19.445046 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:19.445047 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:19.445584 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:19.445585 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:19.446014 (+ 429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:19.446015 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:19.446066 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:19.446658 (+ 592us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:19.446663 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:19.448778 (+ 2115us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.191.254:39591: Server oryx/127.26.191.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":109,"threads_started":1}
W20260811 05:08:19.449018 9721 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:08:19.443699 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.193:53637 (local address 127.26.191.254:39591)
0811 05:08:19.443878 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:19.443880 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:19.443890 (+ 10us) server_negotiation.cc:407] Connection header received
0811 05:08:19.443915 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:19.443916 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:19.443927 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:19.443994 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:19.444348 (+ 354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:19.444948 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:19.445686 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:19.445924 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:19.445994 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:19.448910 (+ 2916us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.191.193:53637: BlockingRecv error: recv got EOF from 127.26.191.193:53637 (error 108)
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":118,"threads_started":1}
Aug 11 05:08:19 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.194@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:08:19 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.194@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:08:19.597931 9724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:19.592545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:39591 (local address 127.26.191.194:40011)
0811 05:08:19.592794 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:19.592812 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:19.592882 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:19.593105 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:19.593106 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:19.593301 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:19.593356 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:19.593358 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:19.594097 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:19.594098 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:19.594661 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:19.594663 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:19.595088 (+ 425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:19.595089 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:19.595149 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:19.595725 (+ 576us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:19.595730 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:19.597863 (+ 2133us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.191.254:39591: Server oryx/127.26.191.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":227,"thread_start_us":95,"threads_started":1}
W20260811 05:08:19.598106 9721 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:08:19.592689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.194:40011 (local address 127.26.191.254:39591)
0811 05:08:19.592768 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:19.592771 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:19.592929 (+ 158us) server_negotiation.cc:407] Connection header received
0811 05:08:19.592967 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:19.592968 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:19.592982 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:19.593063 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:19.593456 (+ 393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:19.593991 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:19.594761 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:19.594991 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:19.595051 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:19.598019 (+ 2968us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.191.194:40011: BlockingRecv error: recv got EOF from 127.26.191.194:40011 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
Aug 11 05:08:19 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.195@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:08:19 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.195@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:08:19.750972 9726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:19.745725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:39591 (local address 127.26.191.195:33373)
0811 05:08:19.745925 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:19.745941 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:19.746015 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:19.746167 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:19.746168 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:19.746366 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:19.746423 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:19.746425 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:19.747146 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:19.747146 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:19.747751 (+ 605us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:19.747752 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:19.748299 (+ 547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:19.748300 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:19.748356 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:19.748963 (+ 607us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:19.748969 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:19.750905 (+ 1936us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.191.254:39591: Server oryx/127.26.191.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":152,"threads_started":1}
W20260811 05:08:19.751107 9721 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:08:19.745907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.195:33373 (local address 127.26.191.254:39591)
0811 05:08:19.745974 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:19.745976 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:19.745998 (+ 22us) server_negotiation.cc:407] Connection header received
0811 05:08:19.746082 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:19.746083 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:19.746098 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:19.746148 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:19.746529 (+ 381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:19.747049 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:19.747858 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:19.748168 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:19.748235 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:19.751020 (+ 2785us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.191.195:33373: BlockingRecv error: recv got EOF from 127.26.191.195:33373 (error 108)
Metrics: {"server-negotiator.queue_time_us":27}
Aug 11 05:08:20 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.193@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:08:20 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.193@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:08:20.455201 9731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:20.449525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:39591 (local address 127.26.191.193:48649)
0811 05:08:20.449736 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:20.449757 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:20.449815 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:20.450013 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:20.450014 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:20.450208 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:20.450259 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:20.450260 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:20.450970 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:20.450971 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:20.451544 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:20.451546 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:20.451954 (+ 408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:20.451955 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:20.452031 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:20.452700 (+ 669us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:20.452706 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:20.455087 (+ 2381us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.191.254:39591: Server oryx/127.26.191.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":96,"threads_started":1}
W20260811 05:08:20.455276 9732 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:08:20.449603 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.193:48649 (local address 127.26.191.254:39591)
0811 05:08:20.449781 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:20.449784 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:20.449797 (+ 13us) server_negotiation.cc:407] Connection header received
0811 05:08:20.449869 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:20.449870 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:20.449885 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:20.449972 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:20.450355 (+ 383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:20.450871 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:20.451634 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:20.451868 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:20.451955 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:20.455195 (+ 3240us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.191.193:48649: BlockingRecv error: recv got EOF from 127.26.191.193:48649 (error 108)
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":105,"threads_started":1}
Aug 11 05:08:20 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.194@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:08:20 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.194@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:08:20.604387 9733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:20.598616 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:39591 (local address 127.26.191.194:40447)
0811 05:08:20.598836 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:20.598849 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:20.598950 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:20.599076 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:20.599077 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:20.599262 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:20.599312 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:20.599314 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:20.600045 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:20.600046 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:20.600896 (+ 850us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:20.600900 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:20.601357 (+ 457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:20.601358 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:20.601412 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:20.602052 (+ 640us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:20.602058 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:20.604241 (+ 2183us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.191.254:39591: Server oryx/127.26.191.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":113,"threads_started":1}
W20260811 05:08:20.604496 9732 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:08:20.598791 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.194:40447 (local address 127.26.191.254:39591)
0811 05:08:20.598850 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:20.598852 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:20.598929 (+ 77us) server_negotiation.cc:407] Connection header received
0811 05:08:20.599004 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:20.599005 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:20.599017 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:20.599070 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:20.599409 (+ 339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:20.599932 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:20.601034 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:20.601244 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:20.601317 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:20.604428 (+ 3111us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.191.194:40447: BlockingRecv error: recv got EOF from 127.26.191.194:40447 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
Aug 11 05:08:20 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.195@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:08:20 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.195@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:08:20.756798 9736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:20.751526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:39591 (local address 127.26.191.195:60207)
0811 05:08:20.751747 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:20.751759 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:20.751875 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:20.752017 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:20.752018 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:20.752220 (+ 202us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:20.752272 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:20.752273 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:20.753059 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:20.753060 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:20.753624 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:20.753626 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:20.754018 (+ 392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:20.754019 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:20.754084 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:20.754624 (+ 540us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:20.754630 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:20.756670 (+ 2040us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.191.254:39591: Server oryx/127.26.191.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":144,"threads_started":1}
W20260811 05:08:20.756917 9732 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:08:20.751621 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.195:60207 (local address 127.26.191.254:39591)
0811 05:08:20.751719 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:20.751722 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:20.751856 (+ 134us) server_negotiation.cc:407] Connection header received
0811 05:08:20.751935 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:20.751936 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:20.751953 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:20.752001 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:20.752359 (+ 358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:20.752971 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:20.753721 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:20.753938 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:20.754018 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:20.756839 (+ 2821us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.191.195:60207: BlockingRecv error: recv got EOF from 127.26.191.195:60207 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
Aug 11 05:08:21 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.193@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:08:21 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.193@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:08:21.461771 9737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:21.455943 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:39591 (local address 127.26.191.193:46801)
0811 05:08:21.456116 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:21.456136 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:21.456196 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:21.456401 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:21.456402 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:21.456587 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:21.456855 (+ 268us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:21.456858 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:21.457813 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:21.457815 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:21.458419 (+ 604us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:21.458421 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:21.458878 (+ 457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:21.458880 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:21.458937 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:21.459464 (+ 527us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:21.459470 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:21.461656 (+ 2186us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.191.254:39591: Server oryx/127.26.191.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":109,"threads_started":1}
W20260811 05:08:21.461845 9740 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:08:21.456045 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.193:46801 (local address 127.26.191.254:39591)
0811 05:08:21.456213 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:21.456215 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:21.456226 (+ 11us) server_negotiation.cc:407] Connection header received
0811 05:08:21.456281 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:21.456282 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:21.456293 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:21.456350 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:21.456943 (+ 593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:21.457711 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:21.458519 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:21.458744 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:21.458805 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:21.461758 (+ 2953us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.191.193:46801: BlockingRecv error: recv got EOF from 127.26.191.193:46801 (error 108)
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":95,"threads_started":1}
Aug 11 05:08:21 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.194@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:08:21 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.194@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:08:21.609817 9741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:21.605107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:39591 (local address 127.26.191.194:56347)
0811 05:08:21.605260 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:21.605271 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:21.605339 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:21.605470 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:21.605471 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:21.605651 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:21.605701 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:21.605702 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:21.606461 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:21.606462 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:21.607022 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:21.607024 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:21.607376 (+ 352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:21.607377 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:21.607423 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:21.607886 (+ 463us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:21.607890 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:21.609751 (+ 1861us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.191.254:39591: Server oryx/127.26.191.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":82,"threads_started":1}
W20260811 05:08:21.609969 9740 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:08:21.605147 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.194:56347 (local address 127.26.191.254:39591)
0811 05:08:21.605242 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:21.605245 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:21.605362 (+ 117us) server_negotiation.cc:407] Connection header received
0811 05:08:21.605394 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:21.605395 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:21.605409 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:21.605463 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:21.605803 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:21.606347 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:21.607107 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:21.607304 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:21.607359 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:21.609876 (+ 2517us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.191.194:56347: BlockingRecv error: recv got EOF from 127.26.191.194:56347 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Aug 11 05:08:21 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.195@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:08:21 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.195@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:08:21.762663 9742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:21.757409 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:39591 (local address 127.26.191.195:51711)
0811 05:08:21.757594 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:21.757608 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:21.757675 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:21.757880 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:21.757881 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:21.758061 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:21.758113 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:21.758115 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:21.758918 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:21.758919 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:21.759480 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:21.759481 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:21.759889 (+ 408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:21.759890 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:21.759937 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:21.760497 (+ 560us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:21.760503 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:21.762595 (+ 2092us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.191.254:39591: Server oryx/127.26.191.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":131,"threads_started":1}
W20260811 05:08:21.762820 9740 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:08:21.757543 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.195:51711 (local address 127.26.191.254:39591)
0811 05:08:21.757599 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:21.757610 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:21.757659 (+ 49us) server_negotiation.cc:407] Connection header received
0811 05:08:21.757724 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:21.757725 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:21.757738 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:21.757806 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:21.758227 (+ 421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:21.758812 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:21.759588 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:21.759788 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:21.759878 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:21.762710 (+ 2832us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.191.195:51711: BlockingRecv error: recv got EOF from 127.26.191.195:51711 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
Aug 11 05:08:22 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.193@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:08:22 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.193@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:08:22.468302 9743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:22.462438 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:39591 (local address 127.26.191.193:50785)
0811 05:08:22.462671 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:22.462728 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:22.462806 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:22.462949 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:22.462949 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:22.463129 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:22.463182 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:22.463184 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:22.463959 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:22.463960 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:22.464700 (+ 740us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:22.464703 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:22.465158 (+ 455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:22.465160 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:22.465238 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:22.465930 (+ 692us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:22.465935 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:22.468215 (+ 2280us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.191.254:39591: Server oryx/127.26.191.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":166,"threads_started":1}
W20260811 05:08:22.468428 9744 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:08:22.462510 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.193:50785 (local address 127.26.191.254:39591)
0811 05:08:22.462652 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:22.462654 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:22.462845 (+ 191us) server_negotiation.cc:407] Connection header received
0811 05:08:22.462874 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:22.462875 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:22.462889 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:22.462945 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:22.463300 (+ 355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:22.463843 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:22.464825 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:22.465059 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:22.465121 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:22.468349 (+ 3228us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.191.193:50785: BlockingRecv error: recv got EOF from 127.26.191.193:50785 (error 108)
Metrics: {"server-negotiator.queue_time_us":121,"thread_start_us":59,"threads_started":1}
Aug 11 05:08:22 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.194@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:08:22 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.194@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:08:22.615538 9747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:22.610338 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:39591 (local address 127.26.191.194:50861)
0811 05:08:22.610600 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:22.610612 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:22.610671 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:22.610806 (+ 135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:22.610806 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:22.610999 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:22.611051 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:22.611052 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:22.611796 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:22.611797 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:22.612362 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:22.612364 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:22.612836 (+ 472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:22.612837 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:22.612883 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:22.613381 (+ 498us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:22.613387 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:22.615433 (+ 2046us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.191.254:39591: Server oryx/127.26.191.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":233,"thread_start_us":64,"threads_started":1}
W20260811 05:08:22.615598 9744 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:08:22.610604 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.194:50861 (local address 127.26.191.254:39591)
0811 05:08:22.610678 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:22.610679 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:22.610691 (+ 12us) server_negotiation.cc:407] Connection header received
0811 05:08:22.610715 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:22.610716 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:22.610730 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:22.610786 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:22.611147 (+ 361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:22.611665 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:22.612471 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:22.612672 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:22.612820 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:22.615532 (+ 2712us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.191.194:50861: BlockingRecv error: recv got EOF from 127.26.191.194:50861 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Aug 11 05:08:22 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.195@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:08:22 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.195@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:08:22.768712 9753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:22.763242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:39591 (local address 127.26.191.195:55103)
0811 05:08:22.763462 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:22.763475 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:22.763573 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:22.763752 (+ 179us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:22.763754 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:22.764075 (+ 321us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:22.764164 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:22.764167 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:22.765001 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:22.765003 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:22.765723 (+ 720us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:22.765726 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:22.766118 (+ 392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:22.766119 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:22.766178 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:22.766685 (+ 507us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:22.766690 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:22.768647 (+ 1957us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.191.254:39591: Server oryx/127.26.191.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":131,"threads_started":1}
W20260811 05:08:22.768970 9744 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:08:22.763364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.195:55103 (local address 127.26.191.254:39591)
0811 05:08:22.763447 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:22.763450 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:22.763552 (+ 102us) server_negotiation.cc:407] Connection header received
0811 05:08:22.763648 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:22.763649 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:22.763664 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:22.763729 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:22.764236 (+ 507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:22.764883 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:22.765826 (+ 943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:22.766044 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:22.766121 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:22.768901 (+ 2780us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.191.195:55103: BlockingRecv error: recv got EOF from 127.26.191.195:55103 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Aug 11 05:08:23 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.193@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:08:23 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.193@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:08:23.480492 9755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:23.468922 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:39591 (local address 127.26.191.193:35175)
0811 05:08:23.469082 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:23.469093 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:23.469145 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:23.469438 (+ 293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:23.469439 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:23.469616 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:23.469670 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:23.469672 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:23.470477 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:23.470479 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:23.471049 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:23.471051 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:23.471488 (+ 437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:23.471490 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:23.471540 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:23.478464 (+ 6924us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:23.478477 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:23.480428 (+ 1951us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.191.254:39591: Server oryx/127.26.191.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":96,"threads_started":1}
W20260811 05:08:23.480789 9756 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:08:23.469141 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.193:35175 (local address 127.26.191.254:39591)
0811 05:08:23.469279 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:23.469282 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:23.469296 (+ 14us) server_negotiation.cc:407] Connection header received
0811 05:08:23.469329 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:23.469329 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:23.469341 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:23.469413 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:23.469795 (+ 382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:23.470376 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:23.471155 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:23.471401 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:23.471473 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:23.480624 (+ 9151us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.191.193:35175: BlockingRecv error: recv got EOF from 127.26.191.193:35175 (error 108)
Metrics: {"server-negotiator.queue_time_us":112,"thread_start_us":78,"threads_started":1}
Aug 11 05:08:23 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.194@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:08:23 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.194@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:08:23.621795 9758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:23.616153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:39591 (local address 127.26.191.194:35495)
0811 05:08:23.616356 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:23.616370 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:23.616443 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:23.616606 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:23.616607 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:23.616823 (+ 216us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:23.616877 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:23.616879 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:23.617958 (+ 1079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:23.617959 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:23.618569 (+ 610us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:23.618571 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:23.619000 (+ 429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:23.619002 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:23.619060 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:23.619673 (+ 613us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:23.619678 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:23.621729 (+ 2051us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.191.254:39591: Server oryx/127.26.191.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":152,"threads_started":1}
W20260811 05:08:23.622068 9756 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:08:23.616260 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.194:35495 (local address 127.26.191.254:39591)
0811 05:08:23.616331 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:23.616333 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:23.616446 (+ 113us) server_negotiation.cc:407] Connection header received
0811 05:08:23.616517 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:23.616518 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:23.616531 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:23.616581 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:23.616947 (+ 366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:23.617869 (+ 922us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:23.618660 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:23.618899 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:23.618965 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:23.621865 (+ 2900us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.191.194:35495: BlockingRecv error: recv got EOF from 127.26.191.194:35495 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
Aug 11 05:08:23 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.195@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:08:23 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.195@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:08:23.774677 9759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:23.769331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:39591 (local address 127.26.191.195:36997)
0811 05:08:23.769601 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:23.769615 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:23.769687 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:23.769868 (+ 181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:23.769869 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:23.770046 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:23.770099 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:23.770100 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:23.770843 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:23.770844 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:23.771370 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:23.771371 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:23.771997 (+ 626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:23.771999 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:23.772081 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:23.772656 (+ 575us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:23.772661 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:23.774612 (+ 1951us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.191.254:39591: Server oryx/127.26.191.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":248,"thread_start_us":130,"threads_started":1}
W20260811 05:08:23.774883 9756 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:08:23.769442 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.195:36997 (local address 127.26.191.254:39591)
0811 05:08:23.769514 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:23.769516 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:23.769692 (+ 176us) server_negotiation.cc:407] Connection header received
0811 05:08:23.769736 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:23.769737 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:23.769751 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:23.769820 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:23.770192 (+ 372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:23.770740 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:23.771492 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:23.771861 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:23.771952 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:23.774760 (+ 2808us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.191.195:36997: BlockingRecv error: recv got EOF from 127.26.191.195:36997 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Aug 11 05:08:24 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.193@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:08:24 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.193@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:08:24.486387 9760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:24.481069 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:39591 (local address 127.26.191.193:58941)
0811 05:08:24.481241 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:24.481254 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:24.481333 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:24.481492 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:24.481493 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:24.481668 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:24.481723 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:24.481724 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:24.482473 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:24.482474 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:24.483082 (+ 608us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:24.483084 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:24.483594 (+ 510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:24.483595 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:24.483659 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:24.484314 (+ 655us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:24.484320 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:24.486319 (+ 1999us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.191.254:39591: Server oryx/127.26.191.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":114,"threads_started":1}
W20260811 05:08:24.486598 9762 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:08:24.481155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.193:58941 (local address 127.26.191.254:39591)
0811 05:08:24.481355 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:24.481357 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:24.481367 (+ 10us) server_negotiation.cc:407] Connection header received
0811 05:08:24.481402 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:24.481403 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:24.481415 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:24.481487 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:24.481794 (+ 307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:24.482355 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:24.483186 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:24.483508 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:24.483566 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:24.486501 (+ 2935us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.191.193:58941: BlockingRecv error: recv got EOF from 127.26.191.193:58941 (error 108)
Metrics: {"server-negotiator.queue_time_us":176,"thread_start_us":146,"threads_started":1}
Aug 11 05:08:24 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.194@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:08:24 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.194@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:08:24.628289 9763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:24.622485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:39591 (local address 127.26.191.194:42773)
0811 05:08:24.622671 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:24.622685 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:24.622768 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:24.623000 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:24.623001 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:24.623279 (+ 278us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:24.623351 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:24.623353 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:24.624208 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:24.624209 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:24.624905 (+ 696us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:24.624908 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:24.625492 (+ 584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:24.625493 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:24.625557 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:24.626077 (+ 520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:24.626082 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:24.628219 (+ 2137us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.191.254:39591: Server oryx/127.26.191.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":124,"threads_started":1}
W20260811 05:08:24.628432 9762 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:08:24.622588 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.194:42773 (local address 127.26.191.254:39591)
0811 05:08:24.622693 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:24.622696 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:24.622799 (+ 103us) server_negotiation.cc:407] Connection header received
0811 05:08:24.622840 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:24.622841 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:24.622857 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:24.622939 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:24.623482 (+ 543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:24.624083 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:24.625041 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:24.625404 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:24.625486 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:24.628337 (+ 2851us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.191.194:42773: BlockingRecv error: recv got EOF from 127.26.191.194:42773 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Aug 11 05:08:24 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.195@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:08:24 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.195@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:08:24.781296 9765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:24.775333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:39591 (local address 127.26.191.195:41825)
0811 05:08:24.775522 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:24.775535 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:24.775615 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:24.775784 (+ 169us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:24.775785 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:24.776003 (+ 218us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:24.776060 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:24.776062 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:24.776878 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:24.776879 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:24.777563 (+ 684us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:24.777567 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:24.778046 (+ 479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:24.778047 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:24.778098 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:24.778619 (+ 521us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:24.778623 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:24.781226 (+ 2603us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.191.254:39591: Server oryx/127.26.191.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":126,"threads_started":1}
W20260811 05:08:24.781515 9762 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:08:24.775409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.195:41825 (local address 127.26.191.254:39591)
0811 05:08:24.775505 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:24.775508 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:24.775646 (+ 138us) server_negotiation.cc:407] Connection header received
0811 05:08:24.775680 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:24.775681 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:24.775697 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:24.775760 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:24.776174 (+ 414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:24.776781 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:24.777697 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:24.777922 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:24.777995 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:24.781433 (+ 3438us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.191.195:41825: BlockingRecv error: recv got EOF from 127.26.191.195:41825 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Aug 11 05:08:25 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.193@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:08:25 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.193@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:08:25.492097 9766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:25.486939 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:39591 (local address 127.26.191.193:41097)
0811 05:08:25.487149 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:25.487161 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:25.487240 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:25.487380 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:25.487381 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:25.487561 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:25.487647 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:25.487649 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:25.488547 (+ 898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:25.488548 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:25.489127 (+ 579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:25.489129 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:25.489492 (+ 363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:25.489493 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:25.489537 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:25.490017 (+ 480us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:25.490023 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:25.491993 (+ 1970us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.191.254:39591: Server oryx/127.26.191.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":123,"threads_started":1}
W20260811 05:08:25.492158 9767 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:08:25.487035 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.193:41097 (local address 127.26.191.254:39591)
0811 05:08:25.487150 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:25.487152 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:25.487242 (+ 90us) server_negotiation.cc:407] Connection header received
0811 05:08:25.487287 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:25.487287 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:25.487300 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:25.487361 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:25.487731 (+ 370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:25.488477 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:25.489215 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:25.489421 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:25.489479 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:25.492084 (+ 2605us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.191.193:41097: BlockingRecv error: recv got EOF from 127.26.191.193:41097 (error 108)
Metrics: {"server-negotiator.queue_time_us":91,"thread_start_us":55,"threads_started":1}
Aug 11 05:08:25 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.194@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:08:25 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.194@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:08:25.634163 9769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:25.628895 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:39591 (local address 127.26.191.194:34357)
0811 05:08:25.629077 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:25.629089 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:25.629150 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:25.629273 (+ 123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:25.629274 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:25.629452 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:25.629503 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:25.629504 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:25.630418 (+ 914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:25.630419 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:25.631044 (+ 625us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:25.631046 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:25.631542 (+ 496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:25.631543 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:25.631587 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:25.632083 (+ 496us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:25.632088 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:25.634098 (+ 2010us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.191.254:39591: Server oryx/127.26.191.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":124,"threads_started":1}
W20260811 05:08:25.634344 9767 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:08:25.628958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.194:34357 (local address 127.26.191.254:39591)
0811 05:08:25.629054 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:25.629056 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:25.629135 (+ 79us) server_negotiation.cc:407] Connection header received
0811 05:08:25.629197 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:25.629198 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:25.629208 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:25.629261 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:25.629571 (+ 310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:25.630341 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:25.631118 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:25.631475 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:25.631535 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:25.634267 (+ 2732us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.191.194:34357: BlockingRecv error: recv got EOF from 127.26.191.194:34357 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
Aug 11 05:08:25 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.195@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:08:25 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.195@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:08:25.787390 9770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:25.781879 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:39591 (local address 127.26.191.195:48961)
0811 05:08:25.782033 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:25.782045 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:25.782108 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:25.782254 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:25.782255 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:25.782442 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:25.782496 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:25.782498 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:25.783510 (+ 1012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:25.783512 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:25.784248 (+ 736us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:25.784252 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:25.784671 (+ 419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:25.784672 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:25.784781 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:25.785333 (+ 552us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:25.785339 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:25.787268 (+ 1929us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.191.254:39591: Server oryx/127.26.191.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":91,"threads_started":1}
W20260811 05:08:25.787479 9767 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:08:25.781950 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.195:48961 (local address 127.26.191.254:39591)
0811 05:08:25.782038 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:25.782040 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:25.782093 (+ 53us) server_negotiation.cc:407] Connection header received
0811 05:08:25.782157 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:25.782158 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:25.782173 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:25.782239 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:25.782591 (+ 352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:25.783416 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:25.784356 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:25.784585 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:25.784671 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:25.787401 (+ 2730us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.191.195:48961: BlockingRecv error: recv got EOF from 127.26.191.195:48961 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 11 05:08:26 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.193@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:08:26 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.193@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:08:26.498104 9772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:26.492673 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:39591 (local address 127.26.191.193:58551)
0811 05:08:26.492940 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:26.492962 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:26.493024 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:26.493189 (+ 165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:26.493190 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:26.493370 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:26.493424 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:26.493425 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:26.494151 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:26.494152 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:26.494928 (+ 776us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:26.494930 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:26.495317 (+ 387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:26.495318 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:26.495363 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:26.495912 (+ 549us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:26.495918 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:26.498001 (+ 2083us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.191.254:39591: Server oryx/127.26.191.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":246,"thread_start_us":201,"threads_started":1}
W20260811 05:08:26.498163 9773 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:08:26.492876 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.193:58551 (local address 127.26.191.254:39591)
0811 05:08:26.493059 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:26.493061 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:26.493070 (+ 9us) server_negotiation.cc:407] Connection header received
0811 05:08:26.493096 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:26.493097 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:26.493108 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:26.493171 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:26.493506 (+ 335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:26.494059 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:26.495025 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:26.495239 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:26.495304 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:26.498091 (+ 2787us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.191.193:58551: BlockingRecv error: recv got EOF from 127.26.191.193:58551 (error 108)
Metrics: {"server-negotiator.queue_time_us":158,"thread_start_us":120,"threads_started":1}
Aug 11 05:08:26 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.194@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:08:26 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.194@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:08:26.640406 9775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:26.634844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:39591 (local address 127.26.191.194:34951)
0811 05:08:26.635023 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:26.635041 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:26.635110 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:26.635357 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:26.635358 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:26.635556 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:26.635617 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:26.635619 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:26.636390 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:26.636392 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:26.637023 (+ 631us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:26.637025 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:26.637512 (+ 487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:26.637513 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:26.637574 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:26.638141 (+ 567us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:26.638146 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:26.640338 (+ 2192us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.191.254:39591: Server oryx/127.26.191.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":99,"threads_started":1}
W20260811 05:08:26.640633 9773 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:08:26.634970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.194:34951 (local address 127.26.191.254:39591)
0811 05:08:26.635088 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:26.635091 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:26.635117 (+ 26us) server_negotiation.cc:407] Connection header received
0811 05:08:26.635211 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:26.635212 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:26.635227 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:26.635285 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:26.635745 (+ 460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:26.636253 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:26.637164 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:26.637381 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:26.637449 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:26.640563 (+ 3114us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.191.194:34951: BlockingRecv error: recv got EOF from 127.26.191.194:34951 (error 108)
Metrics: {"server-negotiator.queue_time_us":81}
Aug 11 05:08:26 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.195@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:08:26 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.195@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:08:26.793620 9776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:26.787965 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:39591 (local address 127.26.191.195:54283)
0811 05:08:26.788137 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:26.788148 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:26.788210 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:26.788479 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:26.788479 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:26.788654 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:26.788706 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:26.788708 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:26.789472 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:26.789473 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:26.790073 (+ 600us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:26.790075 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:26.790489 (+ 414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:26.790490 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:26.790547 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:26.791080 (+ 533us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:26.791085 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:26.793500 (+ 2415us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.191.254:39591: Server oryx/127.26.191.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":107,"threads_started":1}
W20260811 05:08:26.793671 9773 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:08:26.788061 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.195:54283 (local address 127.26.191.254:39591)
0811 05:08:26.788138 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:26.788140 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:26.788231 (+ 91us) server_negotiation.cc:407] Connection header received
0811 05:08:26.788262 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:26.788263 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:26.788278 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:26.788345 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:26.788861 (+ 516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:26.789379 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:26.790175 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:26.790387 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:26.790458 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:26.793600 (+ 3142us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.191.195:54283: BlockingRecv error: recv got EOF from 127.26.191.195:54283 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
Aug 11 05:08:27 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.193@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:08:27 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.193@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:08:27.504396 9777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:27.498779 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:39591 (local address 127.26.191.193:38727)
0811 05:08:27.498926 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:27.498937 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:27.498996 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:27.499220 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:27.499221 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:27.499431 (+ 210us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:27.499490 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:27.499492 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:27.500280 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:27.500281 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:27.500916 (+ 635us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:27.500919 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:27.501349 (+ 430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:27.501350 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:27.501417 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:27.502020 (+ 603us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:27.502025 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:27.504295 (+ 2270us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.191.254:39591: Server oryx/127.26.191.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":78,"threads_started":1}
W20260811 05:08:27.504459 9778 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:08:27.498875 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.193:38727 (local address 127.26.191.254:39591)
0811 05:08:27.499048 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:27.499050 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:27.499061 (+ 11us) server_negotiation.cc:407] Connection header received
0811 05:08:27.499087 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:27.499088 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:27.499100 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:27.499175 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:27.499603 (+ 428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:27.500175 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:27.501009 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:27.501259 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:27.501327 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:27.504398 (+ 3071us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.191.193:38727: BlockingRecv error: recv got EOF from 127.26.191.193:38727 (error 108)
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":116,"threads_started":1}
Aug 11 05:08:27 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.194@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:08:27 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.194@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:08:27.646131 9779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:27.640995 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:39591 (local address 127.26.191.194:42413)
0811 05:08:27.641151 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:27.641163 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:27.641235 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:27.641439 (+ 204us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:27.641441 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:27.641646 (+ 205us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:27.641700 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:27.641702 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:27.642435 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:27.642436 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:27.643000 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:27.643002 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:27.643381 (+ 379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:27.643382 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:27.643433 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:27.643926 (+ 493us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:27.643931 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:27.646055 (+ 2124us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.191.254:39591: Server oryx/127.26.191.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":89,"threads_started":1}
W20260811 05:08:27.646317 9778 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:08:27.641048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.194:42413 (local address 127.26.191.254:39591)
0811 05:08:27.641138 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:27.641139 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:27.641262 (+ 123us) server_negotiation.cc:407] Connection header received
0811 05:08:27.641302 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:27.641303 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:27.641316 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:27.641384 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:27.641814 (+ 430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:27.642331 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:27.643093 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:27.643296 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:27.643356 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:27.646184 (+ 2828us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.191.194:42413: BlockingRecv error: recv got EOF from 127.26.191.194:42413 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 11 05:08:27 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.195@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:08:27 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.195@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:08:27.799791 9782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:27.794234 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:39591 (local address 127.26.191.195:55301)
0811 05:08:27.794439 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:27.794453 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:27.794531 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:27.794765 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:27.794766 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:27.794972 (+ 206us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:27.795029 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:27.795031 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:27.795850 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:27.795855 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:27.796659 (+ 804us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:27.796663 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:27.797187 (+ 524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:27.797188 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:27.797246 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:27.797832 (+ 586us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:27.797841 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:27.799725 (+ 1884us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.191.254:39591: Server oryx/127.26.191.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":100,"threads_started":1}
W20260811 05:08:27.800041 9778 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:08:27.794439 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.195:55301 (local address 127.26.191.254:39591)
0811 05:08:27.794510 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:27.794513 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:27.794526 (+ 13us) server_negotiation.cc:407] Connection header received
0811 05:08:27.794611 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:27.794613 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:27.794636 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:27.794710 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:27.795129 (+ 419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:27.795723 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:27.796834 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:27.797047 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:27.797111 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:27.799953 (+ 2842us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.191.195:55301: BlockingRecv error: recv got EOF from 127.26.191.195:55301 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
Aug 11 05:08:28 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.193@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:08:28 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.193@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:08:28.515056 9783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:28.505023 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:39591 (local address 127.26.191.193:59703)
0811 05:08:28.505227 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:28.505239 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:28.505303 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:28.505508 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:28.505510 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:28.505697 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:28.505747 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:28.505748 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:28.506513 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:28.506514 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:28.507130 (+ 616us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:28.507132 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:28.507590 (+ 458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:28.507591 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:28.507649 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:28.512836 (+ 5187us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:28.512842 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:28.514937 (+ 2095us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.191.254:39591: Server oryx/127.26.191.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":121,"threads_started":1}
W20260811 05:08:28.515187 9784 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:08:28.505079 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.193:59703 (local address 127.26.191.254:39591)
0811 05:08:28.505221 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:28.505223 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:28.505300 (+ 77us) server_negotiation.cc:407] Connection header received
0811 05:08:28.505352 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:28.505353 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:28.505366 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:28.505438 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:28.505840 (+ 402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:28.506414 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:28.507247 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:28.507480 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:28.507559 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:28.515082 (+ 7523us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.191.193:59703: BlockingRecv error: recv got EOF from 127.26.191.193:59703 (error 108)
Metrics: {"server-negotiator.queue_time_us":116,"thread_start_us":80,"threads_started":1}
Aug 11 05:08:28 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.194@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:08:28 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.194@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:08:28.652532 9785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:28.646759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:39591 (local address 127.26.191.194:42905)
0811 05:08:28.646989 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:28.647002 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:28.647075 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:28.647228 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:28.647229 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:28.647431 (+ 202us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:28.647482 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:28.647484 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:28.648427 (+ 943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:28.648428 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:28.649433 (+ 1005us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:28.649437 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:28.649944 (+ 507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:28.649945 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:28.649996 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:28.650561 (+ 565us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:28.650566 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:28.652452 (+ 1886us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.191.254:39591: Server oryx/127.26.191.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":166,"threads_started":1}
W20260811 05:08:28.652762 9784 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:08:28.646843 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.194:42905 (local address 127.26.191.254:39591)
0811 05:08:28.646929 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:28.646932 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:28.647077 (+ 145us) server_negotiation.cc:407] Connection header received
0811 05:08:28.647128 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:28.647129 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:28.647141 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:28.647199 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:28.647591 (+ 392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:28.648290 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:28.649544 (+ 1254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:28.649767 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:28.649867 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:28.652672 (+ 2805us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.191.194:42905: BlockingRecv error: recv got EOF from 127.26.191.194:42905 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Aug 11 05:08:28 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.195@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:08:28 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.195@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:08:28.809201 9788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:28.800353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:39591 (local address 127.26.191.195:53619)
0811 05:08:28.800526 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:28.800570 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:28.800651 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:28.800924 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:28.800926 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:28.801147 (+ 221us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:28.801200 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:28.801202 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:28.801960 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:28.801961 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:28.802582 (+ 621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:28.802584 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:28.803014 (+ 430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:28.803016 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:28.803085 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:28.807003 (+ 3918us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:28.807011 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:28.809120 (+ 2109us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.191.254:39591: Server oryx/127.26.191.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":112,"threads_started":1}
W20260811 05:08:28.809357 9784 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:08:28.800504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.195:53619 (local address 127.26.191.254:39591)
0811 05:08:28.800606 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:28.800609 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:28.800626 (+ 17us) server_negotiation.cc:407] Connection header received
0811 05:08:28.800759 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:28.800760 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:28.800774 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:28.800906 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:28.801298 (+ 392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:28.801861 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:28.802700 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:28.802928 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:28.803014 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:28.809258 (+ 6244us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.191.195:53619: BlockingRecv error: recv got EOF from 127.26.191.195:53619 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
Aug 11 05:08:29 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.193@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:08:29 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.193@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:08:29.521334 9789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:29.515757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:39591 (local address 127.26.191.193:36241)
0811 05:08:29.515943 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:29.515955 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:29.516022 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:29.516223 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:29.516224 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:29.516433 (+ 209us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:29.516495 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:29.516497 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:29.517441 (+ 944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:29.517443 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:29.518145 (+ 702us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:29.518148 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:29.518547 (+ 399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:29.518549 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:29.518607 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:29.519134 (+ 527us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:29.519140 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:29.521252 (+ 2112us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.191.254:39591: Server oryx/127.26.191.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":105,"threads_started":1}
W20260811 05:08:29.521453 9790 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:08:29.515882 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.193:36241 (local address 127.26.191.254:39591)
0811 05:08:29.516038 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:29.516040 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:29.516051 (+ 11us) server_negotiation.cc:407] Connection header received
0811 05:08:29.516080 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:29.516081 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:29.516092 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:29.516160 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:29.516613 (+ 453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:29.517372 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:29.518235 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:29.518446 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:29.518506 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:29.521365 (+ 2859us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.191.193:36241: BlockingRecv error: recv got EOF from 127.26.191.193:36241 (error 108)
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":99,"threads_started":1}
Aug 11 05:08:29 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.194@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:08:29 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.194@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:08:29.659260 9791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:29.653313 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:39591 (local address 127.26.191.194:43027)
0811 05:08:29.653498 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:29.653528 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:29.653623 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:29.653902 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:29.653903 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:29.654280 (+ 377us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:29.654341 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:29.654345 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:29.655199 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:29.655200 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:29.655828 (+ 628us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:29.655830 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:29.656265 (+ 435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:29.656267 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:29.656325 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:29.656959 (+ 634us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:29.656965 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:29.659135 (+ 2170us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.191.254:39591: Server oryx/127.26.191.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":92,"threads_started":1}
W20260811 05:08:29.659319 9790 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:08:29.653389 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.194:43027 (local address 127.26.191.254:39591)
0811 05:08:29.653467 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:29.653470 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:29.653618 (+ 148us) server_negotiation.cc:407] Connection header received
0811 05:08:29.653721 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:29.653722 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:29.653736 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:29.653854 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:29.654467 (+ 613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:29.655088 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:29.655944 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:29.656161 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:29.656230 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:29.659245 (+ 3015us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.191.194:43027: BlockingRecv error: recv got EOF from 127.26.191.194:43027 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
Aug 11 05:08:29 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.195@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:08:29 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.195@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:08:29.815475 9793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:29.809842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:39591 (local address 127.26.191.195:33697)
0811 05:08:29.810054 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:29.810068 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:29.810154 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:29.810414 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:29.810415 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:29.810619 (+ 204us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:29.810672 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:29.810674 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:29.811447 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:29.811448 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:29.812104 (+ 656us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:29.812106 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:29.812496 (+ 390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:29.812497 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:29.812543 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:29.813158 (+ 615us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:29.813163 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:29.815354 (+ 2191us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.191.254:39591: Server oryx/127.26.191.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":98,"threads_started":1}
W20260811 05:08:29.815514 9790 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:08:29.810017 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.195:33697 (local address 127.26.191.254:39591)
0811 05:08:29.810088 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:29.810092 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:29.810131 (+ 39us) server_negotiation.cc:407] Connection header received
0811 05:08:29.810281 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:29.810282 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:29.810298 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:29.810364 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:29.810776 (+ 412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:29.811354 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:29.812184 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:29.812409 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:29.812480 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:29.815446 (+ 2966us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.191.195:33697: BlockingRecv error: recv got EOF from 127.26.191.195:33697 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Aug 11 05:08:30 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.193@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:08:30 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.193@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:08:30.527411 9795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:30.521950 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:39591 (local address 127.26.191.193:40705)
0811 05:08:30.522128 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:30.522139 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:30.522195 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:30.522370 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:30.522371 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:30.522565 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:30.522618 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:30.522619 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:30.523389 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:30.523390 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:30.523999 (+ 609us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:30.524001 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:30.524426 (+ 425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:30.524427 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:30.524489 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:30.525027 (+ 538us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:30.525033 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:30.527343 (+ 2310us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.191.254:39591: Server oryx/127.26.191.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":103,"threads_started":1}
W20260811 05:08:30.527601 9796 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:08:30.522074 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.193:40705 (local address 127.26.191.254:39591)
0811 05:08:30.522230 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:30.522232 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:30.522241 (+ 9us) server_negotiation.cc:407] Connection header received
0811 05:08:30.522266 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:30.522267 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:30.522279 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:30.522352 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:30.522768 (+ 416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:30.523295 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:30.524102 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:30.524320 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:30.524382 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:30.527483 (+ 3101us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.191.193:40705: BlockingRecv error: recv got EOF from 127.26.191.193:40705 (error 108)
Metrics: {"server-negotiator.queue_time_us":116,"thread_start_us":80,"threads_started":1}
Aug 11 05:08:30 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.194@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:08:30 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.194@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:08:30.665712 9797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:30.659943 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:39591 (local address 127.26.191.194:59253)
0811 05:08:30.660156 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:30.660172 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:30.660244 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:30.660504 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:30.660505 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:30.660692 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:30.660852 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:30.660855 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:30.661619 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:30.661620 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:30.662167 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:30.662169 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:30.662584 (+ 415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:30.662586 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:30.662644 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:30.663329 (+ 685us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:30.663335 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:30.665626 (+ 2291us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.191.254:39591: Server oryx/127.26.191.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":101,"threads_started":1}
W20260811 05:08:30.665807 9796 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:08:30.660133 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.194:59253 (local address 127.26.191.254:39591)
0811 05:08:30.660226 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:30.660228 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:30.660240 (+ 12us) server_negotiation.cc:407] Connection header received
0811 05:08:30.660374 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:30.660375 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:30.660390 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:30.660457 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:30.660958 (+ 501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:30.661522 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:30.662272 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:30.662483 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:30.662546 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:30.665741 (+ 3195us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.191.194:59253: BlockingRecv error: recv got EOF from 127.26.191.194:59253 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Aug 11 05:08:30 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.195@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:08:30 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.195@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:08:30.821619 9798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:30.816136 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:39591 (local address 127.26.191.195:52109)
0811 05:08:30.816368 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:30.816379 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:30.816468 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:30.816620 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:30.816621 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:30.816848 (+ 227us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:30.816900 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:30.816902 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:30.817617 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:30.817618 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:30.818176 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:30.818179 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:30.818612 (+ 433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:30.818613 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:30.818675 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:30.819181 (+ 506us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:30.819187 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:30.821513 (+ 2326us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.191.254:39591: Server oryx/127.26.191.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":128,"threads_started":1}
W20260811 05:08:30.821673 9796 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:08:30.816227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.195:52109 (local address 127.26.191.254:39591)
0811 05:08:30.816304 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:30.816307 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:30.816455 (+ 148us) server_negotiation.cc:407] Connection header received
0811 05:08:30.816541 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:30.816542 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:30.816558 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:30.816606 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:30.816993 (+ 387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:30.817524 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:30.818323 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:30.818532 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:30.818612 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:30.821605 (+ 2993us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.191.195:52109: BlockingRecv error: recv got EOF from 127.26.191.195:52109 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
Aug 11 05:08:31 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.193@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:08:31 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.193@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:08:31.533545 9799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:31.528030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:39591 (local address 127.26.191.193:48221)
0811 05:08:31.528203 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:31.528217 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:31.528312 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:31.528503 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:31.528504 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:31.528690 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:31.528771 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:31.528772 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:31.529497 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:31.529498 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:31.530194 (+ 696us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:31.530197 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:31.530681 (+ 484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:31.530682 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:31.530751 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:31.531349 (+ 598us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:31.531354 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:31.533470 (+ 2116us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.191.254:39591: Server oryx/127.26.191.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":76,"threads_started":1}
W20260811 05:08:31.533666 9800 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:08:31.528152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.193:48221 (local address 127.26.191.254:39591)
0811 05:08:31.528321 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:31.528322 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:31.528353 (+ 31us) server_negotiation.cc:407] Connection header received
0811 05:08:31.528377 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:31.528378 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:31.528389 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:31.528441 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:31.528880 (+ 439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:31.529402 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:31.530276 (+ 874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:31.530587 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:31.530720 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:31.533575 (+ 2855us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.191.193:48221: BlockingRecv error: recv got EOF from 127.26.191.193:48221 (error 108)
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":93,"threads_started":1}
Aug 11 05:08:31 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.194@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:08:31 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.194@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:08:31.671469 9801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:31.666204 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:39591 (local address 127.26.191.194:50641)
0811 05:08:31.666369 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:31.666384 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:31.666460 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:31.666621 (+ 161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:31.666621 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:31.666832 (+ 211us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:31.666884 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:31.666886 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:31.667598 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:31.667600 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:31.668132 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:31.668133 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:31.668546 (+ 413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:31.668547 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:31.668616 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:31.669217 (+ 601us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:31.669222 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:31.671364 (+ 2142us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.191.254:39591: Server oryx/127.26.191.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":96,"threads_started":1}
W20260811 05:08:31.671550 9800 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:08:31.666340 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.194:50641 (local address 127.26.191.254:39591)
0811 05:08:31.666411 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:31.666413 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:31.666438 (+ 25us) server_negotiation.cc:407] Connection header received
0811 05:08:31.666544 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:31.666546 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:31.666558 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:31.666604 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:31.666972 (+ 368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:31.667504 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:31.668239 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:31.668460 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:31.668536 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:31.671478 (+ 2942us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.191.194:50641: BlockingRecv error: recv got EOF from 127.26.191.194:50641 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Aug 11 05:08:31 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.195@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:08:31 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.195@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:08:31.827510 9802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:31.822233 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:39591 (local address 127.26.191.195:40139)
0811 05:08:31.822416 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:31.822433 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:31.822514 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:31.822761 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:31.822762 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:31.823071 (+ 309us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:31.823136 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:31.823139 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:31.823944 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:31.823945 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:31.824480 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:31.824481 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:31.824951 (+ 470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:31.824952 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:31.825001 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:31.825470 (+ 469us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:31.825475 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:31.827434 (+ 1959us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.191.254:39591: Server oryx/127.26.191.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":115,"threads_started":1}
W20260811 05:08:31.827724 9800 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:08:31.822385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.195:40139 (local address 127.26.191.254:39591)
0811 05:08:31.822459 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:31.822462 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:31.822498 (+ 36us) server_negotiation.cc:407] Connection header received
0811 05:08:31.822627 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:31.822628 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:31.822647 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:31.822714 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:31.823271 (+ 557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:31.823847 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:31.824585 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:31.824874 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:31.824939 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:31.827628 (+ 2689us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.191.195:40139: BlockingRecv error: recv got EOF from 127.26.191.195:40139 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Aug 11 05:08:32 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.193@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:08:32 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.193@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:08:32.538982 9803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:32.534134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:39591 (local address 127.26.191.193:47045)
0811 05:08:32.534280 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:32.534294 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:32.534387 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:32.534534 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:32.534535 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:32.534713 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:32.534767 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:32.534769 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:32.535448 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:32.535449 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:32.535987 (+ 538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:32.535988 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:32.536378 (+ 390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:32.536379 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:32.536430 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:32.536948 (+ 518us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:32.536953 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:32.538913 (+ 1960us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.191.254:39591: Server oryx/127.26.191.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":58,"threads_started":1}
W20260811 05:08:32.539152 9804 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:08:32.534227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.193:47045 (local address 127.26.191.254:39591)
0811 05:08:32.534375 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:32.534377 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:32.534386 (+ 9us) server_negotiation.cc:407] Connection header received
0811 05:08:32.534447 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:32.534448 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:32.534458 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:32.534507 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:32.534837 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:32.535358 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:32.536072 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:32.536274 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:32.536332 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:32.539041 (+ 2709us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.191.193:47045: BlockingRecv error: recv got EOF from 127.26.191.193:47045 (error 108)
Metrics: {"server-negotiator.queue_time_us":121,"thread_start_us":73,"threads_started":1}
Aug 11 05:08:32 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.194@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:08:32 dist-test-slave-x5fp krb5kdc[8131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.191.194@KRBTEST.COM for oryx/127.26.191.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:08:32.677898 9806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:32.672136 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:39591 (local address 127.26.191.194:45103)
0811 05:08:32.672406 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:32.672428 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:32.672493 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:32.672668 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:32.672669 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:32.672877 (+ 208us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:32.672929 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:32.672931 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:32.673704 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:32.673705 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:32.674356 (+ 651us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:32.674360 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:32.674800 (+ 440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:32.674802 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:32.674862 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:32.675461 (+ 599us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:32.675466 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:32.677792 (+ 2326us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.191.254:39591: Server oryx/127.26.191.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":252,"thread_start_us":187,"threads_started":1}
W20260811 05:08:32.678061 9804 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:08:32.672267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.194:45103 (local address 127.26.191.254:39591)
0811 05:08:32.672351 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:32.672353 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:32.672531 (+ 178us) server_negotiation.cc:407] Connection header received
0811 05:08:32.672567 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:32.672568 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:32.672580 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:32.672649 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:32.673052 (+ 403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:32.673610 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:32.674469 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:32.674677 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:32.674752 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:32.677948 (+ 3196us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.191.194:45103: BlockingRecv error: recv got EOF from 127.26.191.194:45103 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 05:08:32.734112 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 9048
I20260811 05:08:32.748287 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 9294
I20260811 05:08:32.758066 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 9505
I20260811 05:08:32.767859 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 8931
2026-08-11T05:08:32Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (17945 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-11T05:08:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:08:32Z Disabled control of system clock
I20260811 05:08:32.814113 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424853995437-27391-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424853995437-27391-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424853995437-27391-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.254:36901
--webserver_interface=127.26.191.254
--webserver_port=0
--builtin_ntp_servers=127.26.191.212:46071
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.191.254:36901
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260811 05:08:32.902895 9813 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:08:32.903136 9813 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:08:32.903158 9813 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:08:32.904574 9813 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:08:32.904632 9813 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:08:32.904646 9813 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:08:32.904661 9813 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:08:32.904675 9813 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:08:32.906231 9813 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:46071
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424853995437-27391-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424853995437-27391-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.191.254:36901
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.254:36901
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.191.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9813
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424853995437-27391-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:08:32.906517 9813 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:08:32.906863 9813 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:08:32.912446 9823 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:32.912555 9820 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:08:32.912637 9813 server_base.cc:1034] running on GCE node
W20260811 05:08:32.912598 9819 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:08:32.913175 9813 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:08:32.913501 9813 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:08:32.914675 9813 hybrid_clock.cc:648] HybridClock initialized: now 1786424912914636 us; error 53 us; skew 500 ppm
I20260811 05:08:32.916189 9813 webserver.cc:460] Webserver started at http://127.26.191.254:35213/ using document root <none> and password file <none>
I20260811 05:08:32.916465 9813 fs_manager.cc:359] Metadata directory not provided
I20260811 05:08:32.916545 9813 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:08:32.916692 9813 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:08:32.917991 9813 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424853995437-27391-0/minicluster-data/master-0/data/instance:
uuid: "203bbec43ab146328fe227f295fa2724"
format_stamp: "Formatted at 2026-08-11 05:08:32 on dist-test-slave-x5fp"
server_key: "63ffd4271490a69cb73e5fd717c4acc6"
server_key_iv: "195c864ec33a6ac5abfae42bc9c4a6a3"
server_key_version: "encryptionkey@0"
I20260811 05:08:32.918578 9813 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424853995437-27391-0/minicluster-data/master-0/wal/instance:
uuid: "203bbec43ab146328fe227f295fa2724"
format_stamp: "Formatted at 2026-08-11 05:08:32 on dist-test-slave-x5fp"
server_key: "63ffd4271490a69cb73e5fd717c4acc6"
server_key_iv: "195c864ec33a6ac5abfae42bc9c4a6a3"
server_key_version: "encryptionkey@0"
I20260811 05:08:32.920415 9813 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.003s
I20260811 05:08:32.921706 9833 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:32.921916 9813 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:08:32.922055 9813 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424853995437-27391-0/minicluster-data/master-0/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424853995437-27391-0/minicluster-data/master-0/wal
uuid: "203bbec43ab146328fe227f295fa2724"
format_stamp: "Formatted at 2026-08-11 05:08:32 on dist-test-slave-x5fp"
server_key: "63ffd4271490a69cb73e5fd717c4acc6"
server_key_iv: "195c864ec33a6ac5abfae42bc9c4a6a3"
server_key_version: "encryptionkey@0"
I20260811 05:08:32.922154 9813 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424853995437-27391-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424853995437-27391-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424853995437-27391-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:08:32.941294 9813 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:08:32.941694 9813 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:08:32.941862 9813 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:08:32.946311 9813 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.254:36901
I20260811 05:08:32.946378 9918 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.254:36901 every 8 connection(s)
I20260811 05:08:32.946769 9813 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
I20260811 05:08:32.947583 9919 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:08:32.950014 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 9813
I20260811 05:08:32.950120 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424853995437-27391-0/minicluster-data/master-0/wal/instance
I20260811 05:08:32.950332 27391 external_mini_cluster.cc:1428] Setting key 49d5fe0d3eba8cb69d1475fd3dee86ec
I20260811 05:08:32.951014 9919 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 203bbec43ab146328fe227f295fa2724: Bootstrap starting.
I20260811 05:08:32.951800 9919 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 203bbec43ab146328fe227f295fa2724: Neither blocks nor log segments found. Creating new log.
I20260811 05:08:32.952165 9919 log.cc:824] T 00000000000000000000000000000000 P 203bbec43ab146328fe227f295fa2724: Log is configured to *not* fsync() on all Append() calls
I20260811 05:08:32.952978 9919 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 203bbec43ab146328fe227f295fa2724: No bootstrap required, opened a new log
I20260811 05:08:32.954974 9919 raft_consensus.cc:348] T 00000000000000000000000000000000 P 203bbec43ab146328fe227f295fa2724 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "203bbec43ab146328fe227f295fa2724" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 36901 } }
I20260811 05:08:32.955142 9919 raft_consensus.cc:374] T 00000000000000000000000000000000 P 203bbec43ab146328fe227f295fa2724 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:08:32.955191 9919 raft_consensus.cc:729] T 00000000000000000000000000000000 P 203bbec43ab146328fe227f295fa2724 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 203bbec43ab146328fe227f295fa2724, State: Initialized, Role: FOLLOWER
I20260811 05:08:32.955387 9919 consensus_queue.cc:260] T 00000000000000000000000000000000 P 203bbec43ab146328fe227f295fa2724 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "203bbec43ab146328fe227f295fa2724" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 36901 } }
I20260811 05:08:32.955507 9919 raft_consensus.cc:388] T 00000000000000000000000000000000 P 203bbec43ab146328fe227f295fa2724 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:08:32.955546 9919 raft_consensus.cc:482] T 00000000000000000000000000000000 P 203bbec43ab146328fe227f295fa2724 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:08:32.955608 9919 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 203bbec43ab146328fe227f295fa2724 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:08:32.956346 9919 raft_consensus.cc:504] T 00000000000000000000000000000000 P 203bbec43ab146328fe227f295fa2724 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "203bbec43ab146328fe227f295fa2724" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 36901 } }
I20260811 05:08:32.956478 9919 leader_election.cc:302] T 00000000000000000000000000000000 P 203bbec43ab146328fe227f295fa2724 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 203bbec43ab146328fe227f295fa2724; no voters:
I20260811 05:08:32.956712 9919 leader_election.cc:288] T 00000000000000000000000000000000 P 203bbec43ab146328fe227f295fa2724 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 05:08:32.956821 9926 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 203bbec43ab146328fe227f295fa2724 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:08:32.957049 9924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:32.950917 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52506 (local address 127.26.191.254:36901)
0811 05:08:32.951168 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:32.951178 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:32.951220 (+ 42us) server_negotiation.cc:407] Connection header received
0811 05:08:32.951863 (+ 643us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:32.951874 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:32.951968 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:32.952134 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:32.952442 (+ 308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:32.953513 (+ 1071us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:32.954512 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:32.955194 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:32.955373 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:32.956117 (+ 744us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:32.956121 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:32.956121 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:08:32.956325 (+ 204us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:32.956364 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:08:32.956377 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:32.956479 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:32.956567 (+ 88us) server_negotiation.cc:299] Negotiation successful
0811 05:08:32.956661 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":168,"thread_start_us":111,"threads_started":1}
I20260811 05:08:32.957070 9926 raft_consensus.cc:686] T 00000000000000000000000000000000 P 203bbec43ab146328fe227f295fa2724 [term 1 LEADER]: Becoming Leader. State: Replica: 203bbec43ab146328fe227f295fa2724, State: Running, Role: LEADER
I20260811 05:08:32.957315 9926 consensus_queue.cc:237] T 00000000000000000000000000000000 P 203bbec43ab146328fe227f295fa2724 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "203bbec43ab146328fe227f295fa2724" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 36901 } }
I20260811 05:08:32.957099 9919 sys_catalog.cc:564] T 00000000000000000000000000000000 P 203bbec43ab146328fe227f295fa2724 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:08:32.957687 9927 sys_catalog.cc:455] T 00000000000000000000000000000000 P 203bbec43ab146328fe227f295fa2724 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "203bbec43ab146328fe227f295fa2724" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "203bbec43ab146328fe227f295fa2724" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 36901 } } }
I20260811 05:08:32.957881 9927 sys_catalog.cc:458] T 00000000000000000000000000000000 P 203bbec43ab146328fe227f295fa2724 [sys.catalog]: This master's current role is: LEADER
I20260811 05:08:32.958236 9931 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:08:32.958421 9928 sys_catalog.cc:455] T 00000000000000000000000000000000 P 203bbec43ab146328fe227f295fa2724 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 203bbec43ab146328fe227f295fa2724. Latest consensus state: current_term: 1 leader_uuid: "203bbec43ab146328fe227f295fa2724" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "203bbec43ab146328fe227f295fa2724" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 36901 } } }
I20260811 05:08:32.958537 9928 sys_catalog.cc:458] T 00000000000000000000000000000000 P 203bbec43ab146328fe227f295fa2724 [sys.catalog]: This master's current role is: LEADER
I20260811 05:08:32.958870 9931 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:08:32.960700 9931 catalog_manager.cc:1347] Generated new cluster ID: 9d0f5d19331841ef9f538f89d18a8005
I20260811 05:08:32.960794 9931 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:08:32.975167 9931 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:08:32.975996 9931 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:08:32.984915 9931 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 203bbec43ab146328fe227f295fa2724: Generated new TSK 0
I20260811 05:08:32.985318 9931 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 05:08:32.996209 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.191.193:0
--local_ip_for_outbound_sockets=127.26.191.193
--webserver_interface=127.26.191.193
--webserver_port=0
--tserver_master_addrs=127.26.191.254:36901
--builtin_ntp_servers=127.26.191.212:46071
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260811 05:08:33.089428 9962 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:08:33.089655 9962 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:08:33.089679 9962 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:08:33.090868 9962 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:08:33.090917 9962 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:08:33.090943 9962 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.191.193
I20260811 05:08:33.092307 9962 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:46071
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.191.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.191.193
--webserver_port=0
--tserver_master_addrs=127.26.191.254:36901
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9962
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.191.193
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:08:33.092612 9962 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:08:33.092983 9962 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:08:33.098311 9970 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:33.098428 9971 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:33.098311 9973 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:08:33.098738 9962 server_base.cc:1034] running on GCE node
I20260811 05:08:33.098963 9962 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:08:33.099239 9962 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:08:33.100435 9962 hybrid_clock.cc:648] HybridClock initialized: now 1786424913100410 us; error 45 us; skew 500 ppm
I20260811 05:08:33.102169 9962 webserver.cc:460] Webserver started at http://127.26.191.193:43567/ using document root <none> and password file <none>
I20260811 05:08:33.102469 9962 fs_manager.cc:359] Metadata directory not provided
I20260811 05:08:33.102535 9962 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:08:33.102669 9962 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:08:33.104308 9962 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-0/data/instance:
uuid: "5b3e624205d14cccacff57f6a0f05306"
format_stamp: "Formatted at 2026-08-11 05:08:33 on dist-test-slave-x5fp"
server_key: "727fc773f9e49bbe1ab156ff817c8e53"
server_key_iv: "0a45007f5d7d74973bb1f578c38dd039"
server_key_version: "encryptionkey@0"
I20260811 05:08:33.104799 9962 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-0/wal/instance:
uuid: "5b3e624205d14cccacff57f6a0f05306"
format_stamp: "Formatted at 2026-08-11 05:08:33 on dist-test-slave-x5fp"
server_key: "727fc773f9e49bbe1ab156ff817c8e53"
server_key_iv: "0a45007f5d7d74973bb1f578c38dd039"
server_key_version: "encryptionkey@0"
I20260811 05:08:33.106634 9962 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.000s
I20260811 05:08:33.107592 9982 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:33.107818 9962 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:08:33.107915 9962 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-0/wal
uuid: "5b3e624205d14cccacff57f6a0f05306"
format_stamp: "Formatted at 2026-08-11 05:08:33 on dist-test-slave-x5fp"
server_key: "727fc773f9e49bbe1ab156ff817c8e53"
server_key_iv: "0a45007f5d7d74973bb1f578c38dd039"
server_key_version: "encryptionkey@0"
I20260811 05:08:33.107991 9962 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:08:33.124037 9962 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:08:33.124357 9962 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:08:33.124472 9962 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:08:33.124701 9962 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:08:33.125166 9962 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:08:33.125257 9962 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:33.125305 9962 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:08:33.125329 9962 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:33.131951 9962 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.193:33159
I20260811 05:08:33.132005 10157 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.193:33159 every 8 connection(s)
I20260811 05:08:33.132390 9962 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-0/data/info.pb
I20260811 05:08:33.133551 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 9962
I20260811 05:08:33.133673 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-0/wal/instance
I20260811 05:08:33.133912 27391 external_mini_cluster.cc:1428] Setting key 5855ed59d3ceb194309b7cd5ab56a479
I20260811 05:08:33.134932 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.191.194:0
--local_ip_for_outbound_sockets=127.26.191.194
--webserver_interface=127.26.191.194
--webserver_port=0
--tserver_master_addrs=127.26.191.254:36901
--builtin_ntp_servers=127.26.191.212:46071
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260811 05:08:33.138412 9924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:33.133233 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.193:47215 (local address 127.26.191.254:36901)
0811 05:08:33.133316 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:33.133319 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:33.133571 (+ 252us) server_negotiation.cc:407] Connection header received
0811 05:08:33.134232 (+ 661us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:33.134234 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:33.134246 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:33.134300 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:33.135027 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:33.135590 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:33.136621 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:33.136891 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:33.136974 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:33.138058 (+ 1084us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:33.138060 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:33.138060 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:08:33.138066 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:33.138084 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:08:33.138088 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:33.138163 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:33.138265 (+ 102us) server_negotiation.cc:299] Negotiation successful
0811 05:08:33.138326 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 05:08:33.138633 10160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:33.133234 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:36901 (local address 127.26.191.193:47215)
0811 05:08:33.133438 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:33.133485 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:33.134118 (+ 633us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:33.134387 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:33.134392 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:33.134407 (+ 15us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:33.134932 (+ 525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:33.134937 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:33.135699 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:33.135700 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:33.136525 (+ 825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:33.136527 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:33.136990 (+ 463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:33.136991 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:33.137143 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:33.137870 (+ 727us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 05:08:33.137871 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:33.137904 (+ 33us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 05:08:33.137932 (+ 28us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:08:33.138165 (+ 233us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:08:33.138172 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:08:33.138176 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 05:08:33.138268 (+ 92us) client_negotiation.cc:240] Negotiation successful
0811 05:08:33.138398 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":97,"threads_started":1}
I20260811 05:08:33.139134 10158 heartbeater.cc:347] Connected to a master server at 127.26.191.254:36901
I20260811 05:08:33.139240 10158 heartbeater.cc:464] Registering TS with master...
I20260811 05:08:33.139410 10158 heartbeater.cc:511] Master 127.26.191.254:36901 requested a full tablet report, sending...
I20260811 05:08:33.139959 9865 ts_manager.cc:194] Registered new tserver with Master: 5b3e624205d14cccacff57f6a0f05306 (127.26.191.193:33159)
I20260811 05:08:33.140625 9865 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.191.193:47215
W20260811 05:08:33.224617 10161 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:08:33.225026 10161 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:08:33.225068 10161 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:08:33.226332 10161 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:08:33.226413 10161 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:08:33.226459 10161 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.191.194
I20260811 05:08:33.227913 10161 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:46071
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.191.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.191.194
--webserver_port=0
--tserver_master_addrs=127.26.191.254:36901
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10161
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.191.194
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:08:33.228228 10161 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:08:33.228578 10161 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 05:08:33.234277 10161 server_base.cc:1034] running on GCE node
W20260811 05:08:33.234256 10169 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:33.234256 10171 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:33.234279 10180 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:08:33.234834 10161 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:08:33.235160 10161 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:08:33.236342 10161 hybrid_clock.cc:648] HybridClock initialized: now 1786424913236315 us; error 42 us; skew 500 ppm
I20260811 05:08:33.238071 10161 webserver.cc:460] Webserver started at http://127.26.191.194:46503/ using document root <none> and password file <none>
I20260811 05:08:33.238404 10161 fs_manager.cc:359] Metadata directory not provided
I20260811 05:08:33.238461 10161 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:08:33.238626 10161 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:08:33.239816 10161 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-1/data/instance:
uuid: "33d6ff9c79444ef0a52eb04e219d1512"
format_stamp: "Formatted at 2026-08-11 05:08:33 on dist-test-slave-x5fp"
server_key: "7c7bc53d5bc88a454623a8f81e407917"
server_key_iv: "142ee24241b5e62216de3bd8c717eb91"
server_key_version: "encryptionkey@0"
I20260811 05:08:33.240219 10161 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-1/wal/instance:
uuid: "33d6ff9c79444ef0a52eb04e219d1512"
format_stamp: "Formatted at 2026-08-11 05:08:33 on dist-test-slave-x5fp"
server_key: "7c7bc53d5bc88a454623a8f81e407917"
server_key_iv: "142ee24241b5e62216de3bd8c717eb91"
server_key_version: "encryptionkey@0"
I20260811 05:08:33.241868 10161 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 05:08:33.242967 10190 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:33.243247 10161 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:08:33.243364 10161 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-1/wal
uuid: "33d6ff9c79444ef0a52eb04e219d1512"
format_stamp: "Formatted at 2026-08-11 05:08:33 on dist-test-slave-x5fp"
server_key: "7c7bc53d5bc88a454623a8f81e407917"
server_key_iv: "142ee24241b5e62216de3bd8c717eb91"
server_key_version: "encryptionkey@0"
I20260811 05:08:33.243453 10161 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:08:33.271142 10161 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:08:33.271540 10161 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:08:33.271672 10161 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:08:33.272053 10161 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:08:33.272464 10161 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:08:33.272533 10161 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:33.272578 10161 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:08:33.272608 10161 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:33.279731 10161 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.194:43549
I20260811 05:08:33.279808 10358 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.194:43549 every 8 connection(s)
I20260811 05:08:33.280208 10161 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-1/data/info.pb
I20260811 05:08:33.282313 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 10161
I20260811 05:08:33.282400 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-1/wal/instance
I20260811 05:08:33.282611 27391 external_mini_cluster.cc:1428] Setting key 5651ef1771e2a06f6c0982d2346a533d
I20260811 05:08:33.283980 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.191.195:0
--local_ip_for_outbound_sockets=127.26.191.195
--webserver_interface=127.26.191.195
--webserver_port=0
--tserver_master_addrs=127.26.191.254:36901
--builtin_ntp_servers=127.26.191.212:46071
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260811 05:08:33.286966 9924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:33.281102 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.194:44767 (local address 127.26.191.254:36901)
0811 05:08:33.281189 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:33.281191 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:33.281392 (+ 201us) server_negotiation.cc:407] Connection header received
0811 05:08:33.282015 (+ 623us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:33.282017 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:33.282029 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:33.282114 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:33.283081 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:33.283702 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:33.284964 (+ 1262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:33.285289 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:33.285371 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:33.286618 (+ 1247us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:33.286620 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:33.286621 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:08:33.286626 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:33.286644 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:08:33.286648 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:33.286704 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:33.286868 (+ 164us) server_negotiation.cc:299] Negotiation successful
0811 05:08:33.286899 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 05:08:33.287266 10362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:33.281023 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:36901 (local address 127.26.191.194:44767)
0811 05:08:33.281229 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:33.281289 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:33.281908 (+ 619us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:33.282175 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:33.282178 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:33.282187 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:33.282869 (+ 682us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:33.282906 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:33.283820 (+ 914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:33.283821 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:33.284863 (+ 1042us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:33.284866 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:33.285408 (+ 542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:33.285409 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:33.285548 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:33.286405 (+ 857us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 05:08:33.286406 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:33.286453 (+ 47us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 05:08:33.286489 (+ 36us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:08:33.286727 (+ 238us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:08:33.286734 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:08:33.286739 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 05:08:33.286829 (+ 90us) client_negotiation.cc:240] Negotiation successful
0811 05:08:33.286969 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":75,"threads_started":1}
I20260811 05:08:33.287977 10359 heartbeater.cc:347] Connected to a master server at 127.26.191.254:36901
I20260811 05:08:33.288093 10359 heartbeater.cc:464] Registering TS with master...
I20260811 05:08:33.288344 10359 heartbeater.cc:511] Master 127.26.191.254:36901 requested a full tablet report, sending...
I20260811 05:08:33.288863 9865 ts_manager.cc:194] Registered new tserver with Master: 33d6ff9c79444ef0a52eb04e219d1512 (127.26.191.194:43549)
I20260811 05:08:33.289369 9865 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.191.194:44767
W20260811 05:08:33.372359 10363 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:08:33.372674 10363 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:08:33.372713 10363 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:08:33.373978 10363 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:08:33.374055 10363 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:08:33.374100 10363 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.191.195
I20260811 05:08:33.375506 10363 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:46071
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.191.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.191.195
--webserver_port=0
--tserver_master_addrs=127.26.191.254:36901
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10363
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.191.195
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:08:33.375816 10363 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:08:33.376152 10363 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:08:33.381953 10371 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:33.381946 10370 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:33.382153 10374 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:08:33.381973 10363 server_base.cc:1034] running on GCE node
I20260811 05:08:33.382483 10363 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:08:33.382748 10363 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:08:33.383950 10363 hybrid_clock.cc:648] HybridClock initialized: now 1786424913383931 us; error 34 us; skew 500 ppm
I20260811 05:08:33.385600 10363 webserver.cc:460] Webserver started at http://127.26.191.195:39877/ using document root <none> and password file <none>
I20260811 05:08:33.385885 10363 fs_manager.cc:359] Metadata directory not provided
I20260811 05:08:33.385962 10363 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:08:33.386130 10363 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:08:33.387284 10363 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-2/data/instance:
uuid: "5b6219cc30fb4eaaabde722b6bcff2bc"
format_stamp: "Formatted at 2026-08-11 05:08:33 on dist-test-slave-x5fp"
server_key: "0167bf0cea14608c21d117c004408ee6"
server_key_iv: "1428ee76f248ca755dfc2dcd77ef19af"
server_key_version: "encryptionkey@0"
I20260811 05:08:33.387682 10363 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-2/wal/instance:
uuid: "5b6219cc30fb4eaaabde722b6bcff2bc"
format_stamp: "Formatted at 2026-08-11 05:08:33 on dist-test-slave-x5fp"
server_key: "0167bf0cea14608c21d117c004408ee6"
server_key_iv: "1428ee76f248ca755dfc2dcd77ef19af"
server_key_version: "encryptionkey@0"
I20260811 05:08:33.389117 10363 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 05:08:33.389901 10384 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:33.390090 10363 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 05:08:33.390211 10363 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-2/wal
uuid: "5b6219cc30fb4eaaabde722b6bcff2bc"
format_stamp: "Formatted at 2026-08-11 05:08:33 on dist-test-slave-x5fp"
server_key: "0167bf0cea14608c21d117c004408ee6"
server_key_iv: "1428ee76f248ca755dfc2dcd77ef19af"
server_key_version: "encryptionkey@0"
I20260811 05:08:33.390291 10363 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:08:33.402640 10363 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:08:33.403028 10363 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:08:33.403192 10363 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:08:33.403442 10363 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:08:33.403797 10363 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:08:33.403856 10363 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:33.403903 10363 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:08:33.403930 10363 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:33.410105 10363 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.195:41781
I20260811 05:08:33.410147 10563 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.195:41781 every 8 connection(s)
I20260811 05:08:33.410511 10363 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-2/data/info.pb
I20260811 05:08:33.411487 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 10363
I20260811 05:08:33.411610 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-2/wal/instance
I20260811 05:08:33.411881 27391 external_mini_cluster.cc:1428] Setting key 2b4d9526c03e4aa60bfb3dea2e6aa4cc
I20260811 05:08:33.416477 9924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:33.411350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.195:41443 (local address 127.26.191.254:36901)
0811 05:08:33.411438 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:33.411441 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:33.411643 (+ 202us) server_negotiation.cc:407] Connection header received
0811 05:08:33.412427 (+ 784us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:33.412429 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:33.412442 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:33.412485 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:33.413344 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:33.413868 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:33.414914 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:33.415131 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:33.415210 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:33.416145 (+ 935us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:33.416146 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:33.416147 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:08:33.416152 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:33.416168 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:08:33.416172 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:33.416246 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:33.416354 (+ 108us) server_negotiation.cc:299] Negotiation successful
0811 05:08:33.416388 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 05:08:33.416769 10567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:33.411296 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:36901 (local address 127.26.191.195:41443)
0811 05:08:33.411490 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:33.411535 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:33.412307 (+ 772us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:33.412562 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:33.412566 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:33.412576 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:33.413247 (+ 671us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:33.413252 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:33.413972 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:33.413974 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:33.414816 (+ 842us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:33.414818 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:33.415224 (+ 406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:33.415225 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:33.415373 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:33.415966 (+ 593us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 05:08:33.415967 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:33.415998 (+ 31us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 05:08:33.416022 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:08:33.416249 (+ 227us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:08:33.416255 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:08:33.416259 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 05:08:33.416356 (+ 97us) client_negotiation.cc:240] Negotiation successful
0811 05:08:33.416469 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":90,"threads_started":1}
I20260811 05:08:33.417272 10564 heartbeater.cc:347] Connected to a master server at 127.26.191.254:36901
I20260811 05:08:33.417404 10564 heartbeater.cc:464] Registering TS with master...
I20260811 05:08:33.417598 10564 heartbeater.cc:511] Master 127.26.191.254:36901 requested a full tablet report, sending...
I20260811 05:08:33.417991 9865 ts_manager.cc:194] Registered new tserver with Master: 5b6219cc30fb4eaaabde722b6bcff2bc (127.26.191.195:41781)
I20260811 05:08:33.418485 9865 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.191.195:41443
I20260811 05:08:33.424003 27391 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260811 05:08:33.426156 9924 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:08:33.425598 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52514 (local address 127.26.191.254:36901)
0811 05:08:33.425643 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:33.425645 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:33.425768 (+ 123us) server_negotiation.cc:407] Connection header received
0811 05:08:33.425815 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:33.425815 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:33.425825 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:33.425886 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:33.426066 (+ 180us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52514: BlockingRecv error: recv got EOF from 127.0.0.1:52514 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 05:08:33.426172 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 9962
I20260811 05:08:33.441648 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 10161
I20260811 05:08:33.453428 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 10363
I20260811 05:08:33.470575 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 9813
2026-08-11T05:08:33Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (691 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-11T05:08:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:08:33Z Disabled control of system clock
I20260811 05:08:33.504262 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424853995437-27391-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424853995437-27391-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424853995437-27391-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.254:38823
--webserver_interface=127.26.191.254
--webserver_port=0
--builtin_ntp_servers=127.26.191.212:35821
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.191.254:38823
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260811 05:08:33.591452 10581 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:08:33.591671 10581 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:08:33.591702 10581 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:08:33.592904 10581 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:08:33.592947 10581 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:08:33.592960 10581 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:08:33.592973 10581 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:08:33.592985 10581 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:08:33.594326 10581 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:35821
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424853995437-27391-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424853995437-27391-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.191.254:38823
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.254:38823
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.191.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10581
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424853995437-27391-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:08:33.594535 10581 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:08:33.594799 10581 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:08:33.600414 10591 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:33.600425 10590 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:08:33.600510 10581 server_base.cc:1034] running on GCE node
W20260811 05:08:33.600474 10594 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:08:33.601171 10581 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:08:33.601513 10581 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:08:33.602701 10581 hybrid_clock.cc:648] HybridClock initialized: now 1786424913602693 us; error 55 us; skew 500 ppm
I20260811 05:08:33.608529 10581 webserver.cc:460] Webserver started at http://127.26.191.254:44115/ using document root <none> and password file <none>
I20260811 05:08:33.608969 10581 fs_manager.cc:359] Metadata directory not provided
I20260811 05:08:33.609061 10581 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:08:33.609244 10581 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:08:33.610563 10581 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424853995437-27391-0/minicluster-data/master-0/data/instance:
uuid: "4502381e7eeb48139dc81f7f090ba6b9"
format_stamp: "Formatted at 2026-08-11 05:08:33 on dist-test-slave-x5fp"
server_key: "c798de7b3c7d85adadf710faf9f30755"
server_key_iv: "9b53aaebc6a3a8f192ad6a1360f5933a"
server_key_version: "encryptionkey@0"
I20260811 05:08:33.610999 10581 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424853995437-27391-0/minicluster-data/master-0/wal/instance:
uuid: "4502381e7eeb48139dc81f7f090ba6b9"
format_stamp: "Formatted at 2026-08-11 05:08:33 on dist-test-slave-x5fp"
server_key: "c798de7b3c7d85adadf710faf9f30755"
server_key_iv: "9b53aaebc6a3a8f192ad6a1360f5933a"
server_key_version: "encryptionkey@0"
I20260811 05:08:33.612527 10581 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 05:08:33.613601 10605 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:33.613934 10581 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:08:33.614063 10581 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424853995437-27391-0/minicluster-data/master-0/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424853995437-27391-0/minicluster-data/master-0/wal
uuid: "4502381e7eeb48139dc81f7f090ba6b9"
format_stamp: "Formatted at 2026-08-11 05:08:33 on dist-test-slave-x5fp"
server_key: "c798de7b3c7d85adadf710faf9f30755"
server_key_iv: "9b53aaebc6a3a8f192ad6a1360f5933a"
server_key_version: "encryptionkey@0"
I20260811 05:08:33.614166 10581 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424853995437-27391-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424853995437-27391-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424853995437-27391-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:08:33.617969 10581 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:08:33.618274 10581 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:08:33.618431 10581 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:08:33.622725 10581 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.254:38823
I20260811 05:08:33.622793 10682 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.254:38823 every 8 connection(s)
I20260811 05:08:33.623171 10581 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
I20260811 05:08:33.623944 10683 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:08:33.627146 10683 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4502381e7eeb48139dc81f7f090ba6b9: Bootstrap starting.
I20260811 05:08:33.627797 10683 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4502381e7eeb48139dc81f7f090ba6b9: Neither blocks nor log segments found. Creating new log.
I20260811 05:08:33.628131 10683 log.cc:824] T 00000000000000000000000000000000 P 4502381e7eeb48139dc81f7f090ba6b9: Log is configured to *not* fsync() on all Append() calls
I20260811 05:08:33.629077 10683 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4502381e7eeb48139dc81f7f090ba6b9: No bootstrap required, opened a new log
I20260811 05:08:33.629725 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 10581
I20260811 05:08:33.629855 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424853995437-27391-0/minicluster-data/master-0/wal/instance
I20260811 05:08:33.630079 27391 external_mini_cluster.cc:1428] Setting key edb2f4511657af8787dd3ad0d3d92d7f
I20260811 05:08:33.631630 10683 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4502381e7eeb48139dc81f7f090ba6b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4502381e7eeb48139dc81f7f090ba6b9" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 38823 } }
I20260811 05:08:33.631829 10683 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4502381e7eeb48139dc81f7f090ba6b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:08:33.631877 10683 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4502381e7eeb48139dc81f7f090ba6b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4502381e7eeb48139dc81f7f090ba6b9, State: Initialized, Role: FOLLOWER
I20260811 05:08:33.632103 10683 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4502381e7eeb48139dc81f7f090ba6b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4502381e7eeb48139dc81f7f090ba6b9" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 38823 } }
I20260811 05:08:33.632216 10683 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4502381e7eeb48139dc81f7f090ba6b9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:08:33.632268 10683 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4502381e7eeb48139dc81f7f090ba6b9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:08:33.632356 10683 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4502381e7eeb48139dc81f7f090ba6b9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:08:33.633267 10688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:33.630727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40700 (local address 127.26.191.254:38823)
0811 05:08:33.630955 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:33.630963 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:33.630991 (+ 28us) server_negotiation.cc:407] Connection header received
0811 05:08:33.631602 (+ 611us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:33.631610 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:33.631653 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:33.631776 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:33.632672 (+ 896us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:33.632675 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:33.632676 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:08:33.632680 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:33.632804 (+ 124us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:08:33.632818 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:33.632880 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:33.632984 (+ 104us) server_negotiation.cc:299] Negotiation successful
0811 05:08:33.633060 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":90,"threads_started":1}
I20260811 05:08:33.633281 10683 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4502381e7eeb48139dc81f7f090ba6b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4502381e7eeb48139dc81f7f090ba6b9" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 38823 } }
I20260811 05:08:33.633472 10683 leader_election.cc:302] T 00000000000000000000000000000000 P 4502381e7eeb48139dc81f7f090ba6b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4502381e7eeb48139dc81f7f090ba6b9; no voters:
I20260811 05:08:33.633654 10683 leader_election.cc:288] T 00000000000000000000000000000000 P 4502381e7eeb48139dc81f7f090ba6b9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 05:08:33.633983 10689 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4502381e7eeb48139dc81f7f090ba6b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:08:33.634043 10683 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4502381e7eeb48139dc81f7f090ba6b9 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:08:33.634162 10689 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4502381e7eeb48139dc81f7f090ba6b9 [term 1 LEADER]: Becoming Leader. State: Replica: 4502381e7eeb48139dc81f7f090ba6b9, State: Running, Role: LEADER
I20260811 05:08:33.634285 10689 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4502381e7eeb48139dc81f7f090ba6b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4502381e7eeb48139dc81f7f090ba6b9" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 38823 } }
I20260811 05:08:33.634656 10689 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4502381e7eeb48139dc81f7f090ba6b9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4502381e7eeb48139dc81f7f090ba6b9. Latest consensus state: current_term: 1 leader_uuid: "4502381e7eeb48139dc81f7f090ba6b9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4502381e7eeb48139dc81f7f090ba6b9" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 38823 } } }
I20260811 05:08:33.634670 10693 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4502381e7eeb48139dc81f7f090ba6b9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4502381e7eeb48139dc81f7f090ba6b9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4502381e7eeb48139dc81f7f090ba6b9" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 38823 } } }
I20260811 05:08:33.634876 10689 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4502381e7eeb48139dc81f7f090ba6b9 [sys.catalog]: This master's current role is: LEADER
I20260811 05:08:33.634893 10693 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4502381e7eeb48139dc81f7f090ba6b9 [sys.catalog]: This master's current role is: LEADER
I20260811 05:08:33.635156 10702 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:08:33.635859 10702 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:08:33.637652 10702 catalog_manager.cc:1347] Generated new cluster ID: 1a555d6cd3484deab46259259af6002a
I20260811 05:08:33.637714 10702 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:08:33.646525 10702 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:08:33.646706 10702 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:08:33.650902 10702 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4502381e7eeb48139dc81f7f090ba6b9: Generated new TSK 0
I20260811 05:08:33.651109 10702 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 05:08:33.652287 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.191.193:0
--local_ip_for_outbound_sockets=127.26.191.193
--webserver_interface=127.26.191.193
--webserver_port=0
--tserver_master_addrs=127.26.191.254:38823
--builtin_ntp_servers=127.26.191.212:35821
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260811 05:08:33.745545 10712 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:08:33.745781 10712 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:08:33.745806 10712 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:08:33.747025 10712 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:08:33.747066 10712 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:08:33.747093 10712 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.191.193
I20260811 05:08:33.748451 10712 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:35821
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.191.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.191.193
--webserver_port=0
--tserver_master_addrs=127.26.191.254:38823
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10712
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.191.193
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:08:33.748762 10712 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:08:33.749096 10712 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:08:33.755419 10720 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:33.755438 10725 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:33.755532 10729 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:08:33.756215 10712 server_base.cc:1034] running on GCE node
I20260811 05:08:33.756546 10712 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:08:33.756877 10712 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:08:33.758071 10712 hybrid_clock.cc:648] HybridClock initialized: now 1786424913758049 us; error 38 us; skew 500 ppm
I20260811 05:08:33.759519 10712 webserver.cc:460] Webserver started at http://127.26.191.193:37983/ using document root <none> and password file <none>
I20260811 05:08:33.759826 10712 fs_manager.cc:359] Metadata directory not provided
I20260811 05:08:33.759910 10712 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:08:33.760079 10712 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:08:33.761327 10712 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-0/data/instance:
uuid: "382fc861427e4bdd9127728edb7c5ead"
format_stamp: "Formatted at 2026-08-11 05:08:33 on dist-test-slave-x5fp"
server_key: "193555504909bf6d7b460fc8a3d08d0c"
server_key_iv: "bd78a067fc02117ce8e5761fff83e49c"
server_key_version: "encryptionkey@0"
I20260811 05:08:33.761714 10712 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-0/wal/instance:
uuid: "382fc861427e4bdd9127728edb7c5ead"
format_stamp: "Formatted at 2026-08-11 05:08:33 on dist-test-slave-x5fp"
server_key: "193555504909bf6d7b460fc8a3d08d0c"
server_key_iv: "bd78a067fc02117ce8e5761fff83e49c"
server_key_version: "encryptionkey@0"
I20260811 05:08:33.763181 10712 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 05:08:33.764092 10739 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:33.764304 10712 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:08:33.764403 10712 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-0/wal
uuid: "382fc861427e4bdd9127728edb7c5ead"
format_stamp: "Formatted at 2026-08-11 05:08:33 on dist-test-slave-x5fp"
server_key: "193555504909bf6d7b460fc8a3d08d0c"
server_key_iv: "bd78a067fc02117ce8e5761fff83e49c"
server_key_version: "encryptionkey@0"
I20260811 05:08:33.764505 10712 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:08:33.768157 10712 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:08:33.768465 10712 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:08:33.768620 10712 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:08:33.768901 10712 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:08:33.769285 10712 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:08:33.769333 10712 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:33.769366 10712 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:08:33.769389 10712 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:33.776041 10712 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.193:41103
I20260811 05:08:33.776149 10892 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.193:41103 every 8 connection(s)
I20260811 05:08:33.776557 10712 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-0/data/info.pb
I20260811 05:08:33.779852 10688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:33.777466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.193:52947 (local address 127.26.191.254:38823)
0811 05:08:33.777520 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:33.777526 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:33.777747 (+ 221us) server_negotiation.cc:407] Connection header received
0811 05:08:33.778249 (+ 502us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:33.778250 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:33.778256 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:33.778320 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:33.779615 (+ 1295us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:33.779617 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:33.779618 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:08:33.779623 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:33.779641 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:08:33.779645 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:33.779716 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:33.779758 (+ 42us) server_negotiation.cc:299] Negotiation successful
0811 05:08:33.779771 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 05:08:33.780069 10906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:33.777405 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:38823 (local address 127.26.191.193:52947)
0811 05:08:33.777627 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:33.777670 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:33.778154 (+ 484us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:33.778376 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:33.778379 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:33.778388 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:33.779447 (+ 1059us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 05:08:33.779447 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:33.779478 (+ 31us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 05:08:33.779509 (+ 31us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:08:33.779708 (+ 199us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:08:33.779711 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:08:33.779713 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 05:08:33.779765 (+ 52us) client_negotiation.cc:240] Negotiation successful
0811 05:08:33.779843 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":111,"threads_started":1}
I20260811 05:08:33.780282 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 10712
I20260811 05:08:33.780397 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-0/wal/instance
I20260811 05:08:33.780607 27391 external_mini_cluster.cc:1428] Setting key 331f7f7a63239547516c25e289faa726
I20260811 05:08:33.780699 10896 heartbeater.cc:347] Connected to a master server at 127.26.191.254:38823
I20260811 05:08:33.780859 10896 heartbeater.cc:464] Registering TS with master...
I20260811 05:08:33.781054 10896 heartbeater.cc:511] Master 127.26.191.254:38823 requested a full tablet report, sending...
I20260811 05:08:33.781699 10624 ts_manager.cc:194] Registered new tserver with Master: 382fc861427e4bdd9127728edb7c5ead (127.26.191.193:41103)
I20260811 05:08:33.781752 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.191.194:0
--local_ip_for_outbound_sockets=127.26.191.194
--webserver_interface=127.26.191.194
--webserver_port=0
--tserver_master_addrs=127.26.191.254:38823
--builtin_ntp_servers=127.26.191.212:35821
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260811 05:08:33.869226 10907 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:08:33.869441 10907 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:08:33.869463 10907 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:08:33.870648 10907 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:08:33.870692 10907 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:08:33.870718 10907 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.191.194
I20260811 05:08:33.872074 10907 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:35821
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.191.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.191.194
--webserver_port=0
--tserver_master_addrs=127.26.191.254:38823
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10907
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.191.194
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:08:33.872318 10907 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:08:33.872651 10907 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:08:33.878063 10913 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:33.878067 10914 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:33.878196 10916 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:08:33.878511 10907 server_base.cc:1034] running on GCE node
I20260811 05:08:33.878793 10907 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:08:33.879073 10907 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:08:33.880283 10907 hybrid_clock.cc:648] HybridClock initialized: now 1786424913880241 us; error 53 us; skew 500 ppm
I20260811 05:08:33.881950 10907 webserver.cc:460] Webserver started at http://127.26.191.194:46455/ using document root <none> and password file <none>
I20260811 05:08:33.882234 10907 fs_manager.cc:359] Metadata directory not provided
I20260811 05:08:33.882313 10907 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:08:33.882503 10907 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:08:33.883785 10907 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-1/data/instance:
uuid: "f6d646552b9c4e1c864964ba33d8d120"
format_stamp: "Formatted at 2026-08-11 05:08:33 on dist-test-slave-x5fp"
server_key: "96be051b7245a5a9035568d888b55870"
server_key_iv: "b6c483108010aaa85ae5f3da881f6c5a"
server_key_version: "encryptionkey@0"
I20260811 05:08:33.884186 10907 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-1/wal/instance:
uuid: "f6d646552b9c4e1c864964ba33d8d120"
format_stamp: "Formatted at 2026-08-11 05:08:33 on dist-test-slave-x5fp"
server_key: "96be051b7245a5a9035568d888b55870"
server_key_iv: "b6c483108010aaa85ae5f3da881f6c5a"
server_key_version: "encryptionkey@0"
I20260811 05:08:33.885775 10907 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.004s
I20260811 05:08:33.886713 10926 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:33.887130 10907 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 05:08:33.887286 10907 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-1/wal
uuid: "f6d646552b9c4e1c864964ba33d8d120"
format_stamp: "Formatted at 2026-08-11 05:08:33 on dist-test-slave-x5fp"
server_key: "96be051b7245a5a9035568d888b55870"
server_key_iv: "b6c483108010aaa85ae5f3da881f6c5a"
server_key_version: "encryptionkey@0"
I20260811 05:08:33.887384 10907 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:08:33.891528 10907 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:08:33.891892 10907 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:08:33.892055 10907 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:08:33.892299 10907 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:08:33.892658 10907 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:08:33.892717 10907 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:33.892812 10907 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:08:33.892843 10907 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:33.899335 10907 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.194:45627
I20260811 05:08:33.899367 11085 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.194:45627 every 8 connection(s)
I20260811 05:08:33.899750 10907 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-1/data/info.pb
I20260811 05:08:33.903429 10688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:33.900636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.194:48583 (local address 127.26.191.254:38823)
0811 05:08:33.900684 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:33.900686 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:33.901036 (+ 350us) server_negotiation.cc:407] Connection header received
0811 05:08:33.901610 (+ 574us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:33.901611 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:33.901619 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:33.901701 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:33.903123 (+ 1422us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:33.903125 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:33.903125 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:08:33.903130 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:33.903152 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:08:33.903156 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:33.903218 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:33.903347 (+ 129us) server_negotiation.cc:299] Negotiation successful
0811 05:08:33.903365 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 05:08:33.903611 11090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:33.900605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:38823 (local address 127.26.191.194:48583)
0811 05:08:33.900860 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:33.900908 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:33.901453 (+ 545us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:33.901807 (+ 354us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:33.901812 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:33.901820 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:33.902932 (+ 1112us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 05:08:33.902933 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:33.902964 (+ 31us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 05:08:33.902997 (+ 33us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:08:33.903229 (+ 232us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:08:33.903234 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:08:33.903237 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 05:08:33.903300 (+ 63us) client_negotiation.cc:240] Negotiation successful
0811 05:08:33.903377 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":177,"spinlock_wait_cycles":12032,"thread_start_us":171,"threads_started":1}
I20260811 05:08:33.904220 11086 heartbeater.cc:347] Connected to a master server at 127.26.191.254:38823
I20260811 05:08:33.904333 11086 heartbeater.cc:464] Registering TS with master...
I20260811 05:08:33.904465 11086 heartbeater.cc:511] Master 127.26.191.254:38823 requested a full tablet report, sending...
I20260811 05:08:33.904870 10624 ts_manager.cc:194] Registered new tserver with Master: f6d646552b9c4e1c864964ba33d8d120 (127.26.191.194:45627)
I20260811 05:08:33.908423 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 10907
I20260811 05:08:33.908519 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-1/wal/instance
I20260811 05:08:33.908854 27391 external_mini_cluster.cc:1428] Setting key bc942f31586f8f83297f42f2a29f725a
I20260811 05:08:33.909966 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.191.195:0
--local_ip_for_outbound_sockets=127.26.191.195
--webserver_interface=127.26.191.195
--webserver_port=0
--tserver_master_addrs=127.26.191.254:38823
--builtin_ntp_servers=127.26.191.212:35821
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260811 05:08:34.000834 11092 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:08:34.001055 11092 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:08:34.001077 11092 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:08:34.002308 11092 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:08:34.002357 11092 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:08:34.002384 11092 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.191.195
I20260811 05:08:34.003798 11092 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:35821
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.191.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.191.195
--webserver_port=0
--tserver_master_addrs=127.26.191.254:38823
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11092
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.191.195
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:08:34.004078 11092 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:08:34.004437 11092 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:08:34.010228 11100 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:34.010224 11101 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:34.010224 11105 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:08:34.010593 11092 server_base.cc:1034] running on GCE node
I20260811 05:08:34.010918 11092 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:08:34.011221 11092 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:08:34.012391 11092 hybrid_clock.cc:648] HybridClock initialized: now 1786424914012386 us; error 41 us; skew 500 ppm
I20260811 05:08:34.014008 11092 webserver.cc:460] Webserver started at http://127.26.191.195:42985/ using document root <none> and password file <none>
I20260811 05:08:34.014307 11092 fs_manager.cc:359] Metadata directory not provided
I20260811 05:08:34.014384 11092 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:08:34.014559 11092 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:08:34.015707 11092 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-2/data/instance:
uuid: "7a9f1694b662445686f7207c616b2657"
format_stamp: "Formatted at 2026-08-11 05:08:34 on dist-test-slave-x5fp"
server_key: "921e18200d2c607aabe153112c8f95ac"
server_key_iv: "93f9d25197d0165c87c0fe9835b324df"
server_key_version: "encryptionkey@0"
I20260811 05:08:34.016103 11092 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-2/wal/instance:
uuid: "7a9f1694b662445686f7207c616b2657"
format_stamp: "Formatted at 2026-08-11 05:08:34 on dist-test-slave-x5fp"
server_key: "921e18200d2c607aabe153112c8f95ac"
server_key_iv: "93f9d25197d0165c87c0fe9835b324df"
server_key_version: "encryptionkey@0"
I20260811 05:08:34.017697 11092 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 05:08:34.018769 11114 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:34.018998 11092 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 05:08:34.019132 11092 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-2/wal
uuid: "7a9f1694b662445686f7207c616b2657"
format_stamp: "Formatted at 2026-08-11 05:08:34 on dist-test-slave-x5fp"
server_key: "921e18200d2c607aabe153112c8f95ac"
server_key_iv: "93f9d25197d0165c87c0fe9835b324df"
server_key_version: "encryptionkey@0"
I20260811 05:08:34.019224 11092 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:08:34.023792 11092 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:08:34.024115 11092 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:08:34.024286 11092 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:08:34.024524 11092 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:08:34.024945 11092 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:08:34.025007 11092 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:34.025055 11092 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:08:34.025085 11092 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:34.031980 11092 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.195:44173
I20260811 05:08:34.032069 11281 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.195:44173 every 8 connection(s)
I20260811 05:08:34.032482 11092 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-2/data/info.pb
I20260811 05:08:34.036017 10688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:34.033443 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.195:54891 (local address 127.26.191.254:38823)
0811 05:08:34.033491 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:34.033493 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:34.033762 (+ 269us) server_negotiation.cc:407] Connection header received
0811 05:08:34.034368 (+ 606us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:34.034370 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:34.034380 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:34.034458 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:34.035735 (+ 1277us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:34.035737 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:34.035737 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:08:34.035742 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:34.035759 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:08:34.035763 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:34.035819 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:34.035922 (+ 103us) server_negotiation.cc:299] Negotiation successful
0811 05:08:34.035942 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 05:08:34.036346 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 11092
I20260811 05:08:34.036449 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424853995437-27391-0/minicluster-data/ts-2/wal/instance
I20260811 05:08:34.036650 27391 external_mini_cluster.cc:1428] Setting key b834320a27064a5081cb793b06a5bf86
I20260811 05:08:34.036970 11284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:34.033396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:38823 (local address 127.26.191.195:54891)
0811 05:08:34.033638 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:34.033673 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:34.034225 (+ 552us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:34.034537 (+ 312us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:34.034546 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:34.034555 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:34.035564 (+ 1009us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 05:08:34.035565 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:34.035595 (+ 30us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 05:08:34.035623 (+ 28us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:08:34.035827 (+ 204us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:08:34.035832 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:08:34.035836 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 05:08:34.035932 (+ 96us) client_negotiation.cc:240] Negotiation successful
0811 05:08:34.035997 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":111,"threads_started":1}
I20260811 05:08:34.037444 11282 heartbeater.cc:347] Connected to a master server at 127.26.191.254:38823
I20260811 05:08:34.037554 11282 heartbeater.cc:464] Registering TS with master...
I20260811 05:08:34.037703 11282 heartbeater.cc:511] Master 127.26.191.254:38823 requested a full tablet report, sending...
I20260811 05:08:34.038048 10624 ts_manager.cc:194] Registered new tserver with Master: 7a9f1694b662445686f7207c616b2657 (127.26.191.195:44173)
I20260811 05:08:34.049103 27391 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260811 05:08:34.051168 10688 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:08:34.050611 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40704 (local address 127.26.191.254:38823)
0811 05:08:34.050693 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:34.050696 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:34.050799 (+ 103us) server_negotiation.cc:407] Connection header received
0811 05:08:34.050887 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:34.050888 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:34.050893 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:34.050944 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:34.051060 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40704: BlockingRecv error: recv got EOF from 127.0.0.1:40704 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 05:08:34.051225 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 10712
I20260811 05:08:34.078430 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 10907
I20260811 05:08:34.092254 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 11092
I20260811 05:08:34.102550 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 10581
2026-08-11T05:08:34Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (637 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424853995437-27391-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 05:08:34 dist-test-slave-x5fp krb5kdc[11293](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 05:08:34 dist-test-slave-x5fp krb5kdc[11293](info): set up 2 sockets
Aug 11 05:08:34 dist-test-slave-x5fp krb5kdc[11293](info): commencing operation
krb5kdc: starting...
W20260811 05:08:35.401791 27391 mini_kdc.cc:121] Time spent starting KDC: real 1.269s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424853995437-27391-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424853995437-27391-0/krb5kdc/test-user.keytab.
Aug 11 05:08:35 dist-test-slave-x5fp krb5kdc[11293](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424915, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T05:08:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:08:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.191.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.191.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.191.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab.
Entry for principal kudu/127.26.191.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab.
I20260811 05:08:35.536015 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424853995437-27391-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424853995437-27391-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424853995437-27391-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.254:40425
--webserver_interface=127.26.191.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab
--principal=kudu/127.26.191.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:39339
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.191.254:40425
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:08:35.621161 11315 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:08:35.621444 11315 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:08:35.621484 11315 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:08:35.622676 11315 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:08:35.622753 11315 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:08:35.622778 11315 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:08:35.622807 11315 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:08:35.622825 11315 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:08:35.624351 11315 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:39339
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424853995437-27391-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424853995437-27391-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.191.254:40425
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab
--principal=kudu/127.26.191.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.254:40425
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.191.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11315
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424853995437-27391-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:08:35.624650 11315 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:08:35.624920 11315 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:08:35.629992 11321 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:35.630008 11323 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:35.630004 11320 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:08:35.630152 11315 server_base.cc:1034] running on GCE node
I20260811 05:08:35.630492 11315 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:08:35.630800 11315 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:08:35.632004 11315 hybrid_clock.cc:648] HybridClock initialized: now 1786424915631983 us; error 45 us; skew 500 ppm
Aug 11 05:08:35 dist-test-slave-x5fp krb5kdc[11293](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424915, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:08:35.634913 11315 init.cc:377] Logged in from keytab as kudu/127.26.191.254@KRBTEST.COM (short username kudu)
I20260811 05:08:35.635475 11315 webserver.cc:460] Webserver started at http://127.26.191.254:40221/ using document root <none> and password file <none>
I20260811 05:08:35.635737 11315 fs_manager.cc:359] Metadata directory not provided
I20260811 05:08:35.635816 11315 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:08:35.635994 11315 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:08:35.637292 11315 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424853995437-27391-0/minicluster-data/master-0/data/instance:
uuid: "5421397b40ac4655b061da84ca628742"
format_stamp: "Formatted at 2026-08-11 05:08:35 on dist-test-slave-x5fp"
server_key: "dd65b37cc1683e55a06e47cc35185a64"
server_key_iv: "2c9b12d9f1c7babc2bc816b80ceb4cd2"
server_key_version: "encryptionkey@0"
I20260811 05:08:35.637717 11315 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424853995437-27391-0/minicluster-data/master-0/wal/instance:
uuid: "5421397b40ac4655b061da84ca628742"
format_stamp: "Formatted at 2026-08-11 05:08:35 on dist-test-slave-x5fp"
server_key: "dd65b37cc1683e55a06e47cc35185a64"
server_key_iv: "2c9b12d9f1c7babc2bc816b80ceb4cd2"
server_key_version: "encryptionkey@0"
I20260811 05:08:35.639292 11315 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 05:08:35.640190 11331 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:35.640426 11315 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:08:35.640554 11315 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424853995437-27391-0/minicluster-data/master-0/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424853995437-27391-0/minicluster-data/master-0/wal
uuid: "5421397b40ac4655b061da84ca628742"
format_stamp: "Formatted at 2026-08-11 05:08:35 on dist-test-slave-x5fp"
server_key: "dd65b37cc1683e55a06e47cc35185a64"
server_key_iv: "2c9b12d9f1c7babc2bc816b80ceb4cd2"
server_key_version: "encryptionkey@0"
I20260811 05:08:35.640642 11315 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424853995437-27391-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424853995437-27391-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424853995437-27391-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:08:35.658237 11315 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:08:35.660912 11315 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:08:35.661115 11315 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:08:35.665807 11315 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.254:40425
I20260811 05:08:35.665866 11412 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.254:40425 every 8 connection(s)
I20260811 05:08:35.666288 11315 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
I20260811 05:08:35.667464 11413 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:08:35.670214 11413 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5421397b40ac4655b061da84ca628742: Bootstrap starting.
I20260811 05:08:35.670830 11413 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5421397b40ac4655b061da84ca628742: Neither blocks nor log segments found. Creating new log.
I20260811 05:08:35.671090 11413 log.cc:824] T 00000000000000000000000000000000 P 5421397b40ac4655b061da84ca628742: Log is configured to *not* fsync() on all Append() calls
I20260811 05:08:35.671798 11413 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5421397b40ac4655b061da84ca628742: No bootstrap required, opened a new log
I20260811 05:08:35.672168 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 11315
I20260811 05:08:35.672290 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424853995437-27391-0/minicluster-data/master-0/wal/instance
I20260811 05:08:35.672530 27391 external_mini_cluster.cc:1428] Setting key f74f9956eb42147f8a446de61f32704e
I20260811 05:08:35.674291 11413 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5421397b40ac4655b061da84ca628742 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5421397b40ac4655b061da84ca628742" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 40425 } }
I20260811 05:08:35.674448 11413 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5421397b40ac4655b061da84ca628742 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:08:35.674474 11413 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5421397b40ac4655b061da84ca628742 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5421397b40ac4655b061da84ca628742, State: Initialized, Role: FOLLOWER
I20260811 05:08:35.674636 11413 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5421397b40ac4655b061da84ca628742 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5421397b40ac4655b061da84ca628742" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 40425 } }
I20260811 05:08:35.674742 11413 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5421397b40ac4655b061da84ca628742 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:08:35.674783 11413 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5421397b40ac4655b061da84ca628742 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:08:35.674839 11413 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5421397b40ac4655b061da84ca628742 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:08:35.676265 11413 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5421397b40ac4655b061da84ca628742 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5421397b40ac4655b061da84ca628742" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 40425 } }
I20260811 05:08:35.676378 11413 leader_election.cc:302] T 00000000000000000000000000000000 P 5421397b40ac4655b061da84ca628742 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5421397b40ac4655b061da84ca628742; no voters:
I20260811 05:08:35.676648 11413 leader_election.cc:288] T 00000000000000000000000000000000 P 5421397b40ac4655b061da84ca628742 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 05:08:35.676674 11420 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5421397b40ac4655b061da84ca628742 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:08:35.676967 11420 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5421397b40ac4655b061da84ca628742 [term 1 LEADER]: Becoming Leader. State: Replica: 5421397b40ac4655b061da84ca628742, State: Running, Role: LEADER
I20260811 05:08:35.677083 11413 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5421397b40ac4655b061da84ca628742 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:08:35.677060 11420 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5421397b40ac4655b061da84ca628742 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5421397b40ac4655b061da84ca628742" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 40425 } }
I20260811 05:08:35.677446 11420 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5421397b40ac4655b061da84ca628742 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5421397b40ac4655b061da84ca628742. Latest consensus state: current_term: 1 leader_uuid: "5421397b40ac4655b061da84ca628742" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5421397b40ac4655b061da84ca628742" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 40425 } } }
I20260811 05:08:35.677546 11420 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5421397b40ac4655b061da84ca628742 [sys.catalog]: This master's current role is: LEADER
I20260811 05:08:35.677456 11424 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5421397b40ac4655b061da84ca628742 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5421397b40ac4655b061da84ca628742" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5421397b40ac4655b061da84ca628742" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 40425 } } }
I20260811 05:08:35.677716 11424 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5421397b40ac4655b061da84ca628742 [sys.catalog]: This master's current role is: LEADER
I20260811 05:08:35.677841 11429 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:08:35.678508 11429 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 11 05:08:35 dist-test-slave-x5fp krb5kdc[11293](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424915, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
I20260811 05:08:35.682946 11429 catalog_manager.cc:1347] Generated new cluster ID: 1eab3969519c448183bcdeb4e431719e
I20260811 05:08:35.683010 11429 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:08:35.686918 11419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:35.673222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39302 (local address 127.26.191.254:40425)
0811 05:08:35.673442 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:35.673450 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:35.673478 (+ 28us) server_negotiation.cc:407] Connection header received
0811 05:08:35.674297 (+ 819us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:35.674306 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:35.674378 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:35.674570 (+ 192us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:35.675490 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:35.676675 (+ 1185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:35.677939 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:35.678536 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:35.679016 (+ 480us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:35.681644 (+ 2628us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:35.681649 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:35.681649 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:08:35.681663 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:35.684335 (+ 2672us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:35.684858 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:35.684861 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:35.684862 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:35.685010 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:35.685267 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:35.685268 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:35.685269 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:35.685607 (+ 338us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:35.686289 (+ 682us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:35.686372 (+ 83us) server_negotiation.cc:299] Negotiation successful
0811 05:08:35.686532 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":101,"threads_started":1}
I20260811 05:08:35.691560 11429 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:08:35.692065 11429 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:08:35.696709 11429 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5421397b40ac4655b061da84ca628742: Generated new TSK 0
I20260811 05:08:35.696899 11429 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.191.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.191.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.191.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.193.keytab.
Entry for principal kudu/127.26.191.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.193.keytab.
I20260811 05:08:35.733623 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424853995437-27391-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424853995437-27391-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424853995437-27391-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424853995437-27391-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.191.193:0
--local_ip_for_outbound_sockets=127.26.191.193
--webserver_interface=127.26.191.193
--webserver_port=0
--tserver_master_addrs=127.26.191.254:40425
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.193.keytab
--principal=kudu/127.26.191.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:39339
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:08:35.823917 11449 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:08:35.824199 11449 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:08:35.824247 11449 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:08:35.825659 11449 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:08:35.825735 11449 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:08:35.825789 11449 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.191.193
I20260811 05:08:35.827616 11449 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:39339
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424853995437-27391-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424853995437-27391-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.193.keytab
--principal=kudu/127.26.191.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.191.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424853995437-27391-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.191.193
--webserver_port=0
--tserver_master_addrs=127.26.191.254:40425
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11449
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.191.193
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424853995437-27391-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:08:35.827925 11449 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:08:35.828190 11449 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:08:35.834368 11459 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:35.834324 11458 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:35.834352 11461 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:08:35.834613 11449 server_base.cc:1034] running on GCE node
I20260811 05:08:35.834909 11449 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:08:35.835206 11449 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:08:35.836416 11449 hybrid_clock.cc:648] HybridClock initialized: now 1786424915836402 us; error 35 us; skew 500 ppm
Aug 11 05:08:35 dist-test-slave-x5fp krb5kdc[11293](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424915, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:08:35.839318 11449 init.cc:377] Logged in from keytab as kudu/127.26.191.193@KRBTEST.COM (short username kudu)
I20260811 05:08:35.839807 11449 webserver.cc:460] Webserver started at http://127.26.191.193:40155/ using document root <none> and password file <none>
I20260811 05:08:35.840062 11449 fs_manager.cc:359] Metadata directory not provided
I20260811 05:08:35.840145 11449 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:08:35.840330 11449 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:08:35.841564 11449 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424853995437-27391-0/minicluster-data/ts-0/data/instance:
uuid: "c720f8a2aa8f4a7190911db90ad78eb9"
format_stamp: "Formatted at 2026-08-11 05:08:35 on dist-test-slave-x5fp"
server_key: "fffd8f6f6a845d4b40dedb74940fc984"
server_key_iv: "3cf3bd26df30cf1b1a5e3d3d53bff6d0"
server_key_version: "encryptionkey@0"
I20260811 05:08:35.841913 11449 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424853995437-27391-0/minicluster-data/ts-0/wal/instance:
uuid: "c720f8a2aa8f4a7190911db90ad78eb9"
format_stamp: "Formatted at 2026-08-11 05:08:35 on dist-test-slave-x5fp"
server_key: "fffd8f6f6a845d4b40dedb74940fc984"
server_key_iv: "3cf3bd26df30cf1b1a5e3d3d53bff6d0"
server_key_version: "encryptionkey@0"
I20260811 05:08:35.843298 11449 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 05:08:35.844156 11470 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:35.844372 11449 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 05:08:35.844497 11449 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424853995437-27391-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424853995437-27391-0/minicluster-data/ts-0/wal
uuid: "c720f8a2aa8f4a7190911db90ad78eb9"
format_stamp: "Formatted at 2026-08-11 05:08:35 on dist-test-slave-x5fp"
server_key: "fffd8f6f6a845d4b40dedb74940fc984"
server_key_iv: "3cf3bd26df30cf1b1a5e3d3d53bff6d0"
server_key_version: "encryptionkey@0"
I20260811 05:08:35.844581 11449 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424853995437-27391-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424853995437-27391-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424853995437-27391-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:08:35.859895 11449 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:08:35.862082 11449 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:08:35.862282 11449 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:08:35.862550 11449 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:08:35.862919 11449 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:08:35.862983 11449 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:35.863029 11449 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:08:35.863077 11449 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:35.869701 11449 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.193:39685
I20260811 05:08:35.869779 11625 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.193:39685 every 8 connection(s)
I20260811 05:08:35.870115 11449 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424853995437-27391-0/minicluster-data/ts-0/data/info.pb
I20260811 05:08:35.870796 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 11449
I20260811 05:08:35.870939 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424853995437-27391-0/minicluster-data/ts-0/wal/instance
I20260811 05:08:35.871191 27391 external_mini_cluster.cc:1428] Setting key d5d7a54540ae77616af4f15ebe25e3ae
Aug 11 05:08:35 dist-test-slave-x5fp krb5kdc[11293](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424915, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.193@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
I20260811 05:08:35.881073 11419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:35.870956 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.193:36699 (local address 127.26.191.254:40425)
0811 05:08:35.871025 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:35.871028 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:35.871314 (+ 286us) server_negotiation.cc:407] Connection header received
0811 05:08:35.871984 (+ 670us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:35.871985 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:35.872000 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:35.872049 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:35.873152 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:35.873671 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:35.874690 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:35.875049 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:35.875123 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:35.877844 (+ 2721us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:35.877845 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:35.877846 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:08:35.877859 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:35.879490 (+ 1631us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:35.879959 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:35.879960 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:35.879961 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:35.880030 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:35.880316 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:35.880318 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:35.880318 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:35.880453 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:35.880534 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:35.880871 (+ 337us) server_negotiation.cc:299] Negotiation successful
0811 05:08:35.880973 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 05:08:35.881300 11630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:35.870941 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:40425 (local address 127.26.191.193:36699)
0811 05:08:35.871165 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:35.871215 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:35.871896 (+ 681us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:35.872130 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:35.872134 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:35.872847 (+ 713us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:35.873056 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:35.873061 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:35.873774 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:35.873775 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:35.874596 (+ 821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:35.874598 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:35.875156 (+ 558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:35.875157 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:35.875311 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:35.875937 (+ 626us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:35.875946 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:35.877731 (+ 1785us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:08:35.879602 (+ 1871us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:35.879612 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:35.879615 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:35.879876 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:35.880109 (+ 233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:35.880110 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:35.880110 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:35.880237 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:35.880524 (+ 287us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:08:35.880533 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:08:35.880692 (+ 159us) client_negotiation.cc:769] Sending connection context
0811 05:08:35.880846 (+ 154us) client_negotiation.cc:240] Negotiation successful
0811 05:08:35.881023 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":128,"threads_started":1}
I20260811 05:08:35.881883 11626 heartbeater.cc:347] Connected to a master server at 127.26.191.254:40425
I20260811 05:08:35.882000 11626 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.26.191.194@KRBTEST.COM; defaulting to no policy
I20260811 05:08:35.882225 11626 heartbeater.cc:511] Master 127.26.191.254:40425 requested a full tablet report, sending...
I20260811 05:08:35.882795 11360 ts_manager.cc:194] Registered new tserver with Master: c720f8a2aa8f4a7190911db90ad78eb9 (127.26.191.193:39685)
I20260811 05:08:35.883533 11360 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.191.193@KRBTEST.COM'} at 127.26.191.193:36699
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.191.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.191.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.194.keytab.
Entry for principal kudu/127.26.191.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.194.keytab.
I20260811 05:08:35.905535 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424853995437-27391-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424853995437-27391-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424853995437-27391-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424853995437-27391-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.191.194:0
--local_ip_for_outbound_sockets=127.26.191.194
--webserver_interface=127.26.191.194
--webserver_port=0
--tserver_master_addrs=127.26.191.254:40425
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.194.keytab
--principal=kudu/127.26.191.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:39339
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:08:35.995728 11633 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:08:35.995950 11633 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:08:35.995975 11633 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:08:35.997181 11633 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:08:35.997224 11633 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:08:35.997251 11633 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.191.194
I20260811 05:08:35.998788 11633 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:39339
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424853995437-27391-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424853995437-27391-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.194.keytab
--principal=kudu/127.26.191.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.191.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424853995437-27391-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.191.194
--webserver_port=0
--tserver_master_addrs=127.26.191.254:40425
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11633
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.191.194
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424853995437-27391-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:08:35.999048 11633 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:08:35.999291 11633 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:08:36.004781 11643 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:36.004781 11640 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:36.004878 11641 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:08:36.005057 11633 server_base.cc:1034] running on GCE node
I20260811 05:08:36.005265 11633 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:08:36.005563 11633 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:08:36.006740 11633 hybrid_clock.cc:648] HybridClock initialized: now 1786424916006724 us; error 30 us; skew 500 ppm
Aug 11 05:08:36 dist-test-slave-x5fp krb5kdc[11293](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424916, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:08:36.009383 11633 init.cc:377] Logged in from keytab as kudu/127.26.191.194@KRBTEST.COM (short username kudu)
I20260811 05:08:36.009856 11633 webserver.cc:460] Webserver started at http://127.26.191.194:39055/ using document root <none> and password file <none>
I20260811 05:08:36.010104 11633 fs_manager.cc:359] Metadata directory not provided
I20260811 05:08:36.010154 11633 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:08:36.010289 11633 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:08:36.011366 11633 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424853995437-27391-0/minicluster-data/ts-1/data/instance:
uuid: "5eee815b8be246c0a78bd46594688fe9"
format_stamp: "Formatted at 2026-08-11 05:08:36 on dist-test-slave-x5fp"
server_key: "3eca185f4a543103dc23f5b15970ff84"
server_key_iv: "028c4ba27c7e78bbc4d050bff67f90f1"
server_key_version: "encryptionkey@0"
I20260811 05:08:36.011740 11633 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424853995437-27391-0/minicluster-data/ts-1/wal/instance:
uuid: "5eee815b8be246c0a78bd46594688fe9"
format_stamp: "Formatted at 2026-08-11 05:08:36 on dist-test-slave-x5fp"
server_key: "3eca185f4a543103dc23f5b15970ff84"
server_key_iv: "028c4ba27c7e78bbc4d050bff67f90f1"
server_key_version: "encryptionkey@0"
I20260811 05:08:36.013212 11633 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 05:08:36.014163 11657 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:36.014402 11633 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:08:36.014524 11633 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424853995437-27391-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424853995437-27391-0/minicluster-data/ts-1/wal
uuid: "5eee815b8be246c0a78bd46594688fe9"
format_stamp: "Formatted at 2026-08-11 05:08:36 on dist-test-slave-x5fp"
server_key: "3eca185f4a543103dc23f5b15970ff84"
server_key_iv: "028c4ba27c7e78bbc4d050bff67f90f1"
server_key_version: "encryptionkey@0"
I20260811 05:08:36.014605 11633 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424853995437-27391-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424853995437-27391-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424853995437-27391-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:08:36.025986 11633 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:08:36.028247 11633 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:08:36.028420 11633 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:08:36.028671 11633 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:08:36.029122 11633 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:08:36.029179 11633 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:36.029225 11633 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:08:36.029284 11633 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:36.035801 11633 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.194:43903
I20260811 05:08:36.035859 11823 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.194:43903 every 8 connection(s)
I20260811 05:08:36.036248 11633 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424853995437-27391-0/minicluster-data/ts-1/data/info.pb
I20260811 05:08:36.042183 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 11633
I20260811 05:08:36.042351 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424853995437-27391-0/minicluster-data/ts-1/wal/instance
I20260811 05:08:36.042562 27391 external_mini_cluster.cc:1428] Setting key 14e03275607e1b29f609df9b735ad5ae
Aug 11 05:08:36 dist-test-slave-x5fp krb5kdc[11293](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424916, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.194@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
I20260811 05:08:36.047344 11419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:36.037132 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.194:46853 (local address 127.26.191.254:40425)
0811 05:08:36.037200 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:36.037202 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:36.037579 (+ 377us) server_negotiation.cc:407] Connection header received
0811 05:08:36.037957 (+ 378us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:36.037959 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:36.037970 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:36.038044 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:36.039041 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:36.039569 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:36.040658 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:36.040970 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:36.041033 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:36.043529 (+ 2496us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:36.043530 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:36.043530 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:08:36.043539 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:36.045570 (+ 2031us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:36.046144 (+ 574us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:36.046145 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:36.046146 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:36.046217 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:36.046528 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:36.046529 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:36.046529 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:36.046641 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:36.046699 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:36.047099 (+ 400us) server_negotiation.cc:299] Negotiation successful
0811 05:08:36.047201 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 05:08:36.047525 11827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:36.037113 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:40425 (local address 127.26.191.194:46853)
0811 05:08:36.037290 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:36.037334 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:36.037840 (+ 506us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:36.038101 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:36.038105 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:36.038705 (+ 600us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:36.038932 (+ 227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:36.038938 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:36.039663 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:36.039663 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:36.040569 (+ 906us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:36.040571 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:36.041054 (+ 483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:36.041055 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:36.041161 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:36.041682 (+ 521us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:36.041691 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:36.043452 (+ 1761us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:08:36.045669 (+ 2217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:36.045679 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:36.045682 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:36.046055 (+ 373us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:36.046297 (+ 242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:36.046298 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:36.046299 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:36.046459 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:36.046715 (+ 256us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:08:36.046723 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:08:36.046924 (+ 201us) client_negotiation.cc:769] Sending connection context
0811 05:08:36.047034 (+ 110us) client_negotiation.cc:240] Negotiation successful
0811 05:08:36.047216 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":100,"threads_started":1}
I20260811 05:08:36.048170 11824 heartbeater.cc:347] Connected to a master server at 127.26.191.254:40425
I20260811 05:08:36.048269 11824 heartbeater.cc:464] Registering TS with master...
I20260811 05:08:36.048560 11824 heartbeater.cc:511] Master 127.26.191.254:40425 requested a full tablet report, sending...
I20260811 05:08:36.049160 11360 ts_manager.cc:194] Registered new tserver with Master: 5eee815b8be246c0a78bd46594688fe9 (127.26.191.194:43903)
I20260811 05:08:36.049706 11360 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.191.194@KRBTEST.COM'} at 127.26.191.194:46853
WARNING: no policy specified for kudu/127.26.191.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.191.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.191.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.195.keytab.
Entry for principal kudu/127.26.191.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.195.keytab.
I20260811 05:08:36.072014 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424853995437-27391-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424853995437-27391-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424853995437-27391-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424853995437-27391-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.191.195:0
--local_ip_for_outbound_sockets=127.26.191.195
--webserver_interface=127.26.191.195
--webserver_port=0
--tserver_master_addrs=127.26.191.254:40425
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.195.keytab
--principal=kudu/127.26.191.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:39339
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:08:36.161358 11830 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:08:36.161595 11830 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:08:36.161634 11830 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:08:36.162794 11830 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:08:36.162863 11830 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:08:36.162911 11830 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.191.195
I20260811 05:08:36.164453 11830 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:39339
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424853995437-27391-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424853995437-27391-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.195.keytab
--principal=kudu/127.26.191.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.191.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424853995437-27391-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.191.195
--webserver_port=0
--tserver_master_addrs=127.26.191.254:40425
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11830
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.191.195
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424853995437-27391-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:08:36.164758 11830 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:08:36.165020 11830 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:08:36.171221 11840 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:36.171217 11836 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:36.171221 11837 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:08:36.171582 11830 server_base.cc:1034] running on GCE node
I20260811 05:08:36.171845 11830 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:08:36.172053 11830 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:08:36.173203 11830 hybrid_clock.cc:648] HybridClock initialized: now 1786424916173182 us; error 30 us; skew 500 ppm
Aug 11 05:08:36 dist-test-slave-x5fp krb5kdc[11293](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424916, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:08:36.175817 11830 init.cc:377] Logged in from keytab as kudu/127.26.191.195@KRBTEST.COM (short username kudu)
I20260811 05:08:36.176312 11830 webserver.cc:460] Webserver started at http://127.26.191.195:43601/ using document root <none> and password file <none>
I20260811 05:08:36.176571 11830 fs_manager.cc:359] Metadata directory not provided
I20260811 05:08:36.176620 11830 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:08:36.176800 11830 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:08:36.178057 11830 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424853995437-27391-0/minicluster-data/ts-2/data/instance:
uuid: "c5879de0f64e48439c37aa47c2e25552"
format_stamp: "Formatted at 2026-08-11 05:08:36 on dist-test-slave-x5fp"
server_key: "aa5121fee7d0b264225b1e29ce43e31a"
server_key_iv: "269d72abfe971515ac5532d6baf4d394"
server_key_version: "encryptionkey@0"
I20260811 05:08:36.178504 11830 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424853995437-27391-0/minicluster-data/ts-2/wal/instance:
uuid: "c5879de0f64e48439c37aa47c2e25552"
format_stamp: "Formatted at 2026-08-11 05:08:36 on dist-test-slave-x5fp"
server_key: "aa5121fee7d0b264225b1e29ce43e31a"
server_key_iv: "269d72abfe971515ac5532d6baf4d394"
server_key_version: "encryptionkey@0"
I20260811 05:08:36.180032 11830 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 05:08:36.181034 11850 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:36.181281 11830 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:08:36.181416 11830 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424853995437-27391-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424853995437-27391-0/minicluster-data/ts-2/wal
uuid: "c5879de0f64e48439c37aa47c2e25552"
format_stamp: "Formatted at 2026-08-11 05:08:36 on dist-test-slave-x5fp"
server_key: "aa5121fee7d0b264225b1e29ce43e31a"
server_key_iv: "269d72abfe971515ac5532d6baf4d394"
server_key_version: "encryptionkey@0"
I20260811 05:08:36.181499 11830 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424853995437-27391-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424853995437-27391-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424853995437-27391-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:08:36.202564 11830 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:08:36.204663 11830 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:08:36.204869 11830 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:08:36.205134 11830 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:08:36.205488 11830 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:08:36.205550 11830 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:36.205597 11830 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:08:36.205629 11830 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:36.212117 11830 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.195:44441
I20260811 05:08:36.212178 12026 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.195:44441 every 8 connection(s)
I20260811 05:08:36.212582 11830 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424853995437-27391-0/minicluster-data/ts-2/data/info.pb
I20260811 05:08:36.218919 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 11830
I20260811 05:08:36.219043 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424853995437-27391-0/minicluster-data/ts-2/wal/instance
I20260811 05:08:36.219257 27391 external_mini_cluster.cc:1428] Setting key 807b0bd4cdfa984e08713403e469c930
Aug 11 05:08:36 dist-test-slave-x5fp krb5kdc[11293](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424916, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.195@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
I20260811 05:08:36.223121 11419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:36.213490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.195:48713 (local address 127.26.191.254:40425)
0811 05:08:36.213585 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:36.213588 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:36.213754 (+ 166us) server_negotiation.cc:407] Connection header received
0811 05:08:36.214265 (+ 511us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:36.214266 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:36.214277 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:36.214347 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:36.215309 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:36.215833 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:36.216919 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:36.217113 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:36.217177 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:36.219843 (+ 2666us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:36.219844 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:36.219845 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:08:36.219854 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:36.221517 (+ 1663us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:36.222009 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:36.222011 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:36.222012 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:36.222082 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:36.222373 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:36.222374 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:36.222375 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:36.222512 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:36.222600 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:36.222922 (+ 322us) server_negotiation.cc:299] Negotiation successful
0811 05:08:36.223021 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260811 05:08:36.223328 12030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:36.213443 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:40425 (local address 127.26.191.195:48713)
0811 05:08:36.213614 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:36.213660 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:36.214161 (+ 501us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:36.214410 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:36.214413 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:36.215001 (+ 588us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:36.215208 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:36.215213 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:36.215921 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:36.215921 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:36.216813 (+ 892us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:36.216816 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:36.217194 (+ 378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:36.217194 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:36.217300 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:36.218008 (+ 708us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:36.218018 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:36.219711 (+ 1693us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:08:36.221635 (+ 1924us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:36.221643 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:36.221646 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:36.221906 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:36.222161 (+ 255us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:36.222162 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:36.222163 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:36.222294 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:36.222590 (+ 296us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:08:36.222598 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:08:36.222758 (+ 160us) client_negotiation.cc:769] Sending connection context
0811 05:08:36.222875 (+ 117us) client_negotiation.cc:240] Negotiation successful
0811 05:08:36.223058 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":96,"threads_started":1}
I20260811 05:08:36.223855 12027 heartbeater.cc:347] Connected to a master server at 127.26.191.254:40425
I20260811 05:08:36.223984 12027 heartbeater.cc:464] Registering TS with master...
I20260811 05:08:36.224217 12027 heartbeater.cc:511] Master 127.26.191.254:40425 requested a full tablet report, sending...
I20260811 05:08:36.224682 11360 ts_manager.cc:194] Registered new tserver with Master: c5879de0f64e48439c37aa47c2e25552 (127.26.191.195:44441)
I20260811 05:08:36.225117 11360 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.191.195@KRBTEST.COM'} at 127.26.191.195:48713
I20260811 05:08:36.231254 27391 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 05:08:36.239668 11419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:36.232766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39312 (local address 127.26.191.254:40425)
0811 05:08:36.232865 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:36.232868 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:36.232977 (+ 109us) server_negotiation.cc:407] Connection header received
0811 05:08:36.233065 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:36.233067 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:36.233078 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:36.233143 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:36.233804 (+ 661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:36.234353 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:36.235196 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:36.235429 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:36.235512 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:36.237017 (+ 1505us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:36.237019 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:36.237019 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:08:36.237028 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:36.238283 (+ 1255us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:36.238673 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:36.238675 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:36.238675 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:36.238742 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:36.238986 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:36.238987 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:36.238987 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:36.239163 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:36.239287 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:36.239454 (+ 167us) server_negotiation.cc:299] Negotiation successful
0811 05:08:36.239541 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260811 05:08:36.241818 11360 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39312:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 05:08:36.243642 11360 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 05:08:36.251322 12047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:36.246745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53246 (local address 127.26.191.193:39685)
0811 05:08:36.247014 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:36.247021 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:36.247061 (+ 40us) server_negotiation.cc:407] Connection header received
0811 05:08:36.247225 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:36.247228 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:36.247247 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:36.247345 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:08:36.247518 (+ 173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:36.248382 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:36.249940 (+ 1558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:36.250807 (+ 867us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:36.250894 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:36.250964 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:36.251164 (+ 200us) server_negotiation.cc:299] Negotiation successful
0811 05:08:36.251213 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":231,"thread_start_us":113,"threads_started":1}
I20260811 05:08:36.251385 12048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:36.246753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42560 (local address 127.26.191.195:44441)
0811 05:08:36.247253 (+ 500us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:36.247258 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:36.247269 (+ 11us) server_negotiation.cc:407] Connection header received
0811 05:08:36.247311 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:36.247313 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:36.247329 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:36.247600 (+ 271us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:08:36.247667 (+ 67us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:36.248942 (+ 1275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:36.250142 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:36.250880 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:36.251007 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:36.251063 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:36.251234 (+ 171us) server_negotiation.cc:299] Negotiation successful
0811 05:08:36.251300 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":458,"thread_start_us":127,"threads_started":1}
I20260811 05:08:36.251441 12049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:36.247001 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40860 (local address 127.26.191.194:43903)
0811 05:08:36.247528 (+ 527us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:36.247533 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:36.247545 (+ 12us) server_negotiation.cc:407] Connection header received
0811 05:08:36.247588 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:36.247591 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:36.247609 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:36.247691 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:08:36.247917 (+ 226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:36.249158 (+ 1241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:36.250287 (+ 1129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:36.250787 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:36.250884 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:36.250950 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:36.251303 (+ 353us) server_negotiation.cc:299] Negotiation successful
0811 05:08:36.251348 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":482,"thread_start_us":102,"threads_started":1}
I20260811 05:08:36.251677 12046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:36.246447 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.193:39685 (local address 127.0.0.1:53246)
0811 05:08:36.247000 (+ 553us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:36.247010 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:36.247067 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:36.247362 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:36.247365 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:36.247367 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:08:36.247431 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:36.247433 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:36.248487 (+ 1054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:36.248488 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:36.249832 (+ 1344us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:36.249834 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:36.251004 (+ 1170us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:36.251005 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:36.251079 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:36.251084 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 05:08:36.251143 (+ 59us) client_negotiation.cc:240] Negotiation successful
0811 05:08:36.251197 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":533,"mutex_wait_us":3,"thread_start_us":95,"threads_started":1}
I20260811 05:08:36.251657 12045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:36.246447 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.194:43903 (local address 127.0.0.1:40860)
0811 05:08:36.246737 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:36.246748 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:36.246816 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:36.247786 (+ 970us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:36.247787 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:36.247790 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:08:36.247828 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:36.247829 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:36.249263 (+ 1434us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:36.249263 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:36.250196 (+ 933us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:36.250198 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:36.250881 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:36.250882 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:36.250968 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:36.251004 (+ 36us) client_negotiation.cc:769] Sending connection context
0811 05:08:36.251076 (+ 72us) client_negotiation.cc:240] Negotiation successful
0811 05:08:36.251145 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":267,"thread_start_us":96,"threads_started":1}
I20260811 05:08:36.251663 12044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:36.246435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.195:44441 (local address 127.0.0.1:42560)
0811 05:08:36.246562 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:36.246607 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:36.246709 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:36.247442 (+ 733us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:36.247443 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:36.247447 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:08:36.247512 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:36.247514 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:36.249075 (+ 1561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:36.249076 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:36.250017 (+ 941us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:36.250019 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:36.251025 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:36.251026 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:36.251096 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:36.251099 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 05:08:36.251147 (+ 48us) client_negotiation.cc:240] Negotiation successful
0811 05:08:36.251183 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":98,"mutex_wait_us":6,"thread_start_us":76,"threads_started":1}
I20260811 05:08:36.252837 11731 tablet_service.cc:1467] Processing CreateTablet for tablet 9a20a2fe3d034856affdf4795eb300f9 (DEFAULT_TABLE table=test-table [id=e068852f48c84ea59d766f487f8fe7dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:08:36.252843 11930 tablet_service.cc:1467] Processing CreateTablet for tablet 9a20a2fe3d034856affdf4795eb300f9 (DEFAULT_TABLE table=test-table [id=e068852f48c84ea59d766f487f8fe7dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:08:36.253034 11541 tablet_service.cc:1467] Processing CreateTablet for tablet 9a20a2fe3d034856affdf4795eb300f9 (DEFAULT_TABLE table=test-table [id=e068852f48c84ea59d766f487f8fe7dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:08:36.253254 11930 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a20a2fe3d034856affdf4795eb300f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:08:36.253255 11731 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a20a2fe3d034856affdf4795eb300f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:08:36.253369 11541 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a20a2fe3d034856affdf4795eb300f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:08:36.256068 12050 tablet_bootstrap.cc:492] T 9a20a2fe3d034856affdf4795eb300f9 P 5eee815b8be246c0a78bd46594688fe9: Bootstrap starting.
I20260811 05:08:36.256850 12050 tablet_bootstrap.cc:654] T 9a20a2fe3d034856affdf4795eb300f9 P 5eee815b8be246c0a78bd46594688fe9: Neither blocks nor log segments found. Creating new log.
I20260811 05:08:36.256935 12052 tablet_bootstrap.cc:492] T 9a20a2fe3d034856affdf4795eb300f9 P c720f8a2aa8f4a7190911db90ad78eb9: Bootstrap starting.
I20260811 05:08:36.257649 12052 tablet_bootstrap.cc:654] T 9a20a2fe3d034856affdf4795eb300f9 P c720f8a2aa8f4a7190911db90ad78eb9: Neither blocks nor log segments found. Creating new log.
I20260811 05:08:36.257618 12050 log.cc:824] T 9a20a2fe3d034856affdf4795eb300f9 P 5eee815b8be246c0a78bd46594688fe9: Log is configured to *not* fsync() on all Append() calls
I20260811 05:08:36.258220 12052 log.cc:824] T 9a20a2fe3d034856affdf4795eb300f9 P c720f8a2aa8f4a7190911db90ad78eb9: Log is configured to *not* fsync() on all Append() calls
I20260811 05:08:36.258491 12050 tablet_bootstrap.cc:492] T 9a20a2fe3d034856affdf4795eb300f9 P 5eee815b8be246c0a78bd46594688fe9: No bootstrap required, opened a new log
I20260811 05:08:36.258575 12050 ts_tablet_manager.cc:1397] T 9a20a2fe3d034856affdf4795eb300f9 P 5eee815b8be246c0a78bd46594688fe9: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260811 05:08:36.258585 12053 tablet_bootstrap.cc:492] T 9a20a2fe3d034856affdf4795eb300f9 P c5879de0f64e48439c37aa47c2e25552: Bootstrap starting.
I20260811 05:08:36.259017 12052 tablet_bootstrap.cc:492] T 9a20a2fe3d034856affdf4795eb300f9 P c720f8a2aa8f4a7190911db90ad78eb9: No bootstrap required, opened a new log
I20260811 05:08:36.259112 12052 ts_tablet_manager.cc:1397] T 9a20a2fe3d034856affdf4795eb300f9 P c720f8a2aa8f4a7190911db90ad78eb9: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 05:08:36.259208 12053 tablet_bootstrap.cc:654] T 9a20a2fe3d034856affdf4795eb300f9 P c5879de0f64e48439c37aa47c2e25552: Neither blocks nor log segments found. Creating new log.
I20260811 05:08:36.259763 12053 log.cc:824] T 9a20a2fe3d034856affdf4795eb300f9 P c5879de0f64e48439c37aa47c2e25552: Log is configured to *not* fsync() on all Append() calls
I20260811 05:08:36.260628 12053 tablet_bootstrap.cc:492] T 9a20a2fe3d034856affdf4795eb300f9 P c5879de0f64e48439c37aa47c2e25552: No bootstrap required, opened a new log
I20260811 05:08:36.260706 12053 ts_tablet_manager.cc:1397] T 9a20a2fe3d034856affdf4795eb300f9 P c5879de0f64e48439c37aa47c2e25552: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 05:08:36.260799 12050 raft_consensus.cc:348] T 9a20a2fe3d034856affdf4795eb300f9 P 5eee815b8be246c0a78bd46594688fe9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5879de0f64e48439c37aa47c2e25552" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 44441 } } peers { permanent_uuid: "5eee815b8be246c0a78bd46594688fe9" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 43903 } } peers { permanent_uuid: "c720f8a2aa8f4a7190911db90ad78eb9" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 39685 } }
I20260811 05:08:36.260978 12050 raft_consensus.cc:374] T 9a20a2fe3d034856affdf4795eb300f9 P 5eee815b8be246c0a78bd46594688fe9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:08:36.261026 12050 raft_consensus.cc:729] T 9a20a2fe3d034856affdf4795eb300f9 P 5eee815b8be246c0a78bd46594688fe9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eee815b8be246c0a78bd46594688fe9, State: Initialized, Role: FOLLOWER
I20260811 05:08:36.261162 12050 consensus_queue.cc:260] T 9a20a2fe3d034856affdf4795eb300f9 P 5eee815b8be246c0a78bd46594688fe9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5879de0f64e48439c37aa47c2e25552" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 44441 } } peers { permanent_uuid: "5eee815b8be246c0a78bd46594688fe9" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 43903 } } peers { permanent_uuid: "c720f8a2aa8f4a7190911db90ad78eb9" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 39685 } }
I20260811 05:08:36.261108 12052 raft_consensus.cc:348] T 9a20a2fe3d034856affdf4795eb300f9 P c720f8a2aa8f4a7190911db90ad78eb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5879de0f64e48439c37aa47c2e25552" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 44441 } } peers { permanent_uuid: "5eee815b8be246c0a78bd46594688fe9" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 43903 } } peers { permanent_uuid: "c720f8a2aa8f4a7190911db90ad78eb9" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 39685 } }
I20260811 05:08:36.261313 12052 raft_consensus.cc:374] T 9a20a2fe3d034856affdf4795eb300f9 P c720f8a2aa8f4a7190911db90ad78eb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:08:36.261353 12052 raft_consensus.cc:729] T 9a20a2fe3d034856affdf4795eb300f9 P c720f8a2aa8f4a7190911db90ad78eb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c720f8a2aa8f4a7190911db90ad78eb9, State: Initialized, Role: FOLLOWER
I20260811 05:08:36.261449 12050 ts_tablet_manager.cc:1428] T 9a20a2fe3d034856affdf4795eb300f9 P 5eee815b8be246c0a78bd46594688fe9: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260811 05:08:36.261495 12052 consensus_queue.cc:260] T 9a20a2fe3d034856affdf4795eb300f9 P c720f8a2aa8f4a7190911db90ad78eb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5879de0f64e48439c37aa47c2e25552" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 44441 } } peers { permanent_uuid: "5eee815b8be246c0a78bd46594688fe9" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 43903 } } peers { permanent_uuid: "c720f8a2aa8f4a7190911db90ad78eb9" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 39685 } }
I20260811 05:08:36.261615 11824 heartbeater.cc:503] Master 127.26.191.254:40425 was elected leader, sending a full tablet report...
I20260811 05:08:36.261827 12052 ts_tablet_manager.cc:1428] T 9a20a2fe3d034856affdf4795eb300f9 P c720f8a2aa8f4a7190911db90ad78eb9: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 05:08:36.261869 11626 heartbeater.cc:503] Master 127.26.191.254:40425 was elected leader, sending a full tablet report...
I20260811 05:08:36.262696 12053 raft_consensus.cc:348] T 9a20a2fe3d034856affdf4795eb300f9 P c5879de0f64e48439c37aa47c2e25552 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5879de0f64e48439c37aa47c2e25552" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 44441 } } peers { permanent_uuid: "5eee815b8be246c0a78bd46594688fe9" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 43903 } } peers { permanent_uuid: "c720f8a2aa8f4a7190911db90ad78eb9" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 39685 } }
I20260811 05:08:36.262874 12053 raft_consensus.cc:374] T 9a20a2fe3d034856affdf4795eb300f9 P c5879de0f64e48439c37aa47c2e25552 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:08:36.262916 12053 raft_consensus.cc:729] T 9a20a2fe3d034856affdf4795eb300f9 P c5879de0f64e48439c37aa47c2e25552 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5879de0f64e48439c37aa47c2e25552, State: Initialized, Role: FOLLOWER
I20260811 05:08:36.262992 12053 consensus_queue.cc:260] T 9a20a2fe3d034856affdf4795eb300f9 P c5879de0f64e48439c37aa47c2e25552 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5879de0f64e48439c37aa47c2e25552" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 44441 } } peers { permanent_uuid: "5eee815b8be246c0a78bd46594688fe9" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 43903 } } peers { permanent_uuid: "c720f8a2aa8f4a7190911db90ad78eb9" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 39685 } }
I20260811 05:08:36.263252 12053 ts_tablet_manager.cc:1428] T 9a20a2fe3d034856affdf4795eb300f9 P c5879de0f64e48439c37aa47c2e25552: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260811 05:08:36.263329 12027 heartbeater.cc:503] Master 127.26.191.254:40425 was elected leader, sending a full tablet report...
W20260811 05:08:36.286892 11825 tablet.cc:2369] T 9a20a2fe3d034856affdf4795eb300f9 P 5eee815b8be246c0a78bd46594688fe9: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 05:08:36.370963 11628 tablet.cc:2369] T 9a20a2fe3d034856affdf4795eb300f9 P c720f8a2aa8f4a7190911db90ad78eb9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 05:08:36.398130 12064 raft_consensus.cc:482] T 9a20a2fe3d034856affdf4795eb300f9 P c5879de0f64e48439c37aa47c2e25552 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 05:08:36.398283 12064 raft_consensus.cc:504] T 9a20a2fe3d034856affdf4795eb300f9 P c5879de0f64e48439c37aa47c2e25552 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5879de0f64e48439c37aa47c2e25552" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 44441 } } peers { permanent_uuid: "5eee815b8be246c0a78bd46594688fe9" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 43903 } } peers { permanent_uuid: "c720f8a2aa8f4a7190911db90ad78eb9" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 39685 } }
I20260811 05:08:36.398759 12064 leader_election.cc:288] T 9a20a2fe3d034856affdf4795eb300f9 P c5879de0f64e48439c37aa47c2e25552 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5eee815b8be246c0a78bd46594688fe9 (127.26.191.194:43903), c720f8a2aa8f4a7190911db90ad78eb9 (127.26.191.193:39685)
I20260811 05:08:36.402746 12049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:36.399095 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.195:59411 (local address 127.26.191.194:43903)
0811 05:08:36.399148 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:36.399150 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:36.399164 (+ 14us) server_negotiation.cc:407] Connection header received
0811 05:08:36.399200 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:36.399201 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:36.399212 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:36.399309 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:08:36.399492 (+ 183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:36.400272 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:36.401698 (+ 1426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:36.402349 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:36.402436 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:36.402445 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:36.402601 (+ 156us) server_negotiation.cc:299] Negotiation successful
0811 05:08:36.402666 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 05:08:36.402714 12030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:36.399008 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.194:43903 (local address 127.26.191.195:59411)
0811 05:08:36.399062 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:36.399076 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:36.399122 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:36.399324 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:36.399325 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:36.399327 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:08:36.399406 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:36.399408 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:36.400381 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:36.400382 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:36.401600 (+ 1218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:36.401603 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:36.402431 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:36.402432 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:36.402493 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:36.402497 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 05:08:36.402577 (+ 80us) client_negotiation.cc:240] Negotiation successful
0811 05:08:36.402621 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32,"mutex_wait_us":1}
I20260811 05:08:36.402812 12065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:36.399009 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.193:39685 (local address 127.26.191.195:44453)
0811 05:08:36.399330 (+ 321us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:36.399342 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:36.399401 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:36.399627 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:36.399628 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:36.399631 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:08:36.399731 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:36.399733 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:36.400636 (+ 903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:36.400637 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:36.401735 (+ 1098us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:36.401737 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:36.402551 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:36.402552 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:36.402615 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:36.402618 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 05:08:36.402669 (+ 51us) client_negotiation.cc:240] Negotiation successful
0811 05:08:36.402701 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":304,"mutex_wait_us":66,"thread_start_us":156,"threads_started":1}
I20260811 05:08:36.402822 12047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:36.399149 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.195:44453 (local address 127.26.191.193:39685)
0811 05:08:36.399195 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:36.399197 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:36.399436 (+ 239us) server_negotiation.cc:407] Connection header received
0811 05:08:36.399491 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:36.399493 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:36.399504 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:36.399562 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:08:36.399832 (+ 270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:36.400543 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:36.401826 (+ 1283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:36.402458 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:36.402529 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:36.402536 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:36.402699 (+ 163us) server_negotiation.cc:299] Negotiation successful
0811 05:08:36.402742 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 05:08:36.403157 11567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a20a2fe3d034856affdf4795eb300f9" candidate_uuid: "c5879de0f64e48439c37aa47c2e25552" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c720f8a2aa8f4a7190911db90ad78eb9" is_pre_election: true
I20260811 05:08:36.403189 11755 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a20a2fe3d034856affdf4795eb300f9" candidate_uuid: "c5879de0f64e48439c37aa47c2e25552" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eee815b8be246c0a78bd46594688fe9" is_pre_election: true
I20260811 05:08:36.403335 11567 raft_consensus.cc:2454] T 9a20a2fe3d034856affdf4795eb300f9 P c720f8a2aa8f4a7190911db90ad78eb9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5879de0f64e48439c37aa47c2e25552 in term 0.
I20260811 05:08:36.403410 11755 raft_consensus.cc:2454] T 9a20a2fe3d034856affdf4795eb300f9 P 5eee815b8be246c0a78bd46594688fe9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5879de0f64e48439c37aa47c2e25552 in term 0.
I20260811 05:08:36.403621 11851 leader_election.cc:302] T 9a20a2fe3d034856affdf4795eb300f9 P c5879de0f64e48439c37aa47c2e25552 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5879de0f64e48439c37aa47c2e25552, c720f8a2aa8f4a7190911db90ad78eb9; no voters:
I20260811 05:08:36.403789 12064 raft_consensus.cc:2781] T 9a20a2fe3d034856affdf4795eb300f9 P c5879de0f64e48439c37aa47c2e25552 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 05:08:36.403884 12064 raft_consensus.cc:482] T 9a20a2fe3d034856affdf4795eb300f9 P c5879de0f64e48439c37aa47c2e25552 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 05:08:36.403926 12064 raft_consensus.cc:3037] T 9a20a2fe3d034856affdf4795eb300f9 P c5879de0f64e48439c37aa47c2e25552 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:08:36.404754 12064 raft_consensus.cc:504] T 9a20a2fe3d034856affdf4795eb300f9 P c5879de0f64e48439c37aa47c2e25552 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5879de0f64e48439c37aa47c2e25552" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 44441 } } peers { permanent_uuid: "5eee815b8be246c0a78bd46594688fe9" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 43903 } } peers { permanent_uuid: "c720f8a2aa8f4a7190911db90ad78eb9" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 39685 } }
I20260811 05:08:36.404932 12064 leader_election.cc:288] T 9a20a2fe3d034856affdf4795eb300f9 P c5879de0f64e48439c37aa47c2e25552 [CANDIDATE]: Term 1 election: Requested vote from peers 5eee815b8be246c0a78bd46594688fe9 (127.26.191.194:43903), c720f8a2aa8f4a7190911db90ad78eb9 (127.26.191.193:39685)
I20260811 05:08:36.405153 11567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a20a2fe3d034856affdf4795eb300f9" candidate_uuid: "c5879de0f64e48439c37aa47c2e25552" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c720f8a2aa8f4a7190911db90ad78eb9"
I20260811 05:08:36.405144 11755 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a20a2fe3d034856affdf4795eb300f9" candidate_uuid: "c5879de0f64e48439c37aa47c2e25552" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eee815b8be246c0a78bd46594688fe9"
I20260811 05:08:36.405239 11755 raft_consensus.cc:3037] T 9a20a2fe3d034856affdf4795eb300f9 P 5eee815b8be246c0a78bd46594688fe9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:08:36.405239 11567 raft_consensus.cc:3037] T 9a20a2fe3d034856affdf4795eb300f9 P c720f8a2aa8f4a7190911db90ad78eb9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:08:36.406214 11567 raft_consensus.cc:2454] T 9a20a2fe3d034856affdf4795eb300f9 P c720f8a2aa8f4a7190911db90ad78eb9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5879de0f64e48439c37aa47c2e25552 in term 1.
I20260811 05:08:36.406214 11755 raft_consensus.cc:2454] T 9a20a2fe3d034856affdf4795eb300f9 P 5eee815b8be246c0a78bd46594688fe9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5879de0f64e48439c37aa47c2e25552 in term 1.
I20260811 05:08:36.406436 11852 leader_election.cc:302] T 9a20a2fe3d034856affdf4795eb300f9 P c5879de0f64e48439c37aa47c2e25552 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eee815b8be246c0a78bd46594688fe9, c5879de0f64e48439c37aa47c2e25552; no voters:
I20260811 05:08:36.406570 12064 raft_consensus.cc:2781] T 9a20a2fe3d034856affdf4795eb300f9 P c5879de0f64e48439c37aa47c2e25552 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:08:36.406737 12064 raft_consensus.cc:686] T 9a20a2fe3d034856affdf4795eb300f9 P c5879de0f64e48439c37aa47c2e25552 [term 1 LEADER]: Becoming Leader. State: Replica: c5879de0f64e48439c37aa47c2e25552, State: Running, Role: LEADER
I20260811 05:08:36.406879 12064 consensus_queue.cc:237] T 9a20a2fe3d034856affdf4795eb300f9 P c5879de0f64e48439c37aa47c2e25552 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5879de0f64e48439c37aa47c2e25552" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 44441 } } peers { permanent_uuid: "5eee815b8be246c0a78bd46594688fe9" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 43903 } } peers { permanent_uuid: "c720f8a2aa8f4a7190911db90ad78eb9" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 39685 } }
I20260811 05:08:36.408017 11360 catalog_manager.cc:5495] T 9a20a2fe3d034856affdf4795eb300f9 P c5879de0f64e48439c37aa47c2e25552 reported cstate change: term changed from 0 to 1, leader changed from <none> to c5879de0f64e48439c37aa47c2e25552 (127.26.191.195). New cstate: current_term: 1 leader_uuid: "c5879de0f64e48439c37aa47c2e25552" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5879de0f64e48439c37aa47c2e25552" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 44441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5eee815b8be246c0a78bd46594688fe9" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c720f8a2aa8f4a7190911db90ad78eb9" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 39685 } health_report { overall_health: UNKNOWN } } }
I20260811 05:08:36.432595 12048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:36.429921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42574 (local address 127.26.191.195:44441)
0811 05:08:36.429997 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:36.429999 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:36.430010 (+ 11us) server_negotiation.cc:407] Connection header received
0811 05:08:36.430091 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:36.430092 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:36.430115 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:36.430208 (+ 93us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:08:36.430387 (+ 179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:36.430875 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:36.431698 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:36.431912 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:36.432019 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:36.432197 (+ 178us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:08:36.432319 (+ 122us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:08:36.432435 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:36.432455 (+ 20us) server_negotiation.cc:299] Negotiation successful
0811 05:08:36.432476 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 05:08:36.434671 11755 raft_consensus.cc:1261] T 9a20a2fe3d034856affdf4795eb300f9 P 5eee815b8be246c0a78bd46594688fe9 [term 1 FOLLOWER]: Refusing update from remote peer c5879de0f64e48439c37aa47c2e25552: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:08:36.434692 11567 raft_consensus.cc:1261] T 9a20a2fe3d034856affdf4795eb300f9 P c720f8a2aa8f4a7190911db90ad78eb9 [term 1 FOLLOWER]: Refusing update from remote peer c5879de0f64e48439c37aa47c2e25552: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:08:36.435055 12064 consensus_queue.cc:1035] T 9a20a2fe3d034856affdf4795eb300f9 P c5879de0f64e48439c37aa47c2e25552 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eee815b8be246c0a78bd46594688fe9" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:08:36.435215 12067 consensus_queue.cc:1035] T 9a20a2fe3d034856affdf4795eb300f9 P c5879de0f64e48439c37aa47c2e25552 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c720f8a2aa8f4a7190911db90ad78eb9" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:08:36.437857 12071 mvcc.cc:205] Tried to move back new op lower bound from 7317196457713356800 to 7317196457603334144. Current Snapshot: MvccSnapshot[applied={T|T < 7317196457713356800}]
I20260811 05:08:36.437932 12074 mvcc.cc:205] Tried to move back new op lower bound from 7317196457713356800 to 7317196457603334144. Current Snapshot: MvccSnapshot[applied={T|T < 7317196457713356800}]
I20260811 05:08:36.438774 12076 mvcc.cc:205] Tried to move back new op lower bound from 7317196457713356800 to 7317196457603334144. Current Snapshot: MvccSnapshot[applied={T|T < 7317196457713356800 or (T in {7317196457713356800})}]
I20260811 05:08:36.440969 11358 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39312:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:08:36.441092 11358 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39312:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:08:36.441910 11358 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5421397b40ac4655b061da84ca628742: Sending DeleteTablet for 3 replicas of tablet 9a20a2fe3d034856affdf4795eb300f9
I20260811 05:08:36.442250 11930 tablet_service.cc:1514] Processing DeleteTablet for tablet 9a20a2fe3d034856affdf4795eb300f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:08:36 UTC) from {username='kudu', principal='kudu/127.26.191.254@KRBTEST.COM'} at 127.0.0.1:42560
I20260811 05:08:36.442306 11731 tablet_service.cc:1514] Processing DeleteTablet for tablet 9a20a2fe3d034856affdf4795eb300f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:08:36 UTC) from {username='kudu', principal='kudu/127.26.191.254@KRBTEST.COM'} at 127.0.0.1:40860
I20260811 05:08:36.442523 12092 tablet_replica.cc:330] T 9a20a2fe3d034856affdf4795eb300f9 P 5eee815b8be246c0a78bd46594688fe9: stopping tablet replica
I20260811 05:08:36.442625 12092 raft_consensus.cc:2229] T 9a20a2fe3d034856affdf4795eb300f9 P 5eee815b8be246c0a78bd46594688fe9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 05:08:36.442639 11541 tablet_service.cc:1514] Processing DeleteTablet for tablet 9a20a2fe3d034856affdf4795eb300f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:08:36 UTC) from {username='kudu', principal='kudu/127.26.191.254@KRBTEST.COM'} at 127.0.0.1:53246
I20260811 05:08:36.442739 12092 raft_consensus.cc:2258] T 9a20a2fe3d034856affdf4795eb300f9 P 5eee815b8be246c0a78bd46594688fe9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:08:36.443032 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 11449
I20260811 05:08:36.445897 12092 ts_tablet_manager.cc:1905] T 9a20a2fe3d034856affdf4795eb300f9 P 5eee815b8be246c0a78bd46594688fe9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:08:36.449016 12092 ts_tablet_manager.cc:1918] T 9a20a2fe3d034856affdf4795eb300f9 P 5eee815b8be246c0a78bd46594688fe9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 05:08:36.449105 12092 log.cc:1196] T 9a20a2fe3d034856affdf4795eb300f9 P 5eee815b8be246c0a78bd46594688fe9: Deleting WAL directory at /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424853995437-27391-0/minicluster-data/ts-1/wal/wals/9a20a2fe3d034856affdf4795eb300f9
I20260811 05:08:36.449390 12092 ts_tablet_manager.cc:1939] T 9a20a2fe3d034856affdf4795eb300f9 P 5eee815b8be246c0a78bd46594688fe9: Deleting consensus metadata
I20260811 05:08:36.450660 11334 catalog_manager.cc:4841] TS 5eee815b8be246c0a78bd46594688fe9 (127.26.191.194:43903): tablet 9a20a2fe3d034856affdf4795eb300f9 (table test-table [id=e068852f48c84ea59d766f487f8fe7dd]) successfully deleted
I20260811 05:08:36.452857 12088 tablet_replica.cc:330] T 9a20a2fe3d034856affdf4795eb300f9 P c5879de0f64e48439c37aa47c2e25552: stopping tablet replica
I20260811 05:08:36.452976 12088 raft_consensus.cc:2229] T 9a20a2fe3d034856affdf4795eb300f9 P c5879de0f64e48439c37aa47c2e25552 [term 1 LEADER]: Raft consensus shutting down.
I20260811 05:08:36.453116 12088 raft_consensus.cc:2258] T 9a20a2fe3d034856affdf4795eb300f9 P c5879de0f64e48439c37aa47c2e25552 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:08:36.453572 12088 ts_tablet_manager.cc:1905] T 9a20a2fe3d034856affdf4795eb300f9 P c5879de0f64e48439c37aa47c2e25552: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:08:36.455261 12088 ts_tablet_manager.cc:1918] T 9a20a2fe3d034856affdf4795eb300f9 P c5879de0f64e48439c37aa47c2e25552: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 05:08:36.455344 12088 log.cc:1196] T 9a20a2fe3d034856affdf4795eb300f9 P c5879de0f64e48439c37aa47c2e25552: Deleting WAL directory at /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424853995437-27391-0/minicluster-data/ts-2/wal/wals/9a20a2fe3d034856affdf4795eb300f9
I20260811 05:08:36.455626 12088 ts_tablet_manager.cc:1939] T 9a20a2fe3d034856affdf4795eb300f9 P c5879de0f64e48439c37aa47c2e25552: Deleting consensus metadata
I20260811 05:08:36.456131 11335 catalog_manager.cc:4841] TS c5879de0f64e48439c37aa47c2e25552 (127.26.191.195:44441): tablet 9a20a2fe3d034856affdf4795eb300f9 (table test-table [id=e068852f48c84ea59d766f487f8fe7dd]) successfully deleted
W20260811 05:08:36.458618 11333 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.191.193:39685 (error 108)
I20260811 05:08:36.459321 12044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:36.459118 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.193:39685 (local address 127.0.0.1:53260)
0811 05:08:36.459210 (+ 92us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:36.459270 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.193:39685: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260811 05:08:36.459472 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 11633
W20260811 05:08:36.459470 11333 catalog_manager.cc:4584] TS c720f8a2aa8f4a7190911db90ad78eb9 (127.26.191.193:39685): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 9a20a2fe3d034856affdf4795eb300f9: Network error: Client connection negotiation failed: client connection to 127.26.191.193:39685: connect: Connection refused (error 111)
I20260811 05:08:36.484769 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 11830
I20260811 05:08:36.499341 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 11315
2026-08-11T05:08:36Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2393 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 05:08:36 dist-test-slave-x5fp krb5kdc[12098](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 05:08:36 dist-test-slave-x5fp krb5kdc[12098](info): set up 2 sockets
Aug 11 05:08:36 dist-test-slave-x5fp krb5kdc[12098](info): commencing operation
krb5kdc: starting...
W20260811 05:08:37.894506 27391 mini_kdc.cc:121] Time spent starting KDC: real 1.368s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/krb5kdc/test-user.keytab.
Aug 11 05:08:37 dist-test-slave-x5fp krb5kdc[12098](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424917, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T05:08:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:08:38Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.26.191.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.26.191.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.26.191.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/krb5kdc/rangeradmin_127.26.191.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.26.191.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/krb5kdc/rangeradmin_127.26.191.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.26.191.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.26.191.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.26.191.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/krb5kdc/rangerlookup_127.26.191.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.26.191.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/krb5kdc/rangerlookup_127.26.191.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.26.191.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.26.191.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.26.191.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/krb5kdc/HTTP_127.26.191.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.26.191.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/krb5kdc/HTTP_127.26.191.212@KRBTEST.COM.keytab.
I20260811 05:08:38.092340 27391 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskVmtCMs/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/minicluster-data/postgres -l logfile start
2026-08-11 05:08:41.141 UTC [12144] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-11 05:08:41.141 UTC [12144] LOG: listening on IPv4 address "127.26.191.212", port 48351
2026-08-11 05:08:41.147 UTC [12144] LOG: listening on Unix socket "/tmp/.s.PGSQL.48351"
2026-08-11 05:08:41.171 UTC [12147] LOG: database system was shut down at 2026-08-11 05:08:39 UTC
2026-08-11 05:08:41.176 UTC [12144] LOG: database system is ready to accept connections
I20260811 05:08:42.417992 27391 mini_postgres.cc:96] Postgres bound to 48351
2026-08-11 05:08:42.426 UTC [12162] FATAL: database "slave" does not exist
127.26.191.212:48351 - accepting connections
I20260811 05:08:42.427649 27391 mini_ranger.cc:161] Starting Ranger...
I20260811 05:08:42.445603 27391 mini_ranger.cc:84] Created miniranger Postgres user
I20260811 05:08:43.087212 27391 mini_ranger.cc:87] Created ranger Postgres database
I20260811 05:08:43.087322 27391 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/minicluster-data/ranger-admin
2026-08-11 05:08:43,433 [I] DB FLAVOR :POSTGRES
2026-08-11 05:08:43,433 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 05:08:43,433 [I] Checking connection..
2026-08-11 05:08:43,434 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVmtCMs/build/release/bin/postgresql.jar:/tmp/dist-test-taskVmtCMs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.191.212:48351/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-11 05:08:43,717 [I] Checking connection passed.
2026-08-11 05:08:43,717 [I] --------- Verifying version history table ---------
2026-08-11 05:08:43,717 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVmtCMs/build/release/bin/postgresql.jar:/tmp/dist-test-taskVmtCMs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.191.212:48351/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 05:08:43,998 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 05:08:43,999 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVmtCMs/build/release/bin/postgresql.jar:/tmp/dist-test-taskVmtCMs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.191.212:48351/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 05:08:44,270 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 05:08:44,270 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-11 05:08:44,271 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVmtCMs/build/release/bin/postgresql.jar:/tmp/dist-test-taskVmtCMs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.191.212:48351/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskVmtCMs/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-11 05:08:44.561 UTC [12265] WARNING: there is no transaction in progress
2026-08-11 05:08:44,571 [I] create_dbversion_catalog.sql file imported successfully
2026-08-11 05:08:44,571 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVmtCMs/build/release/bin/postgresql.jar:/tmp/dist-test-taskVmtCMs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.191.212:48351/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 05:08:44,864 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-11 05:08:44,864 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 05:08:44,865 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVmtCMs/build/release/bin/postgresql.jar:/tmp/dist-test-taskVmtCMs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.191.212:48351/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-11 05:08:45,170 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVmtCMs/build/release/bin/postgresql.jar:/tmp/dist-test-taskVmtCMs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.191.212:48351/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-11 05:08:45,456 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVmtCMs/build/release/bin/postgresql.jar:/tmp/dist-test-taskVmtCMs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.191.212:48351/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-x5fp.c.gcp-upstream.internal','N') ;"
2026-08-11 05:08:45,716 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVmtCMs/build/release/bin/postgresql.jar:/tmp/dist-test-taskVmtCMs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.191.212:48351/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 05:08:46,006 [I] Table x_portal_user does not exist in database ranger
2026-08-11 05:08:46,006 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVmtCMs/build/release/bin/postgresql.jar:/tmp/dist-test-taskVmtCMs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.191.212:48351/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 05:08:46,295 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-11 05:08:46,296 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVmtCMs/build/release/bin/postgresql.jar:/tmp/dist-test-taskVmtCMs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.191.212:48351/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 05:08:46,541 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVmtCMs/build/release/bin/postgresql.jar:/tmp/dist-test-taskVmtCMs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.191.212:48351/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 05:08:46,803 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-11 05:08:46,803 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVmtCMs/build/release/bin/postgresql.jar:/tmp/dist-test-taskVmtCMs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.191.212:48351/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskVmtCMs/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-11 05:08:48.039 UTC [12443] WARNING: there is no transaction in progress
2026-08-11 05:08:48.062 UTC [12443] WARNING: there is no transaction in progress
2026-08-11 05:08:48.086 UTC [12443] WARNING: there is no transaction in progress
2026-08-11 05:08:48.112 UTC [12443] WARNING: there is no transaction in progress
2026-08-11 05:08:48.138 UTC [12443] WARNING: there is no transaction in progress
2026-08-11 05:08:48.161 UTC [12443] WARNING: there is no transaction in progress
2026-08-11 05:08:48.229 UTC [12443] WARNING: there is no transaction in progress
2026-08-11 05:08:48.238 UTC [12443] WARNING: there is no transaction in progress
2026-08-11 05:08:48.256 UTC [12443] WARNING: there is no transaction in progress
2026-08-11 05:08:48.270 UTC [12443] WARNING: there is no transaction in progress
2026-08-11 05:08:48.284 UTC [12443] WARNING: there is no transaction in progress
2026-08-11 05:08:48.303 UTC [12443] WARNING: there is no transaction in progress
2026-08-11 05:08:48.318 UTC [12443] WARNING: there is no transaction in progress
2026-08-11 05:08:48.327 UTC [12443] WARNING: there is no transaction in progress
2026-08-11 05:08:48.338 UTC [12443] WARNING: there is no transaction in progress
2026-08-11 05:08:48.348 UTC [12443] WARNING: there is no transaction in progress
2026-08-11 05:08:49,191 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-11 05:08:49,192 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVmtCMs/build/release/bin/postgresql.jar:/tmp/dist-test-taskVmtCMs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.191.212:48351/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-11 05:08:49,484 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-11 05:08:49,484 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVmtCMs/build/release/bin/postgresql.jar:/tmp/dist-test-taskVmtCMs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.191.212:48351/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 05:08:49,737 [I] Table x_portal_user already exists in database 'ranger'
2026-08-11 05:08:49,738 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVmtCMs/build/release/bin/postgresql.jar:/tmp/dist-test-taskVmtCMs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.191.212:48351/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 05:08:50,027 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-11 05:08:50,028 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVmtCMs/build/release/bin/postgresql.jar:/tmp/dist-test-taskVmtCMs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.191.212:48351/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 05:08:50,311 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVmtCMs/build/release/bin/postgresql.jar:/tmp/dist-test-taskVmtCMs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.191.212:48351/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 05:08:50,577 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVmtCMs/build/release/bin/postgresql.jar:/tmp/dist-test-taskVmtCMs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.191.212:48351/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-x5fp.c.gcp-upstream.internal';"
2026-08-11 05:08:50,831 [I] CORE_DB_SCHEMA import status has been updated
2026-08-11 05:08:50,831 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVmtCMs/build/release/bin/postgresql.jar:/tmp/dist-test-taskVmtCMs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.191.212:48351/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-11 05:08:51,107 [I] DB_PATCHES have already been applied
I20260811 05:08:51.114106 27391 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/minicluster-data/ranger-admin:/tmp/dist-test-taskVmtCMs/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskVmtCMs/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskVmtCMs/build/release/bin/postgresql.jar:/tmp/dist-test-taskVmtCMs/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260811 05:08:51.114192 27391 mini_ranger.cc:193] Using host: 127.26.191.212
I20260811 05:08:51.118880 27391 mini_ranger.cc:227] Ranger admin URL: http://127.26.191.212:40025
Aug 11, 2026 5:08:51 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 5:08:51 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 5:08:51 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/minicluster-data/ranger-admin/ews/webapp
Aug 11, 2026 5:08:51 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 11, 2026 5:08:51 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 11, 2026 5:08:52 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/minicluster-data/ranger-admin/ews/webapp].
Aug 11, 2026 5:08:52 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260811 05:08:52.536109 27391 mini_ranger.cc:160] Time spent starting Ranger: real 10.108s user 0.000s sys 0.013s
Aug 11, 2026 5:09:14 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 11, 2026 5:09:14 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.MetricsREST
Aug 11, 2026 5:09:14 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 11, 2026 5:09:14 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 11, 2026 5:09:14 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 11, 2026 5:09:14 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 11, 2026 5:09:14 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 11, 2026 5:09:14 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 11, 2026 5:09:14 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 11, 2026 5:09:14 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 11, 2026 5:09:14 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 11, 2026 5:09:14 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 11, 2026 5:09:14 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 11, 2026 5:09:14 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 11, 2026 5:09:14 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 11, 2026 5:09:14 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 11, 2026 5:09:14 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 11, 2026 5:09:15 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260811 05:09:16.345135 27391 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.26.191.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.26.191.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.26.191.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/krb5kdc/rangerkms_127.26.191.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.26.191.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/krb5kdc/rangerkms_127.26.191.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.26.191.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.26.191.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.26.191.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/krb5kdc/HTTP_127.26.191.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.26.191.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/krb5kdc/HTTP_127.26.191.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 11 05:09:16 dist-test-slave-x5fp krb5kdc[12098](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424956, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260811 05:09:16.447530 27391 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260811 05:09:16.459649 27391 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260811 05:09:17.569458 27391 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260811 05:09:17.569548 27391 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/minicluster-data/ranger-kms
I20260811 05:09:17.569569 27391 mini_ranger_kms.cc:227] Using postgres at 127.26.191.212:48351
2026-08-11 05:09:17,914 [I] DB FLAVOR :POSTGRES
2026-08-11 05:09:17,915 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 05:09:17,915 [I] Checking connection
2026-08-11 05:09:17,915 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVmtCMs/build/release/bin/postgresql.jar:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.191.212:48351/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-11 05:09:18,231 [I] connection success
2026-08-11 05:09:18,231 [I] --------- Verifying Ranger DB tables ---------
2026-08-11 05:09:18,231 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-11 05:09:18,231 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVmtCMs/build/release/bin/postgresql.jar:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.191.212:48351/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-11 05:09:18,499 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-11 05:09:18,499 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 05:09:18,499 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-11 05:09:18,499 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVmtCMs/build/release/bin/postgresql.jar:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.191.212:48351/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-11 05:09:18,795 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260811 05:09:19.329401 27391 mini_ranger_kms.cc:310] Created kms service
I20260811 05:09:19.576257 27391 mini_ranger_kms.cc:326] Created kudu user
I20260811 05:09:19.631719 27391 mini_ranger_kms.cc:343] Created rangerkms user
Aug 11 05:09:19 dist-test-slave-x5fp krb5kdc[12098](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424956, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.26.191.212@KRBTEST.COM
I20260811 05:09:20.106791 27391 mini_ranger_kms.cc:384] Added ranger policy
I20260811 05:09:20.106933 27391 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/minicluster-data/ranger-kms:/tmp/dist-test-taskVmtCMs/build/release/bin/postgresql.jar:/tmp/dist-test-taskVmtCMs/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskVmtCMs/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260811 05:09:20.106959 27391 mini_ranger_kms.cc:240] Using host: 127.26.191.212
I20260811 05:09:20.111965 27391 mini_ranger_kms.cc:276] Ranger KMS PID: 12727
I20260811 05:09:20.112120 27391 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.26.191.212:44643
Aug 11, 2026 5:09:21 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 5:09:21 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 5:09:21 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 11, 2026 5:09:21 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 11, 2026 5:09:21 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/minicluster-data/ranger-kms/ews/webapp].
Aug 11, 2026 5:09:21 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 11 05:09:22 dist-test-slave-x5fp krb5kdc[12098](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786424962, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.26.191.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:09:22.908010 27391 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.460s user 0.000s sys 0.323s
I20260811 05:09:22.908138 27391 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260811 05:09:22.908221 27391 mini_ranger_kms.cc:401] 127.26.191.212:44643/kms/v1/keys
Aug 11 05:09:23 dist-test-slave-x5fp krb5kdc[12098](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424962, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.26.191.212@KRBTEST.COM for HTTP/127.26.191.212@KRBTEST.COM
Aug 11 05:09:23 dist-test-slave-x5fp krb5kdc[12098](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424962, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.26.191.212@KRBTEST.COM for HTTP/127.26.191.212@KRBTEST.COM
Aug 11 05:09:26 dist-test-slave-x5fp krb5kdc[12098](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424966, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.26.191.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.191.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.191.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab.
Entry for principal kudu/127.26.191.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab.
I20260811 05:09:26.221840 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.254:37741
--webserver_interface=127.26.191.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab
--principal=kudu/127.26.191.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:40931
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.191.254:37741
--ranger_config_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.191.212:44643/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:09:26.337711 12800 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:09:26.337975 12800 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:09:26.338001 12800 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:09:26.339303 12800 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:09:26.339358 12800 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:09:26.339375 12800 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:09:26.339390 12800 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:09:26.339404 12800 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:09:26.341337 12800 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:40931
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/minicluster-data/master-0/wal
--ranger_kms_url=127.26.191.212:44643/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.26.191.254:37741
--ranger_config_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab
--principal=kudu/127.26.191.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.254:37741
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.191.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12800
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:09:26.341634 12800 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:09:26.341918 12800 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:09:26.348767 12811 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:09:26.348933 12809 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:09:26.348939 12808 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:09:26.348968 12800 server_base.cc:1034] running on GCE node
I20260811 05:09:26.349467 12800 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:09:26.349850 12800 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:09:26.351046 12800 hybrid_clock.cc:648] HybridClock initialized: now 1786424966351020 us; error 41 us; skew 500 ppm
Aug 11 05:09:26 dist-test-slave-x5fp krb5kdc[12098](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424966, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:09:26.360358 12800 init.cc:377] Logged in from keytab as kudu/127.26.191.254@KRBTEST.COM (short username kudu)
I20260811 05:09:26.361033 12800 webserver.cc:460] Webserver started at http://127.26.191.254:34345/ using document root <none> and password file <none>
I20260811 05:09:26.361290 12800 fs_manager.cc:359] Metadata directory not provided
I20260811 05:09:26.361357 12800 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:09:26.361527 12800 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 05:09:26 dist-test-slave-x5fp krb5kdc[12098](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424966, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.254@KRBTEST.COM for HTTP/127.26.191.212@KRBTEST.COM
I20260811 05:09:26.414505 12800 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/minicluster-data/master-0/data/instance:
uuid: "3ca33a0ed17648f5adc685690e91f1c0"
format_stamp: "Formatted at 2026-08-11 05:09:26 on dist-test-slave-x5fp"
server_key: "23f0659cacb5538140b1ec824137f331"
server_key_iv: "3bb9a503f07a61596c6de1e21d942669"
server_key_version: "kuduclusterkey@0"
I20260811 05:09:26.415027 12800 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/minicluster-data/master-0/wal/instance:
uuid: "3ca33a0ed17648f5adc685690e91f1c0"
format_stamp: "Formatted at 2026-08-11 05:09:26 on dist-test-slave-x5fp"
server_key: "23f0659cacb5538140b1ec824137f331"
server_key_iv: "3bb9a503f07a61596c6de1e21d942669"
server_key_version: "kuduclusterkey@0"
I20260811 05:09:26.416788 12800 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.004s sys 0.000s
I20260811 05:09:26.429913 12822 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:09:26.430168 12800 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:09:26.430285 12800 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/minicluster-data/master-0/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/minicluster-data/master-0/wal
uuid: "3ca33a0ed17648f5adc685690e91f1c0"
format_stamp: "Formatted at 2026-08-11 05:09:26 on dist-test-slave-x5fp"
server_key: "23f0659cacb5538140b1ec824137f331"
server_key_iv: "3bb9a503f07a61596c6de1e21d942669"
server_key_version: "kuduclusterkey@0"
I20260811 05:09:26.430426 12800 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:09:26.441107 12800 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:09:26.443274 12800 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:09:26.443468 12800 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:09:26.448621 12800 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.254:37741
I20260811 05:09:26.448648 12908 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.254:37741 every 8 connection(s)
I20260811 05:09:26.449149 12800 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
I20260811 05:09:26.449937 12911 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:09:26.451018 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 12800
I20260811 05:09:26.451141 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/minicluster-data/master-0/wal/instance
I20260811 05:09:26.451342 27391 external_mini_cluster.cc:1428] Setting key 09da4fb6869f79ab6a9bc6a86b1dd91b
I20260811 05:09:26.452862 12911 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3ca33a0ed17648f5adc685690e91f1c0: Bootstrap starting.
I20260811 05:09:26.453588 12911 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3ca33a0ed17648f5adc685690e91f1c0: Neither blocks nor log segments found. Creating new log.
I20260811 05:09:26.453926 12911 log.cc:824] T 00000000000000000000000000000000 P 3ca33a0ed17648f5adc685690e91f1c0: Log is configured to *not* fsync() on all Append() calls
I20260811 05:09:26.454676 12911 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3ca33a0ed17648f5adc685690e91f1c0: No bootstrap required, opened a new log
I20260811 05:09:26.457230 12911 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3ca33a0ed17648f5adc685690e91f1c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ca33a0ed17648f5adc685690e91f1c0" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 37741 } }
I20260811 05:09:26.457428 12911 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3ca33a0ed17648f5adc685690e91f1c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:09:26.457496 12911 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3ca33a0ed17648f5adc685690e91f1c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ca33a0ed17648f5adc685690e91f1c0, State: Initialized, Role: FOLLOWER
I20260811 05:09:26.457688 12911 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3ca33a0ed17648f5adc685690e91f1c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ca33a0ed17648f5adc685690e91f1c0" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 37741 } }
I20260811 05:09:26.457798 12911 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3ca33a0ed17648f5adc685690e91f1c0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:09:26.457858 12911 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3ca33a0ed17648f5adc685690e91f1c0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:09:26.457929 12911 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3ca33a0ed17648f5adc685690e91f1c0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:09:26.458700 12911 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3ca33a0ed17648f5adc685690e91f1c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ca33a0ed17648f5adc685690e91f1c0" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 37741 } }
I20260811 05:09:26.458858 12911 leader_election.cc:302] T 00000000000000000000000000000000 P 3ca33a0ed17648f5adc685690e91f1c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3ca33a0ed17648f5adc685690e91f1c0; no voters:
I20260811 05:09:26.459127 12911 leader_election.cc:288] T 00000000000000000000000000000000 P 3ca33a0ed17648f5adc685690e91f1c0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 05:09:26.459160 12918 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3ca33a0ed17648f5adc685690e91f1c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:09:26.460517 12918 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3ca33a0ed17648f5adc685690e91f1c0 [term 1 LEADER]: Becoming Leader. State: Replica: 3ca33a0ed17648f5adc685690e91f1c0, State: Running, Role: LEADER
Aug 11 05:09:26 dist-test-slave-x5fp krb5kdc[12098](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424966, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
I20260811 05:09:26.460664 12918 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3ca33a0ed17648f5adc685690e91f1c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ca33a0ed17648f5adc685690e91f1c0" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 37741 } }
I20260811 05:09:26.460662 12911 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3ca33a0ed17648f5adc685690e91f1c0 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:09:26.461059 12918 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ca33a0ed17648f5adc685690e91f1c0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3ca33a0ed17648f5adc685690e91f1c0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ca33a0ed17648f5adc685690e91f1c0" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 37741 } } }
I20260811 05:09:26.461174 12918 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ca33a0ed17648f5adc685690e91f1c0 [sys.catalog]: This master's current role is: LEADER
I20260811 05:09:26.461354 12918 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ca33a0ed17648f5adc685690e91f1c0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3ca33a0ed17648f5adc685690e91f1c0. Latest consensus state: current_term: 1 leader_uuid: "3ca33a0ed17648f5adc685690e91f1c0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ca33a0ed17648f5adc685690e91f1c0" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 37741 } } }
I20260811 05:09:26.461434 12918 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ca33a0ed17648f5adc685690e91f1c0 [sys.catalog]: This master's current role is: LEADER
I20260811 05:09:26.463263 12911 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260811 05:09:26.468632 12916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:09:26.451934 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45206 (local address 127.26.191.254:37741)
0811 05:09:26.452146 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0811 05:09:26.452157 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 05:09:26.452192 (+ 35us) server_negotiation.cc:407] Connection header received
0811 05:09:26.452782 (+ 590us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:09:26.452793 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:09:26.452864 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:09:26.453028 (+ 164us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:09:26.454088 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:09:26.455605 (+ 1517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:09:26.456925 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:09:26.457804 (+ 879us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:09:26.457961 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:09:26.461630 (+ 3669us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:09:26.461635 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:09:26.461635 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:09:26.461650 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:09:26.465989 (+ 4339us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:09:26.466662 (+ 673us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:09:26.466667 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:09:26.466668 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:09:26.466890 (+ 222us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:09:26.467204 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:09:26.467205 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:09:26.467206 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:09:26.467727 (+ 521us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:09:26.467962 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0811 05:09:26.468083 (+ 121us) server_negotiation.cc:299] Negotiation successful
0811 05:09:26.468311 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":162,"thread_start_us":91,"threads_started":1}
I20260811 05:09:26.472985 12925 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:09:26.474310 12925 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:09:26.476529 12925 catalog_manager.cc:1347] Generated new cluster ID: 53916813cd4f4451be8b775cab38e486
I20260811 05:09:26.476586 12925 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:09:26.489064 12925 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:09:26.489921 12925 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:09:26.502280 12925 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3ca33a0ed17648f5adc685690e91f1c0: Generated new TSK 0
I20260811 05:09:26.502735 12925 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.191.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.191.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.191.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.193.keytab.
Entry for principal kudu/127.26.191.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.193.keytab.
I20260811 05:09:27.365137 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.191.212:44643/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.191.193:0
--local_ip_for_outbound_sockets=127.26.191.193
--webserver_interface=127.26.191.193
--webserver_port=0
--tserver_master_addrs=127.26.191.254:37741
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.193.keytab
--principal=kudu/127.26.191.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:40931
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:09:27.461305 12978 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:09:27.461548 12978 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:09:27.461591 12978 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:09:27.462880 12978 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:09:27.462946 12978 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:09:27.462992 12978 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.191.193
I20260811 05:09:27.464602 12978 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:40931
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.26.191.212:44643/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.193.keytab
--principal=kudu/127.26.191.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.191.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.191.193
--webserver_port=0
--tserver_master_addrs=127.26.191.254:37741
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12978
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.191.193
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:09:27.464924 12978 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:09:27.465173 12978 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:09:27.470513 12984 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:09:27.470687 12978 server_base.cc:1034] running on GCE node
W20260811 05:09:27.470878 12988 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:09:27.471081 12985 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:09:27.471323 12978 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:09:27.471617 12978 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:09:27.472800 12978 hybrid_clock.cc:648] HybridClock initialized: now 1786424967472761 us; error 54 us; skew 500 ppm
Aug 11 05:09:27 dist-test-slave-x5fp krb5kdc[12098](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424967, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:09:27.476110 12978 init.cc:377] Logged in from keytab as kudu/127.26.191.193@KRBTEST.COM (short username kudu)
I20260811 05:09:27.476706 12978 webserver.cc:460] Webserver started at http://127.26.191.193:40207/ using document root <none> and password file <none>
I20260811 05:09:27.476991 12978 fs_manager.cc:359] Metadata directory not provided
I20260811 05:09:27.477064 12978 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:09:27.477216 12978 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 05:09:27 dist-test-slave-x5fp krb5kdc[12098](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424967, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.193@KRBTEST.COM for HTTP/127.26.191.212@KRBTEST.COM
I20260811 05:09:27.489998 12978 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/minicluster-data/ts-0/data/instance:
uuid: "b9f859352c08459d9985d947e9333bfe"
format_stamp: "Formatted at 2026-08-11 05:09:27 on dist-test-slave-x5fp"
server_key: "9579a61efdfed246df3b3c50da37e7db"
server_key_iv: "7fee613cf6a8267de69f2ad930173c03"
server_key_version: "kuduclusterkey@0"
I20260811 05:09:27.490643 12978 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/minicluster-data/ts-0/wal/instance:
uuid: "b9f859352c08459d9985d947e9333bfe"
format_stamp: "Formatted at 2026-08-11 05:09:27 on dist-test-slave-x5fp"
server_key: "9579a61efdfed246df3b3c50da37e7db"
server_key_iv: "7fee613cf6a8267de69f2ad930173c03"
server_key_version: "kuduclusterkey@0"
I20260811 05:09:27.493095 12978 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260811 05:09:27.508913 12999 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:09:27.509126 12978 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:09:27.509243 12978 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/minicluster-data/ts-0/wal
uuid: "b9f859352c08459d9985d947e9333bfe"
format_stamp: "Formatted at 2026-08-11 05:09:27 on dist-test-slave-x5fp"
server_key: "9579a61efdfed246df3b3c50da37e7db"
server_key_iv: "7fee613cf6a8267de69f2ad930173c03"
server_key_version: "kuduclusterkey@0"
I20260811 05:09:27.509358 12978 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:09:27.539896 12978 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:09:27.544246 12978 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:09:27.544493 12978 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:09:27.544873 12978 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:09:27.545341 12978 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:09:27.545390 12978 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:09:27.545431 12978 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:09:27.545485 12978 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:09:27.554965 12978 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.193:34903
I20260811 05:09:27.555558 12978 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/minicluster-data/ts-0/data/info.pb
I20260811 05:09:27.558348 13189 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.193:34903 every 8 connection(s)
Aug 11 05:09:27 dist-test-slave-x5fp krb5kdc[12098](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424967, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.193@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
I20260811 05:09:27.565433 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 12978
I20260811 05:09:27.565593 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/minicluster-data/ts-0/wal/instance
I20260811 05:09:27.565837 27391 external_mini_cluster.cc:1428] Setting key bf538c34d7d4f86cf511167af01dcdf1
I20260811 05:09:27.576596 13193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:09:27.559160 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.193:51365 (local address 127.26.191.254:37741)
0811 05:09:27.559304 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0811 05:09:27.559306 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:09:27.559548 (+ 242us) server_negotiation.cc:407] Connection header received
0811 05:09:27.560143 (+ 595us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:09:27.560145 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:09:27.560173 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:09:27.560248 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:09:27.560966 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:09:27.561612 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:09:27.563004 (+ 1392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:09:27.563290 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:09:27.563381 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:09:27.566002 (+ 2621us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:09:27.566004 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:09:27.566004 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:09:27.566013 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:09:27.574408 (+ 8395us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:09:27.575068 (+ 660us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:09:27.575070 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:09:27.575070 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:09:27.575150 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:09:27.575519 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:09:27.575520 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:09:27.575521 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:09:27.575686 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:09:27.575740 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 05:09:27.576361 (+ 621us) server_negotiation.cc:299] Negotiation successful
0811 05:09:27.576475 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118,"thread_start_us":77,"threads_started":1}
I20260811 05:09:27.576889 13196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:09:27.559132 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:37741 (local address 127.26.191.193:51365)
0811 05:09:27.559393 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0811 05:09:27.559437 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 05:09:27.560012 (+ 575us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:09:27.560323 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:09:27.560328 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:09:27.560565 (+ 237us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:09:27.560862 (+ 297us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:09:27.560866 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:09:27.561735 (+ 869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:09:27.561735 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:09:27.562896 (+ 1161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:09:27.562899 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:09:27.563393 (+ 494us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:09:27.563394 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:09:27.563539 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:09:27.564183 (+ 644us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:09:27.564192 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:09:27.565844 (+ 1652us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:09:27.574552 (+ 8708us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:09:27.574566 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:09:27.574570 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:09:27.574952 (+ 382us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:09:27.575253 (+ 301us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:09:27.575254 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:09:27.575254 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:09:27.575420 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:09:27.575799 (+ 379us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:09:27.575807 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:09:27.576047 (+ 240us) client_negotiation.cc:769] Sending connection context
0811 05:09:27.576331 (+ 284us) client_negotiation.cc:240] Negotiation successful
0811 05:09:27.576542 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":119,"threads_started":1}
I20260811 05:09:27.577626 13190 heartbeater.cc:347] Connected to a master server at 127.26.191.254:37741
I20260811 05:09:27.577756 13190 heartbeater.cc:464] Registering TS with master...
I20260811 05:09:27.578032 13190 heartbeater.cc:511] Master 127.26.191.254:37741 requested a full tablet report, sending...
I20260811 05:09:27.578655 12845 ts_manager.cc:194] Registered new tserver with Master: b9f859352c08459d9985d947e9333bfe (127.26.191.193:34903)
I20260811 05:09:27.579607 12845 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.191.193@KRBTEST.COM'} at 127.26.191.193:51365
WARNING: no policy specified for kudu/127.26.191.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.191.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.191.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.194.keytab.
Entry for principal kudu/127.26.191.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.194.keytab.
I20260811 05:09:27.612300 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.191.212:44643/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.191.194:0
--local_ip_for_outbound_sockets=127.26.191.194
--webserver_interface=127.26.191.194
--webserver_port=0
--tserver_master_addrs=127.26.191.254:37741
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.194.keytab
--principal=kudu/127.26.191.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:40931
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:09:27.745608 13200 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:09:27.746023 13200 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:09:27.746129 13200 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:09:27.748200 13200 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:09:27.748479 13200 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:09:27.748594 13200 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.191.194
I20260811 05:09:27.751209 13200 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:40931
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.26.191.212:44643/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.194.keytab
--principal=kudu/127.26.191.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.191.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.191.194
--webserver_port=0
--tserver_master_addrs=127.26.191.254:37741
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13200
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.191.194
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:09:27.751801 13200 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:09:27.752188 13200 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:09:27.762614 13209 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:09:27.762738 13207 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:09:27.762651 13212 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:09:27.764034 13200 server_base.cc:1034] running on GCE node
I20260811 05:09:27.764307 13200 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:09:27.764629 13200 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:09:27.767942 13200 hybrid_clock.cc:648] HybridClock initialized: now 1786424967767911 us; error 39 us; skew 500 ppm
Aug 11 05:09:27 dist-test-slave-x5fp krb5kdc[12098](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424967, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:09:27.771920 13200 init.cc:377] Logged in from keytab as kudu/127.26.191.194@KRBTEST.COM (short username kudu)
I20260811 05:09:27.772701 13200 webserver.cc:460] Webserver started at http://127.26.191.194:41117/ using document root <none> and password file <none>
I20260811 05:09:27.773149 13200 fs_manager.cc:359] Metadata directory not provided
I20260811 05:09:27.773294 13200 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:09:27.773507 13200 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 05:09:27 dist-test-slave-x5fp krb5kdc[12098](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424967, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.194@KRBTEST.COM for HTTP/127.26.191.212@KRBTEST.COM
I20260811 05:09:27.795262 13200 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/minicluster-data/ts-1/data/instance:
uuid: "abcaaeccbb3c4186b05a9471d75728d3"
format_stamp: "Formatted at 2026-08-11 05:09:27 on dist-test-slave-x5fp"
server_key: "147ee31e889e888223e77cc54010e32b"
server_key_iv: "34cbf002c303c375129eb505c00de5ad"
server_key_version: "kuduclusterkey@0"
I20260811 05:09:27.795897 13200 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/minicluster-data/ts-1/wal/instance:
uuid: "abcaaeccbb3c4186b05a9471d75728d3"
format_stamp: "Formatted at 2026-08-11 05:09:27 on dist-test-slave-x5fp"
server_key: "147ee31e889e888223e77cc54010e32b"
server_key_iv: "34cbf002c303c375129eb505c00de5ad"
server_key_version: "kuduclusterkey@0"
I20260811 05:09:27.804528 13200 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.002s sys 0.000s
Aug 11 05:09:27 dist-test-slave-x5fp krb5kdc[12098](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786424967, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:09:27.817843 13222 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:09:27.818084 13200 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:09:27.818194 13200 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/minicluster-data/ts-1/wal
uuid: "abcaaeccbb3c4186b05a9471d75728d3"
format_stamp: "Formatted at 2026-08-11 05:09:27 on dist-test-slave-x5fp"
server_key: "147ee31e889e888223e77cc54010e32b"
server_key_iv: "34cbf002c303c375129eb505c00de5ad"
server_key_version: "kuduclusterkey@0"
I20260811 05:09:27.818336 13200 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:09:27.838490 13200 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:09:27.841158 13200 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:09:27.841392 13200 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:09:27.841723 13200 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:09:27.842155 13200 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:09:27.842255 13200 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:09:27.842346 13200 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:09:27.842410 13200 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:09:27.865928 13200 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.194:37597
I20260811 05:09:27.866007 13417 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.194:37597 every 8 connection(s)
I20260811 05:09:27.866492 13200 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/minicluster-data/ts-1/data/info.pb
I20260811 05:09:27.871527 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 13200
I20260811 05:09:27.871654 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/minicluster-data/ts-1/wal/instance
I20260811 05:09:27.871865 27391 external_mini_cluster.cc:1428] Setting key 3e54c934a2b4a2a809cd56ef6a3ac901
Aug 11 05:09:27 dist-test-slave-x5fp krb5kdc[12098](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424967, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.194@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
I20260811 05:09:27.877988 13193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:09:27.867660 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.194:48297 (local address 127.26.191.254:37741)
0811 05:09:27.867728 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 05:09:27.867731 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:09:27.868009 (+ 278us) server_negotiation.cc:407] Connection header received
0811 05:09:27.868575 (+ 566us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:09:27.868576 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:09:27.868595 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:09:27.868668 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:09:27.869296 (+ 628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:09:27.869810 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:09:27.871167 (+ 1357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:09:27.871481 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:09:27.871556 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:09:27.874446 (+ 2890us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:09:27.874447 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:09:27.874448 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:09:27.874457 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:09:27.876091 (+ 1634us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:09:27.876554 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:09:27.876555 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:09:27.876556 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:09:27.876622 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:09:27.877113 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:09:27.877114 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:09:27.877115 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:09:27.877279 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:09:27.877336 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 05:09:27.877743 (+ 407us) server_negotiation.cc:299] Negotiation successful
0811 05:09:27.877855 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 05:09:27.878739 13421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:09:27.867362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:37741 (local address 127.26.191.194:48297)
0811 05:09:27.867866 (+ 504us) negotiation.cc:107] Waiting for socket to connect
0811 05:09:27.867904 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 05:09:27.868462 (+ 558us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:09:27.868766 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:09:27.868774 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:09:27.868977 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:09:27.869192 (+ 215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:09:27.869197 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:09:27.869918 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:09:27.869919 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:09:27.871069 (+ 1150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:09:27.871072 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:09:27.871639 (+ 567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:09:27.871641 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:09:27.871833 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:09:27.872522 (+ 689us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:09:27.872533 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:09:27.874328 (+ 1795us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:09:27.876202 (+ 1874us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:09:27.876210 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:09:27.876213 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:09:27.876472 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:09:27.876696 (+ 224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:09:27.876697 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:09:27.876697 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:09:27.877026 (+ 329us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:09:27.877390 (+ 364us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:09:27.877397 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:09:27.877582 (+ 185us) client_negotiation.cc:769] Sending connection context
0811 05:09:27.878404 (+ 822us) client_negotiation.cc:240] Negotiation successful
0811 05:09:27.878559 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":460,"thread_start_us":76,"threads_started":1}
I20260811 05:09:27.879235 13418 heartbeater.cc:347] Connected to a master server at 127.26.191.254:37741
I20260811 05:09:27.879370 13418 heartbeater.cc:464] Registering TS with master...
I20260811 05:09:27.879567 13418 heartbeater.cc:511] Master 127.26.191.254:37741 requested a full tablet report, sending...
I20260811 05:09:27.880005 12845 ts_manager.cc:194] Registered new tserver with Master: abcaaeccbb3c4186b05a9471d75728d3 (127.26.191.194:37597)
I20260811 05:09:27.880395 12845 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.191.194@KRBTEST.COM'} at 127.26.191.194:48297
WARNING: no policy specified for kudu/127.26.191.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.191.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.191.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.195.keytab.
Entry for principal kudu/127.26.191.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.195.keytab.
I20260811 05:09:27.925598 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.191.212:44643/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.191.195:0
--local_ip_for_outbound_sockets=127.26.191.195
--webserver_interface=127.26.191.195
--webserver_port=0
--tserver_master_addrs=127.26.191.254:37741
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.195.keytab
--principal=kudu/127.26.191.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:40931
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:09:28.083065 13426 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:09:28.083431 13426 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:09:28.083554 13426 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:09:28.085556 13426 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:09:28.085703 13426 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:09:28.085793 13426 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.191.195
I20260811 05:09:28.088254 13426 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:40931
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.26.191.212:44643/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.195.keytab
--principal=kudu/127.26.191.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.191.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.191.195
--webserver_port=0
--tserver_master_addrs=127.26.191.254:37741
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13426
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.191.195
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:09:28.088912 13426 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:09:28.089304 13426 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:09:28.097282 13431 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:09:28.097743 13436 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:09:28.098487 13434 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:09:28.099447 13426 server_base.cc:1034] running on GCE node
I20260811 05:09:28.099769 13426 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:09:28.100142 13426 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:09:28.101415 13426 hybrid_clock.cc:648] HybridClock initialized: now 1786424968101385 us; error 43 us; skew 500 ppm
Aug 11 05:09:28 dist-test-slave-x5fp krb5kdc[12098](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424968, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:09:28.105397 13426 init.cc:377] Logged in from keytab as kudu/127.26.191.195@KRBTEST.COM (short username kudu)
I20260811 05:09:28.106117 13426 webserver.cc:460] Webserver started at http://127.26.191.195:43871/ using document root <none> and password file <none>
I20260811 05:09:28.106472 13426 fs_manager.cc:359] Metadata directory not provided
I20260811 05:09:28.106627 13426 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:09:28.106876 13426 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 05:09:28 dist-test-slave-x5fp krb5kdc[12098](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424968, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.195@KRBTEST.COM for HTTP/127.26.191.212@KRBTEST.COM
I20260811 05:09:28.134961 13426 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/minicluster-data/ts-2/data/instance:
uuid: "6c5d894f5b6f43638ae9926c23e66450"
format_stamp: "Formatted at 2026-08-11 05:09:28 on dist-test-slave-x5fp"
server_key: "da15fe78fffd4296a765c70068ab40a0"
server_key_iv: "1dc696c0b318357aae63407faae42201"
server_key_version: "kuduclusterkey@0"
I20260811 05:09:28.135766 13426 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/minicluster-data/ts-2/wal/instance:
uuid: "6c5d894f5b6f43638ae9926c23e66450"
format_stamp: "Formatted at 2026-08-11 05:09:28 on dist-test-slave-x5fp"
server_key: "da15fe78fffd4296a765c70068ab40a0"
server_key_iv: "1dc696c0b318357aae63407faae42201"
server_key_version: "kuduclusterkey@0"
I20260811 05:09:28.140825 13426 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260811 05:09:28.156657 13445 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:09:28.157006 13426 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.002s sys 0.000s
I20260811 05:09:28.157126 13426 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/minicluster-data/ts-2/wal
uuid: "6c5d894f5b6f43638ae9926c23e66450"
format_stamp: "Formatted at 2026-08-11 05:09:28 on dist-test-slave-x5fp"
server_key: "da15fe78fffd4296a765c70068ab40a0"
server_key_iv: "1dc696c0b318357aae63407faae42201"
server_key_version: "kuduclusterkey@0"
I20260811 05:09:28.157238 13426 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:09:28.176574 13426 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:09:28.190228 13426 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:09:28.190434 13426 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:09:28.190699 13426 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:09:28.191138 13426 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:09:28.191191 13426 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:09:28.191286 13426 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:09:28.191331 13426 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:09:28.203549 13426 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.195:40857
I20260811 05:09:28.203672 13639 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.195:40857 every 8 connection(s)
I20260811 05:09:28.204160 13426 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/minicluster-data/ts-2/data/info.pb
Aug 11 05:09:28 dist-test-slave-x5fp krb5kdc[12098](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424968, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.195@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
I20260811 05:09:28.213440 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 13426
I20260811 05:09:28.213583 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/minicluster-data/ts-2/wal/instance
I20260811 05:09:28.213867 27391 external_mini_cluster.cc:1428] Setting key f03fd452d5d768bc8d4fed2a42816a8a
I20260811 05:09:28.216779 13193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:09:28.205187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.195:48987 (local address 127.26.191.254:37741)
0811 05:09:28.205263 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0811 05:09:28.205265 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:09:28.205491 (+ 226us) server_negotiation.cc:407] Connection header received
0811 05:09:28.206242 (+ 751us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:09:28.206244 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:09:28.206259 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:09:28.206291 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:09:28.207232 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:09:28.208013 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:09:28.209523 (+ 1510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:09:28.209821 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:09:28.209862 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:09:28.212999 (+ 3137us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:09:28.213001 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:09:28.213001 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:09:28.213009 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:09:28.214882 (+ 1873us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:09:28.215428 (+ 546us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:09:28.215429 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:09:28.215430 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:09:28.215517 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:09:28.215843 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:09:28.215844 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:09:28.215844 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:09:28.216041 (+ 197us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:09:28.216135 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0811 05:09:28.216480 (+ 345us) server_negotiation.cc:299] Negotiation successful
0811 05:09:28.216599 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 05:09:28.216836 13647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:09:28.205092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:37741 (local address 127.26.191.195:48987)
0811 05:09:28.205339 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0811 05:09:28.205394 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0811 05:09:28.206103 (+ 709us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:09:28.206519 (+ 416us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:09:28.206524 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:09:28.206811 (+ 287us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:09:28.207123 (+ 312us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:09:28.207129 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:09:28.208133 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:09:28.208133 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:09:28.209418 (+ 1285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:09:28.209421 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:09:28.209955 (+ 534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:09:28.209955 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:09:28.210098 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:09:28.210747 (+ 649us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:09:28.210758 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:09:28.212884 (+ 2126us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:09:28.214971 (+ 2087us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:09:28.214978 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:09:28.214981 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:09:28.215343 (+ 362us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:09:28.215608 (+ 265us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:09:28.215608 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:09:28.215609 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:09:28.215751 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:09:28.216129 (+ 378us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:09:28.216134 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:09:28.216303 (+ 169us) client_negotiation.cc:769] Sending connection context
0811 05:09:28.216422 (+ 119us) client_negotiation.cc:240] Negotiation successful
0811 05:09:28.216576 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":100,"threads_started":1}
I20260811 05:09:28.217835 13643 heartbeater.cc:347] Connected to a master server at 127.26.191.254:37741
I20260811 05:09:28.217947 13643 heartbeater.cc:464] Registering TS with master...
I20260811 05:09:28.218153 13643 heartbeater.cc:511] Master 127.26.191.254:37741 requested a full tablet report, sending...
I20260811 05:09:28.218540 12845 ts_manager.cc:194] Registered new tserver with Master: 6c5d894f5b6f43638ae9926c23e66450 (127.26.191.195:40857)
I20260811 05:09:28.219060 12845 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.191.195@KRBTEST.COM'} at 127.26.191.195:48987
I20260811 05:09:28.225849 27391 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 05:09:28.244664 13193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:09:28.233567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45222 (local address 127.26.191.254:37741)
0811 05:09:28.233641 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0811 05:09:28.233643 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:09:28.236274 (+ 2631us) server_negotiation.cc:407] Connection header received
0811 05:09:28.236418 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:09:28.236420 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:09:28.236433 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:09:28.236467 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:09:28.237435 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:09:28.238006 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:09:28.238819 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:09:28.239117 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:09:28.239196 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:09:28.241111 (+ 1915us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:09:28.241112 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:09:28.241112 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:09:28.241121 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:09:28.243109 (+ 1988us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:09:28.243587 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:09:28.243588 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:09:28.243588 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:09:28.243657 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:09:28.243966 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:09:28.243968 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:09:28.243968 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:09:28.244130 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:09:28.244215 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0811 05:09:28.244463 (+ 248us) server_negotiation.cc:299] Negotiation successful
0811 05:09:28.244552 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 05:09:28.247301 12845 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45222:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 05:09:28.249855 12845 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 05:09:28.261358 13663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:09:28.253450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.193:34903 (local address 127.0.0.1:45250)
0811 05:09:28.255216 (+ 1766us) negotiation.cc:107] Waiting for socket to connect
0811 05:09:28.255270 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0811 05:09:28.255342 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:09:28.255974 (+ 632us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:09:28.255978 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:09:28.255981 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:09:28.256066 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:09:28.256068 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:09:28.257922 (+ 1854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:09:28.257923 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:09:28.259760 (+ 1837us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:09:28.259764 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:09:28.261007 (+ 1243us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:09:28.261008 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:09:28.261102 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:09:28.261118 (+ 16us) client_negotiation.cc:769] Sending connection context
0811 05:09:28.261193 (+ 75us) client_negotiation.cc:240] Negotiation successful
0811 05:09:28.261252 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1726,"thread_start_us":84,"threads_started":1}
I20260811 05:09:28.262450 13664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:09:28.254337 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45250 (local address 127.26.191.193:34903)
0811 05:09:28.255493 (+ 1156us) server_negotiation.cc:206] Beginning negotiation
0811 05:09:28.255499 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 05:09:28.255511 (+ 12us) server_negotiation.cc:407] Connection header received
0811 05:09:28.255551 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:09:28.255553 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:09:28.255572 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:09:28.255667 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:09:28.256169 (+ 502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:09:28.257823 (+ 1654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:09:28.259870 (+ 2047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:09:28.260822 (+ 952us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:09:28.260901 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:09:28.260969 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 05:09:28.262301 (+ 1332us) server_negotiation.cc:299] Negotiation successful
0811 05:09:28.262355 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1118,"thread_start_us":80,"threads_started":1}
I20260811 05:09:28.263583 13081 tablet_service.cc:1467] Processing CreateTablet for tablet 85c1f281cd7743358d16f0b63546fb75 (DEFAULT_TABLE table=test-table [id=e4f015f3fab14b3997f84285589d020d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:09:28.264062 13081 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 85c1f281cd7743358d16f0b63546fb75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:09:28.264556 13660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:09:28.253897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.195:40857 (local address 127.0.0.1:40374)
0811 05:09:28.256679 (+ 2782us) negotiation.cc:107] Waiting for socket to connect
0811 05:09:28.256687 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 05:09:28.256773 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:09:28.257144 (+ 371us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:09:28.257145 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:09:28.257148 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:09:28.257202 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:09:28.257203 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:09:28.259031 (+ 1828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:09:28.259032 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:09:28.260238 (+ 1206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:09:28.260241 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:09:28.264249 (+ 4008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:09:28.264250 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:09:28.264331 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:09:28.264337 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 05:09:28.264397 (+ 60us) client_negotiation.cc:240] Negotiation successful
0811 05:09:28.264444 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2767,"thread_start_us":66,"threads_started":1}
I20260811 05:09:28.266259 13662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:09:28.253704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.194:37597 (local address 127.0.0.1:38626)
0811 05:09:28.256516 (+ 2812us) negotiation.cc:107] Waiting for socket to connect
0811 05:09:28.256529 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 05:09:28.256594 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:09:28.257538 (+ 944us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:09:28.257539 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:09:28.257541 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:09:28.257596 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:09:28.257598 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:09:28.261758 (+ 4160us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:09:28.261759 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:09:28.263033 (+ 1274us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:09:28.263037 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:09:28.265940 (+ 2903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:09:28.265941 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:09:28.266023 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:09:28.266029 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 05:09:28.266091 (+ 62us) client_negotiation.cc:240] Negotiation successful
0811 05:09:28.266143 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2787,"thread_start_us":79,"threads_started":1}
I20260811 05:09:28.266659 13669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:09:28.254706 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40374 (local address 127.26.191.195:40857)
0811 05:09:28.255921 (+ 1215us) server_negotiation.cc:206] Beginning negotiation
0811 05:09:28.255925 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:09:28.256890 (+ 965us) server_negotiation.cc:407] Connection header received
0811 05:09:28.256944 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:09:28.256947 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:09:28.256965 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:09:28.257052 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:09:28.257677 (+ 625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:09:28.258922 (+ 1245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:09:28.263165 (+ 4243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:09:28.264025 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:09:28.264136 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:09:28.264203 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 05:09:28.266483 (+ 2280us) server_negotiation.cc:299] Negotiation successful
0811 05:09:28.266557 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1177,"thread_start_us":75,"threads_started":1}
I20260811 05:09:28.267428 13531 tablet_service.cc:1467] Processing CreateTablet for tablet 85c1f281cd7743358d16f0b63546fb75 (DEFAULT_TABLE table=test-table [id=e4f015f3fab14b3997f84285589d020d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:09:28.267858 13531 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 85c1f281cd7743358d16f0b63546fb75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:09:28.269904 13670 tablet_bootstrap.cc:492] T 85c1f281cd7743358d16f0b63546fb75 P b9f859352c08459d9985d947e9333bfe: Bootstrap starting.
I20260811 05:09:28.271060 13670 tablet_bootstrap.cc:654] T 85c1f281cd7743358d16f0b63546fb75 P b9f859352c08459d9985d947e9333bfe: Neither blocks nor log segments found. Creating new log.
I20260811 05:09:28.271612 13670 log.cc:824] T 85c1f281cd7743358d16f0b63546fb75 P b9f859352c08459d9985d947e9333bfe: Log is configured to *not* fsync() on all Append() calls
I20260811 05:09:28.272598 13668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:09:28.254514 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38626 (local address 127.26.191.194:37597)
0811 05:09:28.255826 (+ 1312us) server_negotiation.cc:206] Beginning negotiation
0811 05:09:28.255831 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:09:28.257280 (+ 1449us) server_negotiation.cc:407] Connection header received
0811 05:09:28.257342 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:09:28.257345 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:09:28.257363 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:09:28.257438 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:09:28.260358 (+ 2920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:09:28.261659 (+ 1301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:09:28.264821 (+ 3162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:09:28.265695 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:09:28.265823 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:09:28.265893 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 05:09:28.272384 (+ 6491us) server_negotiation.cc:299] Negotiation successful
0811 05:09:28.272486 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1259,"thread_start_us":103,"threads_started":1}
I20260811 05:09:28.272620 13673 tablet_bootstrap.cc:492] T 85c1f281cd7743358d16f0b63546fb75 P 6c5d894f5b6f43638ae9926c23e66450: Bootstrap starting.
I20260811 05:09:28.274055 13673 tablet_bootstrap.cc:654] T 85c1f281cd7743358d16f0b63546fb75 P 6c5d894f5b6f43638ae9926c23e66450: Neither blocks nor log segments found. Creating new log.
I20260811 05:09:28.273765 13272 tablet_service.cc:1467] Processing CreateTablet for tablet 85c1f281cd7743358d16f0b63546fb75 (DEFAULT_TABLE table=test-table [id=e4f015f3fab14b3997f84285589d020d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:09:28.274369 13272 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 85c1f281cd7743358d16f0b63546fb75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:09:28.274596 13673 log.cc:824] T 85c1f281cd7743358d16f0b63546fb75 P 6c5d894f5b6f43638ae9926c23e66450: Log is configured to *not* fsync() on all Append() calls
I20260811 05:09:28.275641 13670 tablet_bootstrap.cc:492] T 85c1f281cd7743358d16f0b63546fb75 P b9f859352c08459d9985d947e9333bfe: No bootstrap required, opened a new log
I20260811 05:09:28.275727 13670 ts_tablet_manager.cc:1397] T 85c1f281cd7743358d16f0b63546fb75 P b9f859352c08459d9985d947e9333bfe: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260811 05:09:28.279181 13670 raft_consensus.cc:348] T 85c1f281cd7743358d16f0b63546fb75 P b9f859352c08459d9985d947e9333bfe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9f859352c08459d9985d947e9333bfe" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 34903 } } peers { permanent_uuid: "abcaaeccbb3c4186b05a9471d75728d3" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 37597 } } peers { permanent_uuid: "6c5d894f5b6f43638ae9926c23e66450" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 40857 } }
I20260811 05:09:28.279395 13670 raft_consensus.cc:374] T 85c1f281cd7743358d16f0b63546fb75 P b9f859352c08459d9985d947e9333bfe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:09:28.279444 13670 raft_consensus.cc:729] T 85c1f281cd7743358d16f0b63546fb75 P b9f859352c08459d9985d947e9333bfe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9f859352c08459d9985d947e9333bfe, State: Initialized, Role: FOLLOWER
I20260811 05:09:28.279461 13675 tablet_bootstrap.cc:492] T 85c1f281cd7743358d16f0b63546fb75 P abcaaeccbb3c4186b05a9471d75728d3: Bootstrap starting.
I20260811 05:09:28.280380 13670 consensus_queue.cc:260] T 85c1f281cd7743358d16f0b63546fb75 P b9f859352c08459d9985d947e9333bfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9f859352c08459d9985d947e9333bfe" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 34903 } } peers { permanent_uuid: "abcaaeccbb3c4186b05a9471d75728d3" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 37597 } } peers { permanent_uuid: "6c5d894f5b6f43638ae9926c23e66450" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 40857 } }
I20260811 05:09:28.280794 13675 tablet_bootstrap.cc:654] T 85c1f281cd7743358d16f0b63546fb75 P abcaaeccbb3c4186b05a9471d75728d3: Neither blocks nor log segments found. Creating new log.
I20260811 05:09:28.280948 13670 ts_tablet_manager.cc:1428] T 85c1f281cd7743358d16f0b63546fb75 P b9f859352c08459d9985d947e9333bfe: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260811 05:09:28.281149 13190 heartbeater.cc:503] Master 127.26.191.254:37741 was elected leader, sending a full tablet report...
I20260811 05:09:28.281288 13675 log.cc:824] T 85c1f281cd7743358d16f0b63546fb75 P abcaaeccbb3c4186b05a9471d75728d3: Log is configured to *not* fsync() on all Append() calls
I20260811 05:09:28.282191 13675 tablet_bootstrap.cc:492] T 85c1f281cd7743358d16f0b63546fb75 P abcaaeccbb3c4186b05a9471d75728d3: No bootstrap required, opened a new log
I20260811 05:09:28.282271 13675 ts_tablet_manager.cc:1397] T 85c1f281cd7743358d16f0b63546fb75 P abcaaeccbb3c4186b05a9471d75728d3: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.003s
I20260811 05:09:28.282999 13673 tablet_bootstrap.cc:492] T 85c1f281cd7743358d16f0b63546fb75 P 6c5d894f5b6f43638ae9926c23e66450: No bootstrap required, opened a new log
I20260811 05:09:28.283082 13673 ts_tablet_manager.cc:1397] T 85c1f281cd7743358d16f0b63546fb75 P 6c5d894f5b6f43638ae9926c23e66450: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.002s
I20260811 05:09:28.284689 13675 raft_consensus.cc:348] T 85c1f281cd7743358d16f0b63546fb75 P abcaaeccbb3c4186b05a9471d75728d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9f859352c08459d9985d947e9333bfe" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 34903 } } peers { permanent_uuid: "abcaaeccbb3c4186b05a9471d75728d3" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 37597 } } peers { permanent_uuid: "6c5d894f5b6f43638ae9926c23e66450" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 40857 } }
I20260811 05:09:28.284914 13675 raft_consensus.cc:374] T 85c1f281cd7743358d16f0b63546fb75 P abcaaeccbb3c4186b05a9471d75728d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:09:28.284955 13675 raft_consensus.cc:729] T 85c1f281cd7743358d16f0b63546fb75 P abcaaeccbb3c4186b05a9471d75728d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abcaaeccbb3c4186b05a9471d75728d3, State: Initialized, Role: FOLLOWER
I20260811 05:09:28.285192 13675 consensus_queue.cc:260] T 85c1f281cd7743358d16f0b63546fb75 P abcaaeccbb3c4186b05a9471d75728d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9f859352c08459d9985d947e9333bfe" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 34903 } } peers { permanent_uuid: "abcaaeccbb3c4186b05a9471d75728d3" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 37597 } } peers { permanent_uuid: "6c5d894f5b6f43638ae9926c23e66450" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 40857 } }
I20260811 05:09:28.285593 13675 ts_tablet_manager.cc:1428] T 85c1f281cd7743358d16f0b63546fb75 P abcaaeccbb3c4186b05a9471d75728d3: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 05:09:28.285800 13418 heartbeater.cc:503] Master 127.26.191.254:37741 was elected leader, sending a full tablet report...
I20260811 05:09:28.285676 13673 raft_consensus.cc:348] T 85c1f281cd7743358d16f0b63546fb75 P 6c5d894f5b6f43638ae9926c23e66450 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9f859352c08459d9985d947e9333bfe" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 34903 } } peers { permanent_uuid: "abcaaeccbb3c4186b05a9471d75728d3" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 37597 } } peers { permanent_uuid: "6c5d894f5b6f43638ae9926c23e66450" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 40857 } }
I20260811 05:09:28.285846 13673 raft_consensus.cc:374] T 85c1f281cd7743358d16f0b63546fb75 P 6c5d894f5b6f43638ae9926c23e66450 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:09:28.285882 13673 raft_consensus.cc:729] T 85c1f281cd7743358d16f0b63546fb75 P 6c5d894f5b6f43638ae9926c23e66450 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5d894f5b6f43638ae9926c23e66450, State: Initialized, Role: FOLLOWER
I20260811 05:09:28.286026 13673 consensus_queue.cc:260] T 85c1f281cd7743358d16f0b63546fb75 P 6c5d894f5b6f43638ae9926c23e66450 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9f859352c08459d9985d947e9333bfe" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 34903 } } peers { permanent_uuid: "abcaaeccbb3c4186b05a9471d75728d3" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 37597 } } peers { permanent_uuid: "6c5d894f5b6f43638ae9926c23e66450" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 40857 } }
I20260811 05:09:28.286755 13673 ts_tablet_manager.cc:1428] T 85c1f281cd7743358d16f0b63546fb75 P 6c5d894f5b6f43638ae9926c23e66450: Time spent starting tablet: real 0.004s user 0.003s sys 0.001s
I20260811 05:09:28.286936 13643 heartbeater.cc:503] Master 127.26.191.254:37741 was elected leader, sending a full tablet report...
W20260811 05:09:28.309463 13191 tablet.cc:2369] T 85c1f281cd7743358d16f0b63546fb75 P b9f859352c08459d9985d947e9333bfe: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 05:09:28.368176 13420 tablet.cc:2369] T 85c1f281cd7743358d16f0b63546fb75 P abcaaeccbb3c4186b05a9471d75728d3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 05:09:28.371645 13682 raft_consensus.cc:482] T 85c1f281cd7743358d16f0b63546fb75 P abcaaeccbb3c4186b05a9471d75728d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 05:09:28.371800 13682 raft_consensus.cc:504] T 85c1f281cd7743358d16f0b63546fb75 P abcaaeccbb3c4186b05a9471d75728d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9f859352c08459d9985d947e9333bfe" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 34903 } } peers { permanent_uuid: "abcaaeccbb3c4186b05a9471d75728d3" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 37597 } } peers { permanent_uuid: "6c5d894f5b6f43638ae9926c23e66450" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 40857 } }
I20260811 05:09:28.372383 13682 leader_election.cc:288] T 85c1f281cd7743358d16f0b63546fb75 P abcaaeccbb3c4186b05a9471d75728d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9f859352c08459d9985d947e9333bfe (127.26.191.193:34903), 6c5d894f5b6f43638ae9926c23e66450 (127.26.191.195:40857)
I20260811 05:09:28.378044 13421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:09:28.372888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.195:40857 (local address 127.26.191.194:37501)
0811 05:09:28.372944 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0811 05:09:28.372962 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 05:09:28.373039 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:09:28.373510 (+ 471us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:09:28.373511 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:09:28.373513 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:09:28.373594 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:09:28.373596 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:09:28.375329 (+ 1733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:09:28.375330 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:09:28.376696 (+ 1366us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:09:28.376699 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:09:28.377601 (+ 902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:09:28.377603 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:09:28.377718 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:09:28.377723 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 05:09:28.377777 (+ 54us) client_negotiation.cc:240] Negotiation successful
0811 05:09:28.377946 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27}
I20260811 05:09:28.378975 13669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:09:28.373237 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.194:37501 (local address 127.26.191.195:40857)
0811 05:09:28.373321 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0811 05:09:28.373325 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:09:28.373334 (+ 9us) server_negotiation.cc:407] Connection header received
0811 05:09:28.373368 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:09:28.373369 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:09:28.373379 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:09:28.373447 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:09:28.373674 (+ 227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:09:28.374588 (+ 914us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:09:28.376848 (+ 2260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:09:28.377472 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:09:28.377553 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:09:28.377565 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0811 05:09:28.378822 (+ 1257us) server_negotiation.cc:299] Negotiation successful
0811 05:09:28.378895 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260811 05:09:28.379311 13566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85c1f281cd7743358d16f0b63546fb75" candidate_uuid: "abcaaeccbb3c4186b05a9471d75728d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5d894f5b6f43638ae9926c23e66450" is_pre_election: true
I20260811 05:09:28.379478 13566 raft_consensus.cc:2454] T 85c1f281cd7743358d16f0b63546fb75 P 6c5d894f5b6f43638ae9926c23e66450 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abcaaeccbb3c4186b05a9471d75728d3 in term 0.
I20260811 05:09:28.379977 13226 leader_election.cc:302] T 85c1f281cd7743358d16f0b63546fb75 P abcaaeccbb3c4186b05a9471d75728d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c5d894f5b6f43638ae9926c23e66450, abcaaeccbb3c4186b05a9471d75728d3; no voters:
I20260811 05:09:28.380210 13682 raft_consensus.cc:2781] T 85c1f281cd7743358d16f0b63546fb75 P abcaaeccbb3c4186b05a9471d75728d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 05:09:28.380270 13682 raft_consensus.cc:482] T 85c1f281cd7743358d16f0b63546fb75 P abcaaeccbb3c4186b05a9471d75728d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 05:09:28.380293 13682 raft_consensus.cc:3037] T 85c1f281cd7743358d16f0b63546fb75 P abcaaeccbb3c4186b05a9471d75728d3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:09:28.381481 13682 raft_consensus.cc:504] T 85c1f281cd7743358d16f0b63546fb75 P abcaaeccbb3c4186b05a9471d75728d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9f859352c08459d9985d947e9333bfe" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 34903 } } peers { permanent_uuid: "abcaaeccbb3c4186b05a9471d75728d3" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 37597 } } peers { permanent_uuid: "6c5d894f5b6f43638ae9926c23e66450" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 40857 } }
I20260811 05:09:28.381650 13682 leader_election.cc:288] T 85c1f281cd7743358d16f0b63546fb75 P abcaaeccbb3c4186b05a9471d75728d3 [CANDIDATE]: Term 1 election: Requested vote from peers b9f859352c08459d9985d947e9333bfe (127.26.191.193:34903), 6c5d894f5b6f43638ae9926c23e66450 (127.26.191.195:40857)
I20260811 05:09:28.382073 13566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85c1f281cd7743358d16f0b63546fb75" candidate_uuid: "abcaaeccbb3c4186b05a9471d75728d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5d894f5b6f43638ae9926c23e66450"
I20260811 05:09:28.382172 13566 raft_consensus.cc:3037] T 85c1f281cd7743358d16f0b63546fb75 P 6c5d894f5b6f43638ae9926c23e66450 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:09:28.383205 13566 raft_consensus.cc:2454] T 85c1f281cd7743358d16f0b63546fb75 P 6c5d894f5b6f43638ae9926c23e66450 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abcaaeccbb3c4186b05a9471d75728d3 in term 1.
I20260811 05:09:28.383504 13226 leader_election.cc:302] T 85c1f281cd7743358d16f0b63546fb75 P abcaaeccbb3c4186b05a9471d75728d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c5d894f5b6f43638ae9926c23e66450, abcaaeccbb3c4186b05a9471d75728d3; no voters:
I20260811 05:09:28.383643 13682 raft_consensus.cc:2781] T 85c1f281cd7743358d16f0b63546fb75 P abcaaeccbb3c4186b05a9471d75728d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:09:28.383834 13682 raft_consensus.cc:686] T 85c1f281cd7743358d16f0b63546fb75 P abcaaeccbb3c4186b05a9471d75728d3 [term 1 LEADER]: Becoming Leader. State: Replica: abcaaeccbb3c4186b05a9471d75728d3, State: Running, Role: LEADER
I20260811 05:09:28.383955 13682 consensus_queue.cc:237] T 85c1f281cd7743358d16f0b63546fb75 P abcaaeccbb3c4186b05a9471d75728d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9f859352c08459d9985d947e9333bfe" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 34903 } } peers { permanent_uuid: "abcaaeccbb3c4186b05a9471d75728d3" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 37597 } } peers { permanent_uuid: "6c5d894f5b6f43638ae9926c23e66450" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 40857 } }
I20260811 05:09:28.384943 12845 catalog_manager.cc:5495] T 85c1f281cd7743358d16f0b63546fb75 P abcaaeccbb3c4186b05a9471d75728d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to abcaaeccbb3c4186b05a9471d75728d3 (127.26.191.194). New cstate: current_term: 1 leader_uuid: "abcaaeccbb3c4186b05a9471d75728d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9f859352c08459d9985d947e9333bfe" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 34903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abcaaeccbb3c4186b05a9471d75728d3" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 37597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c5d894f5b6f43638ae9926c23e66450" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 40857 } health_report { overall_health: UNKNOWN } } }
I20260811 05:09:28.389727 13421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:09:28.375173 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.193:34903 (local address 127.26.191.194:34157)
0811 05:09:28.378156 (+ 2983us) negotiation.cc:107] Waiting for socket to connect
0811 05:09:28.378170 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 05:09:28.378233 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:09:28.385547 (+ 7314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:09:28.385548 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:09:28.385552 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:09:28.385610 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:09:28.385612 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:09:28.387208 (+ 1596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:09:28.387209 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:09:28.388472 (+ 1263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:09:28.388476 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:09:28.389459 (+ 983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:09:28.389461 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:09:28.389533 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:09:28.389537 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 05:09:28.389589 (+ 52us) client_negotiation.cc:240] Negotiation successful
0811 05:09:28.389633 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2968,"thread_start_us":104,"threads_started":1}
I20260811 05:09:28.390138 13664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:09:28.373178 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.194:34157 (local address 127.26.191.193:34903)
0811 05:09:28.373284 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0811 05:09:28.373287 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:09:28.378305 (+ 5018us) server_negotiation.cc:407] Connection header received
0811 05:09:28.378344 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:09:28.378345 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:09:28.378361 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:09:28.378415 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:09:28.385933 (+ 7518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:09:28.386803 (+ 870us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:09:28.388593 (+ 1790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:09:28.389328 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:09:28.389410 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:09:28.389421 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0811 05:09:28.390010 (+ 589us) server_negotiation.cc:299] Negotiation successful
0811 05:09:28.390065 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260811 05:09:28.390731 13109 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85c1f281cd7743358d16f0b63546fb75" candidate_uuid: "abcaaeccbb3c4186b05a9471d75728d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9f859352c08459d9985d947e9333bfe" is_pre_election: true
I20260811 05:09:28.390944 13109 raft_consensus.cc:2454] T 85c1f281cd7743358d16f0b63546fb75 P b9f859352c08459d9985d947e9333bfe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abcaaeccbb3c4186b05a9471d75728d3 in term 0.
I20260811 05:09:28.391109 13107 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85c1f281cd7743358d16f0b63546fb75" candidate_uuid: "abcaaeccbb3c4186b05a9471d75728d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9f859352c08459d9985d947e9333bfe"
I20260811 05:09:28.391181 13107 raft_consensus.cc:3037] T 85c1f281cd7743358d16f0b63546fb75 P b9f859352c08459d9985d947e9333bfe [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:09:28.392282 13107 raft_consensus.cc:2454] T 85c1f281cd7743358d16f0b63546fb75 P b9f859352c08459d9985d947e9333bfe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abcaaeccbb3c4186b05a9471d75728d3 in term 1.
I20260811 05:09:28.415004 13668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:09:28.411021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38642 (local address 127.26.191.194:37597)
0811 05:09:28.411073 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 05:09:28.411075 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:09:28.411235 (+ 160us) server_negotiation.cc:407] Connection header received
0811 05:09:28.411284 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:09:28.411285 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:09:28.411312 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:09:28.411383 (+ 71us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:09:28.411607 (+ 224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:09:28.412462 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:09:28.413697 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:09:28.414066 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:09:28.414134 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:09:28.414368 (+ 234us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:09:28.414522 (+ 154us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:09:28.414601 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 05:09:28.414851 (+ 250us) server_negotiation.cc:299] Negotiation successful
0811 05:09:28.414875 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 05:09:28.426136 13566 raft_consensus.cc:1261] T 85c1f281cd7743358d16f0b63546fb75 P 6c5d894f5b6f43638ae9926c23e66450 [term 1 FOLLOWER]: Refusing update from remote peer abcaaeccbb3c4186b05a9471d75728d3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:09:28.426736 13688 consensus_queue.cc:1035] T 85c1f281cd7743358d16f0b63546fb75 P abcaaeccbb3c4186b05a9471d75728d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c5d894f5b6f43638ae9926c23e66450" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 40857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:09:28.429082 13107 raft_consensus.cc:1261] T 85c1f281cd7743358d16f0b63546fb75 P b9f859352c08459d9985d947e9333bfe [term 1 FOLLOWER]: Refusing update from remote peer abcaaeccbb3c4186b05a9471d75728d3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:09:28.429518 13688 consensus_queue.cc:1035] T 85c1f281cd7743358d16f0b63546fb75 P abcaaeccbb3c4186b05a9471d75728d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9f859352c08459d9985d947e9333bfe" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 34903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:09:28.434741 13694 mvcc.cc:205] Tried to move back new op lower bound from 7317196670669488128 to 7317196670501359616. Current Snapshot: MvccSnapshot[applied={T|T < 7317196670669488128}]
I20260811 05:09:28.435204 13697 mvcc.cc:205] Tried to move back new op lower bound from 7317196670669488128 to 7317196670501359616. Current Snapshot: MvccSnapshot[applied={T|T < 7317196670669488128}]
I20260811 05:09:28.438216 13695 mvcc.cc:205] Tried to move back new op lower bound from 7317196670669488128 to 7317196670501359616. Current Snapshot: MvccSnapshot[applied={T|T < 7317196670669488128}]
Aug 11 05:09:28 dist-test-slave-x5fp krb5kdc[12098](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424967, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.254@KRBTEST.COM for HTTP/127.26.191.212@KRBTEST.COM
I20260811 05:09:28.448336 12845 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45222:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:09:28.448439 12845 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45222:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:09:28.451233 12845 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3ca33a0ed17648f5adc685690e91f1c0: Sending DeleteTablet for 3 replicas of tablet 85c1f281cd7743358d16f0b63546fb75
I20260811 05:09:28.451876 13081 tablet_service.cc:1514] Processing DeleteTablet for tablet 85c1f281cd7743358d16f0b63546fb75 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:09:28 UTC) from {username='kudu', principal='kudu/127.26.191.254@KRBTEST.COM'} at 127.0.0.1:45250
I20260811 05:09:28.452167 13272 tablet_service.cc:1514] Processing DeleteTablet for tablet 85c1f281cd7743358d16f0b63546fb75 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:09:28 UTC) from {username='kudu', principal='kudu/127.26.191.254@KRBTEST.COM'} at 127.0.0.1:38626
I20260811 05:09:28.452440 13531 tablet_service.cc:1514] Processing DeleteTablet for tablet 85c1f281cd7743358d16f0b63546fb75 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:09:28 UTC) from {username='kudu', principal='kudu/127.26.191.254@KRBTEST.COM'} at 127.0.0.1:40374
I20260811 05:09:28.453275 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 12978
I20260811 05:09:28.481060 13705 tablet_replica.cc:330] T 85c1f281cd7743358d16f0b63546fb75 P abcaaeccbb3c4186b05a9471d75728d3: stopping tablet replica
I20260811 05:09:28.481346 13706 tablet_replica.cc:330] T 85c1f281cd7743358d16f0b63546fb75 P 6c5d894f5b6f43638ae9926c23e66450: stopping tablet replica
I20260811 05:09:28.481590 13706 raft_consensus.cc:2229] T 85c1f281cd7743358d16f0b63546fb75 P 6c5d894f5b6f43638ae9926c23e66450 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 05:09:28.481769 13705 raft_consensus.cc:2229] T 85c1f281cd7743358d16f0b63546fb75 P abcaaeccbb3c4186b05a9471d75728d3 [term 1 LEADER]: Raft consensus shutting down.
I20260811 05:09:28.481979 13706 raft_consensus.cc:2258] T 85c1f281cd7743358d16f0b63546fb75 P 6c5d894f5b6f43638ae9926c23e66450 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:09:28.482187 13705 raft_consensus.cc:2258] T 85c1f281cd7743358d16f0b63546fb75 P abcaaeccbb3c4186b05a9471d75728d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:09:28.482868 13706 ts_tablet_manager.cc:1905] T 85c1f281cd7743358d16f0b63546fb75 P 6c5d894f5b6f43638ae9926c23e66450: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:09:28.483330 13705 ts_tablet_manager.cc:1905] T 85c1f281cd7743358d16f0b63546fb75 P abcaaeccbb3c4186b05a9471d75728d3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:09:28.486646 13706 ts_tablet_manager.cc:1918] T 85c1f281cd7743358d16f0b63546fb75 P 6c5d894f5b6f43638ae9926c23e66450: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 05:09:28.492901 13705 ts_tablet_manager.cc:1918] T 85c1f281cd7743358d16f0b63546fb75 P abcaaeccbb3c4186b05a9471d75728d3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 05:09:28.493134 13706 log.cc:1196] T 85c1f281cd7743358d16f0b63546fb75 P 6c5d894f5b6f43638ae9926c23e66450: Deleting WAL directory at /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/minicluster-data/ts-2/wal/wals/85c1f281cd7743358d16f0b63546fb75
I20260811 05:09:28.493893 13706 ts_tablet_manager.cc:1939] T 85c1f281cd7743358d16f0b63546fb75 P 6c5d894f5b6f43638ae9926c23e66450: Deleting consensus metadata
I20260811 05:09:28.494066 13705 log.cc:1196] T 85c1f281cd7743358d16f0b63546fb75 P abcaaeccbb3c4186b05a9471d75728d3: Deleting WAL directory at /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424853995437-27391-0/minicluster-data/ts-1/wal/wals/85c1f281cd7743358d16f0b63546fb75
I20260811 05:09:28.494427 13705 ts_tablet_manager.cc:1939] T 85c1f281cd7743358d16f0b63546fb75 P abcaaeccbb3c4186b05a9471d75728d3: Deleting consensus metadata
I20260811 05:09:28.495007 12825 catalog_manager.cc:4841] TS abcaaeccbb3c4186b05a9471d75728d3 (127.26.191.194:37597): tablet 85c1f281cd7743358d16f0b63546fb75 (table test-table [id=e4f015f3fab14b3997f84285589d020d]) successfully deleted
I20260811 05:09:28.497824 12825 catalog_manager.cc:4841] TS 6c5d894f5b6f43638ae9926c23e66450 (127.26.191.195:40857): tablet 85c1f281cd7743358d16f0b63546fb75 (table test-table [id=e4f015f3fab14b3997f84285589d020d]) successfully deleted
W20260811 05:09:28.505086 12826 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.191.193:34903 (error 108)
I20260811 05:09:28.507265 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 13200
I20260811 05:09:28.513072 13662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:09:28.512924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.193:34903 (local address 127.0.0.1:45266)
0811 05:09:28.512970 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0811 05:09:28.513020 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.193:34903: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":21}
W20260811 05:09:28.513266 12826 catalog_manager.cc:4584] TS b9f859352c08459d9985d947e9333bfe (127.26.191.193:34903): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 85c1f281cd7743358d16f0b63546fb75: Network error: Client connection negotiation failed: client connection to 127.26.191.193:34903: connect: Connection refused (error 111)
I20260811 05:09:28.531001 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 13426
I20260811 05:09:28.588075 13662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:09:28.585664 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.193:34903 (local address 127.0.0.1:45272)
0811 05:09:28.587955 (+ 2291us) negotiation.cc:107] Waiting for socket to connect
0811 05:09:28.588017 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.193:34903: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2251}
I20260811 05:09:28.589001 13662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:09:28.588871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.193:34903 (local address 127.0.0.1:45280)
0811 05:09:28.588927 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0811 05:09:28.588960 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.193:34903: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260811 05:09:28.592331 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 12800
I20260811 05:09:28.607625 27391 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260811 05:09:28.954133 27391 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260811 05:09:28.954303 27391 mini_ranger.cc:66] Stopping Ranger...
I20260811 05:09:29.310298 27391 mini_ranger.cc:68] Stopped Ranger
2026-08-11 05:09:29.310 UTC [12144] LOG: received smart shutdown request
2026-08-11 05:09:29.315 UTC [12144] LOG: background worker "logical replication launcher" (PID 12159) exited with exit code 1
2026-08-11 05:09:29.315 UTC [12150] LOG: shutting down
2026-08-11 05:09:29.544 UTC [12144] LOG: database system is shut down
2026-08-11T05:09:29Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (53161 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 05:09:29 dist-test-slave-x5fp krb5kdc[13718](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 05:09:29 dist-test-slave-x5fp krb5kdc[13718](info): set up 2 sockets
Aug 11 05:09:29 dist-test-slave-x5fp krb5kdc[13718](info): commencing operation
krb5kdc: starting...
W20260811 05:09:30.961107 27391 mini_kdc.cc:121] Time spent starting KDC: real 1.273s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/krb5kdc/test-user.keytab.
Aug 11 05:09:31 dist-test-slave-x5fp krb5kdc[13718](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424971, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T05:09:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:09:31Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.26.191.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.26.191.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.26.191.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/krb5kdc/rangeradmin_127.26.191.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.26.191.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/krb5kdc/rangeradmin_127.26.191.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.26.191.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.26.191.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.26.191.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/krb5kdc/rangerlookup_127.26.191.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.26.191.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/krb5kdc/rangerlookup_127.26.191.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.26.191.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.26.191.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.26.191.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/krb5kdc/HTTP_127.26.191.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.26.191.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/krb5kdc/HTTP_127.26.191.212@KRBTEST.COM.keytab.
I20260811 05:09:31.160178 27391 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskVmtCMs/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/postgres -l logfile start
2026-08-11 05:09:34.321 UTC [13762] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-11 05:09:34.321 UTC [13762] LOG: listening on IPv4 address "127.26.191.212", port 34813
2026-08-11 05:09:34.328 UTC [13762] LOG: listening on Unix socket "/tmp/.s.PGSQL.34813"
2026-08-11 05:09:34.363 UTC [13765] LOG: database system was shut down at 2026-08-11 05:09:32 UTC
2026-08-11 05:09:34.368 UTC [13762] LOG: database system is ready to accept connections
I20260811 05:09:35.581583 27391 mini_postgres.cc:96] Postgres bound to 34813
2026-08-11 05:09:35.590 UTC [13778] FATAL: database "slave" does not exist
127.26.191.212:34813 - accepting connections
I20260811 05:09:35.590971 27391 mini_ranger.cc:161] Starting Ranger...
I20260811 05:09:35.610231 27391 mini_ranger.cc:84] Created miniranger Postgres user
I20260811 05:09:36.300325 27391 mini_ranger.cc:87] Created ranger Postgres database
I20260811 05:09:36.300436 27391 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ranger-admin
2026-08-11 05:09:36,614 [I] DB FLAVOR :POSTGRES
2026-08-11 05:09:36,614 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 05:09:36,614 [I] Checking connection..
2026-08-11 05:09:36,615 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVmtCMs/build/release/bin/postgresql.jar:/tmp/dist-test-taskVmtCMs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.191.212:34813/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-11 05:09:36,900 [I] Checking connection passed.
2026-08-11 05:09:36,901 [I] --------- Verifying version history table ---------
2026-08-11 05:09:36,901 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVmtCMs/build/release/bin/postgresql.jar:/tmp/dist-test-taskVmtCMs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.191.212:34813/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 05:09:37,177 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 05:09:37,178 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVmtCMs/build/release/bin/postgresql.jar:/tmp/dist-test-taskVmtCMs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.191.212:34813/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 05:09:37,457 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 05:09:37,458 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-11 05:09:37,458 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVmtCMs/build/release/bin/postgresql.jar:/tmp/dist-test-taskVmtCMs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.191.212:34813/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskVmtCMs/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-11 05:09:37.742 UTC [13874] WARNING: there is no transaction in progress
2026-08-11 05:09:37,751 [I] create_dbversion_catalog.sql file imported successfully
2026-08-11 05:09:37,752 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVmtCMs/build/release/bin/postgresql.jar:/tmp/dist-test-taskVmtCMs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.191.212:34813/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 05:09:38,026 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-11 05:09:38,026 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 05:09:38,026 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVmtCMs/build/release/bin/postgresql.jar:/tmp/dist-test-taskVmtCMs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.191.212:34813/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-11 05:09:38,290 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVmtCMs/build/release/bin/postgresql.jar:/tmp/dist-test-taskVmtCMs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.191.212:34813/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-11 05:09:38,555 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVmtCMs/build/release/bin/postgresql.jar:/tmp/dist-test-taskVmtCMs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.191.212:34813/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-x5fp.c.gcp-upstream.internal','N') ;"
2026-08-11 05:09:38,834 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVmtCMs/build/release/bin/postgresql.jar:/tmp/dist-test-taskVmtCMs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.191.212:34813/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 05:09:39,099 [I] Table x_portal_user does not exist in database ranger
2026-08-11 05:09:39,099 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVmtCMs/build/release/bin/postgresql.jar:/tmp/dist-test-taskVmtCMs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.191.212:34813/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 05:09:39,387 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-11 05:09:39,388 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVmtCMs/build/release/bin/postgresql.jar:/tmp/dist-test-taskVmtCMs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.191.212:34813/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 05:09:39,696 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVmtCMs/build/release/bin/postgresql.jar:/tmp/dist-test-taskVmtCMs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.191.212:34813/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 05:09:39,977 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-11 05:09:39,978 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVmtCMs/build/release/bin/postgresql.jar:/tmp/dist-test-taskVmtCMs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.191.212:34813/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskVmtCMs/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-11 05:09:41.220 UTC [14055] WARNING: there is no transaction in progress
2026-08-11 05:09:41.240 UTC [14055] WARNING: there is no transaction in progress
2026-08-11 05:09:41.260 UTC [14055] WARNING: there is no transaction in progress
2026-08-11 05:09:41.281 UTC [14055] WARNING: there is no transaction in progress
2026-08-11 05:09:41.300 UTC [14055] WARNING: there is no transaction in progress
2026-08-11 05:09:41.326 UTC [14055] WARNING: there is no transaction in progress
2026-08-11 05:09:41.397 UTC [14055] WARNING: there is no transaction in progress
2026-08-11 05:09:41.406 UTC [14055] WARNING: there is no transaction in progress
2026-08-11 05:09:41.425 UTC [14055] WARNING: there is no transaction in progress
2026-08-11 05:09:41.438 UTC [14055] WARNING: there is no transaction in progress
2026-08-11 05:09:41.450 UTC [14055] WARNING: there is no transaction in progress
2026-08-11 05:09:41.467 UTC [14055] WARNING: there is no transaction in progress
2026-08-11 05:09:41.480 UTC [14055] WARNING: there is no transaction in progress
2026-08-11 05:09:41.489 UTC [14055] WARNING: there is no transaction in progress
2026-08-11 05:09:41.498 UTC [14055] WARNING: there is no transaction in progress
2026-08-11 05:09:41.509 UTC [14055] WARNING: there is no transaction in progress
2026-08-11 05:09:42,509 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-11 05:09:42,510 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVmtCMs/build/release/bin/postgresql.jar:/tmp/dist-test-taskVmtCMs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.191.212:34813/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-11 05:09:42,811 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-11 05:09:42,811 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVmtCMs/build/release/bin/postgresql.jar:/tmp/dist-test-taskVmtCMs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.191.212:34813/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 05:09:43,112 [I] Table x_portal_user already exists in database 'ranger'
2026-08-11 05:09:43,112 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVmtCMs/build/release/bin/postgresql.jar:/tmp/dist-test-taskVmtCMs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.191.212:34813/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 05:09:43,402 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-11 05:09:43,403 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVmtCMs/build/release/bin/postgresql.jar:/tmp/dist-test-taskVmtCMs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.191.212:34813/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 05:09:43,680 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVmtCMs/build/release/bin/postgresql.jar:/tmp/dist-test-taskVmtCMs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.191.212:34813/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 05:09:43,969 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVmtCMs/build/release/bin/postgresql.jar:/tmp/dist-test-taskVmtCMs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.191.212:34813/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-x5fp.c.gcp-upstream.internal';"
2026-08-11 05:09:44,225 [I] CORE_DB_SCHEMA import status has been updated
2026-08-11 05:09:44,226 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVmtCMs/build/release/bin/postgresql.jar:/tmp/dist-test-taskVmtCMs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.191.212:34813/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-11 05:09:44,481 [I] DB_PATCHES have already been applied
I20260811 05:09:44.488582 27391 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ranger-admin:/tmp/dist-test-taskVmtCMs/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskVmtCMs/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskVmtCMs/build/release/bin/postgresql.jar:/tmp/dist-test-taskVmtCMs/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260811 05:09:44.488693 27391 mini_ranger.cc:193] Using host: 127.26.191.212
I20260811 05:09:44.493310 27391 mini_ranger.cc:227] Ranger admin URL: http://127.26.191.212:51947
Aug 11, 2026 5:09:44 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 5:09:44 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 5:09:44 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ranger-admin/ews/webapp
Aug 11, 2026 5:09:44 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 11, 2026 5:09:44 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 11, 2026 5:09:45 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ranger-admin/ews/webapp].
Aug 11, 2026 5:09:45 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260811 05:09:45.901141 27391 mini_ranger.cc:160] Time spent starting Ranger: real 10.310s user 0.004s sys 0.009s
Aug 11, 2026 5:10:06 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 11, 2026 5:10:06 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 11, 2026 5:10:06 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 11, 2026 5:10:06 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 11, 2026 5:10:06 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 11, 2026 5:10:06 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 11, 2026 5:10:06 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 11, 2026 5:10:06 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 11, 2026 5:10:06 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 11, 2026 5:10:06 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 11, 2026 5:10:06 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 11, 2026 5:10:06 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 11, 2026 5:10:06 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 11, 2026 5:10:06 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 11, 2026 5:10:06 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 11, 2026 5:10:06 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 11, 2026 5:10:06 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 11, 2026 5:10:07 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260811 05:10:08.270427 27391 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.26.191.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.26.191.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.26.191.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/krb5kdc/rangerkms_127.26.191.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.26.191.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/krb5kdc/rangerkms_127.26.191.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.26.191.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.26.191.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.26.191.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/krb5kdc/HTTP_127.26.191.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.26.191.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/krb5kdc/HTTP_127.26.191.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 11 05:10:08 dist-test-slave-x5fp krb5kdc[13718](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425008, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260811 05:10:08.360455 27391 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260811 05:10:08.371384 27391 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260811 05:10:09.303510 27391 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260811 05:10:09.303608 27391 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ranger-kms
I20260811 05:10:09.303637 27391 mini_ranger_kms.cc:227] Using postgres at 127.26.191.212:34813
2026-08-11 05:10:09,484 [I] DB FLAVOR :POSTGRES
2026-08-11 05:10:09,485 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 05:10:09,485 [I] Checking connection
2026-08-11 05:10:09,485 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVmtCMs/build/release/bin/postgresql.jar:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.191.212:34813/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-11 05:10:09,748 [I] connection success
2026-08-11 05:10:09,748 [I] --------- Verifying Ranger DB tables ---------
2026-08-11 05:10:09,749 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-11 05:10:09,749 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVmtCMs/build/release/bin/postgresql.jar:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.191.212:34813/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-11 05:10:10,046 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-11 05:10:10,047 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 05:10:10,047 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-11 05:10:10,047 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVmtCMs/build/release/bin/postgresql.jar:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.191.212:34813/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-11 05:10:10,320 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260811 05:10:10.871032 27391 mini_ranger_kms.cc:310] Created kms service
I20260811 05:10:11.083567 27391 mini_ranger_kms.cc:326] Created kudu user
I20260811 05:10:11.126801 27391 mini_ranger_kms.cc:343] Created rangerkms user
Aug 11 05:10:11 dist-test-slave-x5fp krb5kdc[13718](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425008, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.26.191.212@KRBTEST.COM
I20260811 05:10:11.580516 27391 mini_ranger_kms.cc:384] Added ranger policy
I20260811 05:10:11.580802 27391 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ranger-kms:/tmp/dist-test-taskVmtCMs/build/release/bin/postgresql.jar:/tmp/dist-test-taskVmtCMs/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskVmtCMs/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260811 05:10:11.580840 27391 mini_ranger_kms.cc:240] Using host: 127.26.191.212
I20260811 05:10:11.585590 27391 mini_ranger_kms.cc:276] Ranger KMS PID: 14365
I20260811 05:10:11.585701 27391 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.26.191.212:41673
Aug 11, 2026 5:10:12 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 5:10:12 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 5:10:12 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 11, 2026 5:10:12 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 11, 2026 5:10:13 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ranger-kms/ews/webapp].
Aug 11, 2026 5:10:13 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 11 05:10:13 dist-test-slave-x5fp krb5kdc[13718](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786425013, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.26.191.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 11 05:10:14 dist-test-slave-x5fp krb5kdc[13718](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425013, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.26.191.212@KRBTEST.COM for HTTP/127.26.191.212@KRBTEST.COM
I20260811 05:10:14.542857 27391 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.182s user 0.009s sys 0.155s
I20260811 05:10:14.542968 27391 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260811 05:10:14.543016 27391 mini_ranger_kms.cc:401] 127.26.191.212:41673/kms/v1/keys
Aug 11 05:10:14 dist-test-slave-x5fp krb5kdc[13718](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425013, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.26.191.212@KRBTEST.COM for HTTP/127.26.191.212@KRBTEST.COM
Aug 11 05:10:17 dist-test-slave-x5fp krb5kdc[13718](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425017, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.26.191.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.191.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.191.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab.
Entry for principal kudu/127.26.191.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab.
I20260811 05:10:17.185657 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.254:39719
--webserver_interface=127.26.191.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab
--principal=kudu/127.26.191.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:41685
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.191.254:39719
--ranger_config_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.191.212:41673/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:10:17.270387 14439 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:10:17.270617 14439 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:10:17.270639 14439 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:10:17.271842 14439 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:10:17.271926 14439 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:10:17.271950 14439 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:10:17.271971 14439 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:10:17.271998 14439 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:10:17.273622 14439 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:41685
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/master-0/wal
--ranger_kms_url=127.26.191.212:41673/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.26.191.254:39719
--ranger_config_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab
--principal=kudu/127.26.191.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.254:39719
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.191.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14439
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:10:17.273919 14439 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:10:17.274168 14439 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:10:17.279294 14450 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:10:17.279361 14439 server_base.cc:1034] running on GCE node
W20260811 05:10:17.279290 14449 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:10:17.279290 14455 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:10:17.279829 14439 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:10:17.280159 14439 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:10:17.281383 14439 hybrid_clock.cc:648] HybridClock initialized: now 1786425017281347 us; error 70 us; skew 500 ppm
Aug 11 05:10:17 dist-test-slave-x5fp krb5kdc[13718](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425017, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:10:17.288996 14439 init.cc:377] Logged in from keytab as kudu/127.26.191.254@KRBTEST.COM (short username kudu)
I20260811 05:10:17.289492 14439 webserver.cc:460] Webserver started at http://127.26.191.254:41531/ using document root <none> and password file <none>
I20260811 05:10:17.289729 14439 fs_manager.cc:359] Metadata directory not provided
I20260811 05:10:17.289801 14439 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:10:17.289968 14439 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 05:10:17 dist-test-slave-x5fp krb5kdc[13718](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425017, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.254@KRBTEST.COM for HTTP/127.26.191.212@KRBTEST.COM
I20260811 05:10:17.337554 14439 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/master-0/data/instance:
uuid: "b122260a99014bdf8d1960c3ee461f1c"
format_stamp: "Formatted at 2026-08-11 05:10:17 on dist-test-slave-x5fp"
server_key: "7416a56cbe4e266d0ec6e0cec126efac"
server_key_iv: "e4ecd915b1034f7482ab26bc79d599ef"
server_key_version: "kuduclusterkey@0"
I20260811 05:10:17.338047 14439 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/master-0/wal/instance:
uuid: "b122260a99014bdf8d1960c3ee461f1c"
format_stamp: "Formatted at 2026-08-11 05:10:17 on dist-test-slave-x5fp"
server_key: "7416a56cbe4e266d0ec6e0cec126efac"
server_key_iv: "e4ecd915b1034f7482ab26bc79d599ef"
server_key_version: "kuduclusterkey@0"
I20260811 05:10:17.339824 14439 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 05:10:17.354341 14468 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:10:17.354579 14439 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:10:17.354718 14439 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/master-0/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/master-0/wal
uuid: "b122260a99014bdf8d1960c3ee461f1c"
format_stamp: "Formatted at 2026-08-11 05:10:17 on dist-test-slave-x5fp"
server_key: "7416a56cbe4e266d0ec6e0cec126efac"
server_key_iv: "e4ecd915b1034f7482ab26bc79d599ef"
server_key_version: "kuduclusterkey@0"
I20260811 05:10:17.354835 14439 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:10:17.391676 14439 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:10:17.393975 14439 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:10:17.394100 14439 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:10:17.398579 14439 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.254:39719
I20260811 05:10:17.398627 14544 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.254:39719 every 8 connection(s)
I20260811 05:10:17.398989 14439 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
I20260811 05:10:17.399705 14546 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:10:17.402104 14546 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b122260a99014bdf8d1960c3ee461f1c: Bootstrap starting.
I20260811 05:10:17.402669 14546 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b122260a99014bdf8d1960c3ee461f1c: Neither blocks nor log segments found. Creating new log.
I20260811 05:10:17.402848 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 14439
I20260811 05:10:17.403005 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/master-0/wal/instance
I20260811 05:10:17.403017 14546 log.cc:824] T 00000000000000000000000000000000 P b122260a99014bdf8d1960c3ee461f1c: Log is configured to *not* fsync() on all Append() calls
I20260811 05:10:17.403242 27391 external_mini_cluster.cc:1428] Setting key 5e3c8f4694640c4724eccae4eb0cc586
I20260811 05:10:17.403999 14546 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b122260a99014bdf8d1960c3ee461f1c: No bootstrap required, opened a new log
I20260811 05:10:17.406386 14546 raft_consensus.cc:348] T 00000000000000000000000000000000 P b122260a99014bdf8d1960c3ee461f1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b122260a99014bdf8d1960c3ee461f1c" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 39719 } }
I20260811 05:10:17.406570 14546 raft_consensus.cc:374] T 00000000000000000000000000000000 P b122260a99014bdf8d1960c3ee461f1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:10:17.406625 14546 raft_consensus.cc:729] T 00000000000000000000000000000000 P b122260a99014bdf8d1960c3ee461f1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b122260a99014bdf8d1960c3ee461f1c, State: Initialized, Role: FOLLOWER
I20260811 05:10:17.406759 14546 consensus_queue.cc:260] T 00000000000000000000000000000000 P b122260a99014bdf8d1960c3ee461f1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b122260a99014bdf8d1960c3ee461f1c" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 39719 } }
I20260811 05:10:17.406839 14546 raft_consensus.cc:388] T 00000000000000000000000000000000 P b122260a99014bdf8d1960c3ee461f1c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:10:17.406863 14546 raft_consensus.cc:482] T 00000000000000000000000000000000 P b122260a99014bdf8d1960c3ee461f1c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:10:17.406930 14546 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b122260a99014bdf8d1960c3ee461f1c [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:10:17.407545 14546 raft_consensus.cc:504] T 00000000000000000000000000000000 P b122260a99014bdf8d1960c3ee461f1c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b122260a99014bdf8d1960c3ee461f1c" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 39719 } }
I20260811 05:10:17.407642 14546 leader_election.cc:302] T 00000000000000000000000000000000 P b122260a99014bdf8d1960c3ee461f1c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b122260a99014bdf8d1960c3ee461f1c; no voters:
I20260811 05:10:17.407866 14546 leader_election.cc:288] T 00000000000000000000000000000000 P b122260a99014bdf8d1960c3ee461f1c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 05:10:17.407892 14555 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b122260a99014bdf8d1960c3ee461f1c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:10:17.408036 14555 raft_consensus.cc:686] T 00000000000000000000000000000000 P b122260a99014bdf8d1960c3ee461f1c [term 1 LEADER]: Becoming Leader. State: Replica: b122260a99014bdf8d1960c3ee461f1c, State: Running, Role: LEADER
I20260811 05:10:17.408165 14555 consensus_queue.cc:237] T 00000000000000000000000000000000 P b122260a99014bdf8d1960c3ee461f1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b122260a99014bdf8d1960c3ee461f1c" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 39719 } }
I20260811 05:10:17.408210 14546 sys_catalog.cc:564] T 00000000000000000000000000000000 P b122260a99014bdf8d1960c3ee461f1c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:10:17.409909 14558 sys_catalog.cc:455] T 00000000000000000000000000000000 P b122260a99014bdf8d1960c3ee461f1c [sys.catalog]: SysCatalogTable state changed. Reason: New leader b122260a99014bdf8d1960c3ee461f1c. Latest consensus state: current_term: 1 leader_uuid: "b122260a99014bdf8d1960c3ee461f1c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b122260a99014bdf8d1960c3ee461f1c" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 39719 } } }
I20260811 05:10:17.409945 14557 sys_catalog.cc:455] T 00000000000000000000000000000000 P b122260a99014bdf8d1960c3ee461f1c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b122260a99014bdf8d1960c3ee461f1c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b122260a99014bdf8d1960c3ee461f1c" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 39719 } } }
I20260811 05:10:17.410019 14558 sys_catalog.cc:458] T 00000000000000000000000000000000 P b122260a99014bdf8d1960c3ee461f1c [sys.catalog]: This master's current role is: LEADER
I20260811 05:10:17.410033 14557 sys_catalog.cc:458] T 00000000000000000000000000000000 P b122260a99014bdf8d1960c3ee461f1c [sys.catalog]: This master's current role is: LEADER
I20260811 05:10:17.410621 14579 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:10:17.410867 14546 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
Aug 11 05:10:17 dist-test-slave-x5fp krb5kdc[13718](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425017, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
I20260811 05:10:17.411164 14579 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:10:17.416853 14579 catalog_manager.cc:1347] Generated new cluster ID: b38128ad6b6d46ed9d3751da574c2105
I20260811 05:10:17.416947 14579 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:10:17.423725 14554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:17.403858 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37228 (local address 127.26.191.254:39719)
0811 05:10:17.404074 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0811 05:10:17.404084 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 05:10:17.404118 (+ 34us) server_negotiation.cc:407] Connection header received
0811 05:10:17.404605 (+ 487us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:10:17.404613 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:10:17.404672 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:10:17.404872 (+ 200us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:10:17.405537 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:17.406465 (+ 928us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:17.407418 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:17.408020 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:17.408135 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:17.411742 (+ 3607us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:10:17.411748 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:10:17.411748 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:10:17.411763 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:10:17.421313 (+ 9550us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:10:17.421855 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:10:17.421858 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:10:17.421859 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:10:17.421977 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:10:17.422217 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:10:17.422218 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:10:17.422218 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:10:17.422576 (+ 358us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:10:17.423240 (+ 664us) server_negotiation.cc:1035] Waiting for connection context
0811 05:10:17.423321 (+ 81us) server_negotiation.cc:299] Negotiation successful
0811 05:10:17.423485 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":160,"thread_start_us":108,"threads_started":1}
I20260811 05:10:17.443203 14579 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:10:17.443980 14579 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:10:17.450409 14579 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b122260a99014bdf8d1960c3ee461f1c: Generated new TSK 0
I20260811 05:10:17.450618 14579 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.191.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.191.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.191.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.193.keytab.
Entry for principal kudu/127.26.191.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.193.keytab.
I20260811 05:10:18.160090 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.191.212:41673/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.191.193:0
--local_ip_for_outbound_sockets=127.26.191.193
--webserver_interface=127.26.191.193
--webserver_port=0
--tserver_master_addrs=127.26.191.254:39719
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.193.keytab
--principal=kudu/127.26.191.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:41685
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:10:18.254971 14620 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:10:18.255216 14620 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:10:18.255266 14620 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:10:18.256573 14620 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:10:18.256702 14620 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:10:18.256793 14620 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.191.193
I20260811 05:10:18.258463 14620 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:41685
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.26.191.212:41673/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.193.keytab
--principal=kudu/127.26.191.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.191.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.191.193
--webserver_port=0
--tserver_master_addrs=127.26.191.254:39719
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14620
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.191.193
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:10:18.258744 14620 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:10:18.259171 14620 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:10:18.265443 14626 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:10:18.265584 14632 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:10:18.265832 14620 server_base.cc:1034] running on GCE node
W20260811 05:10:18.265448 14627 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:10:18.266218 14620 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:10:18.266516 14620 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:10:18.267728 14620 hybrid_clock.cc:648] HybridClock initialized: now 1786425018267698 us; error 46 us; skew 500 ppm
Aug 11 05:10:18 dist-test-slave-x5fp krb5kdc[13718](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425018, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:10:18.270648 14620 init.cc:377] Logged in from keytab as kudu/127.26.191.193@KRBTEST.COM (short username kudu)
I20260811 05:10:18.271204 14620 webserver.cc:460] Webserver started at http://127.26.191.193:42553/ using document root <none> and password file <none>
I20260811 05:10:18.271556 14620 fs_manager.cc:359] Metadata directory not provided
I20260811 05:10:18.271631 14620 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:10:18.271780 14620 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 05:10:18 dist-test-slave-x5fp krb5kdc[13718](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425018, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.193@KRBTEST.COM for HTTP/127.26.191.212@KRBTEST.COM
I20260811 05:10:18.286401 14620 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ts-0/data/instance:
uuid: "ee86d999fab24b709d485d283cee4db8"
format_stamp: "Formatted at 2026-08-11 05:10:18 on dist-test-slave-x5fp"
server_key: "e886b3d5e2838f3713b40b07a69d1746"
server_key_iv: "bc643827c8860c66a61b6736837b2c13"
server_key_version: "kuduclusterkey@0"
I20260811 05:10:18.286972 14620 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ts-0/wal/instance:
uuid: "ee86d999fab24b709d485d283cee4db8"
format_stamp: "Formatted at 2026-08-11 05:10:18 on dist-test-slave-x5fp"
server_key: "e886b3d5e2838f3713b40b07a69d1746"
server_key_iv: "bc643827c8860c66a61b6736837b2c13"
server_key_version: "kuduclusterkey@0"
I20260811 05:10:18.289220 14620 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260811 05:10:18.304483 14647 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:10:18.304679 14620 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.002s sys 0.000s
I20260811 05:10:18.304837 14620 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ts-0/wal
uuid: "ee86d999fab24b709d485d283cee4db8"
format_stamp: "Formatted at 2026-08-11 05:10:18 on dist-test-slave-x5fp"
server_key: "e886b3d5e2838f3713b40b07a69d1746"
server_key_iv: "bc643827c8860c66a61b6736837b2c13"
server_key_version: "kuduclusterkey@0"
I20260811 05:10:18.304971 14620 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:10:18.337942 14620 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:10:18.340286 14620 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:10:18.340467 14620 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:10:18.340768 14620 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:10:18.341174 14620 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:10:18.341230 14620 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:10:18.341271 14620 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:10:18.341296 14620 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:10:18.348752 14620 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.193:35677
I20260811 05:10:18.348968 14828 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.193:35677 every 8 connection(s)
I20260811 05:10:18.349229 14620 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ts-0/data/info.pb
I20260811 05:10:18.350119 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 14620
I20260811 05:10:18.350245 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ts-0/wal/instance
I20260811 05:10:18.350435 27391 external_mini_cluster.cc:1428] Setting key c2ac99ffc8a9a51d399e212d8cb73d6c
Aug 11 05:10:18 dist-test-slave-x5fp krb5kdc[13718](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425018, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.193@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
I20260811 05:10:18.361266 14834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:18.350725 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.193:36433 (local address 127.26.191.254:39719)
0811 05:10:18.350882 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0811 05:10:18.350885 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:10:18.351668 (+ 783us) server_negotiation.cc:407] Connection header received
0811 05:10:18.352438 (+ 770us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:10:18.352439 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:10:18.352456 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:10:18.352539 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:10:18.353409 (+ 870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:18.353926 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:18.354944 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:18.355162 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:18.355242 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:18.357568 (+ 2326us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:10:18.357569 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:10:18.357570 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:10:18.357578 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:10:18.359580 (+ 2002us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:10:18.360082 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:10:18.360083 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:10:18.360083 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:10:18.360151 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:10:18.360474 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:10:18.360475 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:10:18.360475 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:10:18.360630 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:10:18.360717 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0811 05:10:18.361068 (+ 351us) server_negotiation.cc:299] Negotiation successful
0811 05:10:18.361166 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":100,"threads_started":1}
I20260811 05:10:18.361722 14831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:18.350081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:39719 (local address 127.26.191.193:36433)
0811 05:10:18.351487 (+ 1406us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:18.351548 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0811 05:10:18.352294 (+ 746us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:10:18.352695 (+ 401us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:10:18.352700 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:10:18.353019 (+ 319us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:10:18.353310 (+ 291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:10:18.353315 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:10:18.354024 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:10:18.354025 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:10:18.354849 (+ 824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:10:18.354851 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:10:18.355264 (+ 413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:10:18.355265 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:10:18.355406 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:18.355979 (+ 573us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:10:18.355991 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:10:18.357455 (+ 1464us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:10:18.359677 (+ 2222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:10:18.359686 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:10:18.359689 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:10:18.359995 (+ 306us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:10:18.360221 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:10:18.360222 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:10:18.360222 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:10:18.360390 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:10:18.360708 (+ 318us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:10:18.360763 (+ 55us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:10:18.360913 (+ 150us) client_negotiation.cc:769] Sending connection context
0811 05:10:18.361030 (+ 117us) client_negotiation.cc:240] Negotiation successful
0811 05:10:18.361190 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1348,"thread_start_us":87,"threads_started":1}
I20260811 05:10:18.362273 14829 heartbeater.cc:347] Connected to a master server at 127.26.191.254:39719
I20260811 05:10:18.362397 14829 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.26.191.194@KRBTEST.COM; defaulting to no policy
I20260811 05:10:18.362599 14829 heartbeater.cc:511] Master 127.26.191.254:39719 requested a full tablet report, sending...
I20260811 05:10:18.363224 14497 ts_manager.cc:194] Registered new tserver with Master: ee86d999fab24b709d485d283cee4db8 (127.26.191.193:35677)
I20260811 05:10:18.364260 14497 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.191.193@KRBTEST.COM'} at 127.26.191.193:36433
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.191.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.191.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.194.keytab.
Entry for principal kudu/127.26.191.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.194.keytab.
I20260811 05:10:18.388887 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.191.212:41673/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.191.194:0
--local_ip_for_outbound_sockets=127.26.191.194
--webserver_interface=127.26.191.194
--webserver_port=0
--tserver_master_addrs=127.26.191.254:39719
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.194.keytab
--principal=kudu/127.26.191.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:41685
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:10:18.519691 14840 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:10:18.520030 14840 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:10:18.520074 14840 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:10:18.522022 14840 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:10:18.522094 14840 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:10:18.522140 14840 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.191.194
I20260811 05:10:18.524698 14840 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:41685
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.26.191.212:41673/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.194.keytab
--principal=kudu/127.26.191.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.191.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.191.194
--webserver_port=0
--tserver_master_addrs=127.26.191.254:39719
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14840
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.191.194
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:10:18.525180 14840 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:10:18.525569 14840 file_cache.cc:493] Constructed file cache file cache with capacity 419430
Aug 11 05:10:18 dist-test-slave-x5fp krb5kdc[13718](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786425018, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260811 05:10:18.532172 14855 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:10:18.532603 14861 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:10:18.532158 14857 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:10:18.533340 14840 server_base.cc:1034] running on GCE node
I20260811 05:10:18.533576 14840 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:10:18.533916 14840 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:10:18.535108 14840 hybrid_clock.cc:648] HybridClock initialized: now 1786425018535085 us; error 41 us; skew 500 ppm
Aug 11 05:10:18 dist-test-slave-x5fp krb5kdc[13718](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425018, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:10:18.538515 14840 init.cc:377] Logged in from keytab as kudu/127.26.191.194@KRBTEST.COM (short username kudu)
I20260811 05:10:18.539085 14840 webserver.cc:460] Webserver started at http://127.26.191.194:46489/ using document root <none> and password file <none>
I20260811 05:10:18.539394 14840 fs_manager.cc:359] Metadata directory not provided
I20260811 05:10:18.539451 14840 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:10:18.539578 14840 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 05:10:18 dist-test-slave-x5fp krb5kdc[13718](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425018, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.194@KRBTEST.COM for HTTP/127.26.191.212@KRBTEST.COM
I20260811 05:10:18.556232 14840 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ts-1/data/instance:
uuid: "56acbe8a6ae44e8a93eec447cfb8eb66"
format_stamp: "Formatted at 2026-08-11 05:10:18 on dist-test-slave-x5fp"
server_key: "8653b1dd6c23abc25c63bb84b0a21715"
server_key_iv: "b607285979ca99b01223aa3eee479000"
server_key_version: "kuduclusterkey@0"
I20260811 05:10:18.556985 14840 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ts-1/wal/instance:
uuid: "56acbe8a6ae44e8a93eec447cfb8eb66"
format_stamp: "Formatted at 2026-08-11 05:10:18 on dist-test-slave-x5fp"
server_key: "8653b1dd6c23abc25c63bb84b0a21715"
server_key_iv: "b607285979ca99b01223aa3eee479000"
server_key_version: "kuduclusterkey@0"
I20260811 05:10:18.563108 14840 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.001s sys 0.001s
I20260811 05:10:18.579507 14875 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:10:18.579768 14840 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.000s
I20260811 05:10:18.579882 14840 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ts-1/wal
uuid: "56acbe8a6ae44e8a93eec447cfb8eb66"
format_stamp: "Formatted at 2026-08-11 05:10:18 on dist-test-slave-x5fp"
server_key: "8653b1dd6c23abc25c63bb84b0a21715"
server_key_iv: "b607285979ca99b01223aa3eee479000"
server_key_version: "kuduclusterkey@0"
I20260811 05:10:18.579985 14840 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:10:18.593351 14840 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:10:18.596690 14840 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:10:18.596891 14840 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:10:18.597218 14840 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:10:18.597649 14840 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:10:18.597707 14840 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:10:18.597750 14840 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:10:18.597776 14840 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:10:18.605295 14840 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.194:45367
I20260811 05:10:18.605429 15043 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.194:45367 every 8 connection(s)
I20260811 05:10:18.605746 14840 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ts-1/data/info.pb
I20260811 05:10:18.607514 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 14840
I20260811 05:10:18.607616 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ts-1/wal/instance
I20260811 05:10:18.607831 27391 external_mini_cluster.cc:1428] Setting key ac799bf7460981e8764991ae9a883d3f
Aug 11 05:10:18 dist-test-slave-x5fp krb5kdc[13718](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425018, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.194@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
I20260811 05:10:18.624431 14834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:18.606705 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.194:35127 (local address 127.26.191.254:39719)
0811 05:10:18.606761 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 05:10:18.606764 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:10:18.607062 (+ 298us) server_negotiation.cc:407] Connection header received
0811 05:10:18.607812 (+ 750us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:10:18.607814 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:10:18.607834 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:10:18.607873 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:10:18.608954 (+ 1081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:18.609785 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:18.617106 (+ 7321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:18.617486 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:18.617587 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:18.620544 (+ 2957us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:10:18.620546 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:10:18.620546 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:10:18.620556 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:10:18.622502 (+ 1946us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:10:18.623135 (+ 633us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:10:18.623136 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:10:18.623137 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:10:18.623206 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:10:18.623570 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:10:18.623571 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:10:18.623571 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:10:18.623728 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:10:18.623805 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 05:10:18.624216 (+ 411us) server_negotiation.cc:299] Negotiation successful
0811 05:10:18.624328 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 05:10:18.624936 15046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:18.606659 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:39719 (local address 127.26.191.194:35127)
0811 05:10:18.606848 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:18.606917 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0811 05:10:18.607654 (+ 737us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:10:18.608153 (+ 499us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:10:18.608158 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:10:18.608463 (+ 305us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:10:18.608821 (+ 358us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:10:18.608829 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:10:18.609925 (+ 1096us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:10:18.609925 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:10:18.615606 (+ 5681us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:10:18.615611 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:10:18.617631 (+ 2020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:10:18.617632 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:10:18.617813 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:18.618465 (+ 652us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:10:18.618477 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:10:18.620394 (+ 1917us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:10:18.622608 (+ 2214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:10:18.622617 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:10:18.622622 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:10:18.623033 (+ 411us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:10:18.623303 (+ 270us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:10:18.623304 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:10:18.623305 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:10:18.623480 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:10:18.623814 (+ 334us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:10:18.623821 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:10:18.624036 (+ 215us) client_negotiation.cc:769] Sending connection context
0811 05:10:18.624181 (+ 145us) client_negotiation.cc:240] Negotiation successful
0811 05:10:18.624463 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":88,"threads_started":1}
I20260811 05:10:18.625643 15044 heartbeater.cc:347] Connected to a master server at 127.26.191.254:39719
I20260811 05:10:18.625765 15044 heartbeater.cc:464] Registering TS with master...
I20260811 05:10:18.625998 15044 heartbeater.cc:511] Master 127.26.191.254:39719 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.26.191.195@KRBTEST.COM; defaulting to no policy
I20260811 05:10:18.626458 14497 ts_manager.cc:194] Registered new tserver with Master: 56acbe8a6ae44e8a93eec447cfb8eb66 (127.26.191.194:45367)
I20260811 05:10:18.626992 14497 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.191.194@KRBTEST.COM'} at 127.26.191.194:35127
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.191.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.191.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.195.keytab.
Entry for principal kudu/127.26.191.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.195.keytab.
I20260811 05:10:18.652637 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.191.212:41673/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.191.195:0
--local_ip_for_outbound_sockets=127.26.191.195
--webserver_interface=127.26.191.195
--webserver_port=0
--tserver_master_addrs=127.26.191.254:39719
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.195.keytab
--principal=kudu/127.26.191.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:41685
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:10:18.779505 15050 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:10:18.779803 15050 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:10:18.779855 15050 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:10:18.781857 15050 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:10:18.781932 15050 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:10:18.781980 15050 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.191.195
I20260811 05:10:18.784518 15050 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:41685
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.26.191.212:41673/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.195.keytab
--principal=kudu/127.26.191.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.191.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.191.195
--webserver_port=0
--tserver_master_addrs=127.26.191.254:39719
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15050
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.191.195
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:10:18.784858 15050 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:10:18.785202 15050 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:10:18.792053 15067 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:10:18.792254 15063 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:10:18.792174 15065 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:10:18.793164 15050 server_base.cc:1034] running on GCE node
I20260811 05:10:18.793522 15050 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:10:18.793849 15050 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:10:18.795042 15050 hybrid_clock.cc:648] HybridClock initialized: now 1786425018795008 us; error 42 us; skew 500 ppm
Aug 11 05:10:18 dist-test-slave-x5fp krb5kdc[13718](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425018, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:10:18.798864 15050 init.cc:377] Logged in from keytab as kudu/127.26.191.195@KRBTEST.COM (short username kudu)
I20260811 05:10:18.799444 15050 webserver.cc:460] Webserver started at http://127.26.191.195:41253/ using document root <none> and password file <none>
I20260811 05:10:18.799752 15050 fs_manager.cc:359] Metadata directory not provided
I20260811 05:10:18.799829 15050 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:10:18.800021 15050 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 05:10:18 dist-test-slave-x5fp krb5kdc[13718](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425018, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.195@KRBTEST.COM for HTTP/127.26.191.212@KRBTEST.COM
I20260811 05:10:18.822536 15050 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ts-2/data/instance:
uuid: "fe63cc770503483abd0534e475194ce3"
format_stamp: "Formatted at 2026-08-11 05:10:18 on dist-test-slave-x5fp"
server_key: "608ee6c99ec1759fadc8611182888446"
server_key_iv: "77ce28aa2846a40b170c1d942b897a1d"
server_key_version: "kuduclusterkey@0"
I20260811 05:10:18.823064 15050 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ts-2/wal/instance:
uuid: "fe63cc770503483abd0534e475194ce3"
format_stamp: "Formatted at 2026-08-11 05:10:18 on dist-test-slave-x5fp"
server_key: "608ee6c99ec1759fadc8611182888446"
server_key_iv: "77ce28aa2846a40b170c1d942b897a1d"
server_key_version: "kuduclusterkey@0"
I20260811 05:10:18.832074 15050 fs_manager.cc:691] Time spent creating directory manager: real 0.009s user 0.004s sys 0.000s
I20260811 05:10:18.851078 15081 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:10:18.851281 15050 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 05:10:18.851400 15050 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ts-2/wal
uuid: "fe63cc770503483abd0534e475194ce3"
format_stamp: "Formatted at 2026-08-11 05:10:18 on dist-test-slave-x5fp"
server_key: "608ee6c99ec1759fadc8611182888446"
server_key_iv: "77ce28aa2846a40b170c1d942b897a1d"
server_key_version: "kuduclusterkey@0"
I20260811 05:10:18.851521 15050 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:10:18.861528 15050 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:10:18.864042 15050 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:10:18.864262 15050 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:10:18.864578 15050 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:10:18.865051 15050 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:10:18.865149 15050 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:10:18.865231 15050 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:10:18.865298 15050 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:10:18.872191 15050 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.195:43913
I20260811 05:10:18.872504 15266 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.195:43913 every 8 connection(s)
I20260811 05:10:18.872905 15050 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ts-2/data/info.pb
I20260811 05:10:18.882519 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 15050
I20260811 05:10:18.882642 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ts-2/wal/instance
I20260811 05:10:18.882839 27391 external_mini_cluster.cc:1428] Setting key 4aa4cce3b4eb5fb587e24b3ba8a2ae6c
Aug 11 05:10:18 dist-test-slave-x5fp krb5kdc[13718](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425018, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.195@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
I20260811 05:10:18.892537 14834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:18.881266 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.195:60737 (local address 127.26.191.254:39719)
0811 05:10:18.881317 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 05:10:18.881319 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:10:18.881524 (+ 205us) server_negotiation.cc:407] Connection header received
0811 05:10:18.882275 (+ 751us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:10:18.882277 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:10:18.882291 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:10:18.882323 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:10:18.883268 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:18.884073 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:18.885686 (+ 1613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:18.885972 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:18.886020 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:18.888922 (+ 2902us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:10:18.888924 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:10:18.888924 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:10:18.888933 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:10:18.890744 (+ 1811us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:10:18.891291 (+ 547us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:10:18.891293 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:10:18.891293 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:10:18.891356 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:10:18.891660 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:10:18.891661 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:10:18.891661 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:10:18.891808 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:10:18.891869 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 05:10:18.892326 (+ 457us) server_negotiation.cc:299] Negotiation successful
0811 05:10:18.892436 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 05:10:18.893431 15271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:18.881013 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:39719 (local address 127.26.191.195:60737)
0811 05:10:18.881391 (+ 378us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:18.881439 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 05:10:18.882142 (+ 703us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:10:18.882529 (+ 387us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:10:18.882534 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:10:18.882817 (+ 283us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:10:18.883144 (+ 327us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:10:18.883151 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:10:18.884199 (+ 1048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:10:18.884200 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:10:18.885575 (+ 1375us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:10:18.885578 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:10:18.886146 (+ 568us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:10:18.886148 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:10:18.886308 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:18.886986 (+ 678us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:10:18.886996 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:10:18.888789 (+ 1793us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:10:18.890858 (+ 2069us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:10:18.890866 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:10:18.890869 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:10:18.891196 (+ 327us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:10:18.891433 (+ 237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:10:18.891433 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:10:18.891434 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:10:18.891577 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:10:18.891925 (+ 348us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:10:18.891968 (+ 43us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:10:18.892154 (+ 186us) client_negotiation.cc:769] Sending connection context
0811 05:10:18.892982 (+ 828us) client_negotiation.cc:240] Negotiation successful
0811 05:10:18.893173 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":336,"thread_start_us":84,"threads_started":1}
I20260811 05:10:18.894253 15268 heartbeater.cc:347] Connected to a master server at 127.26.191.254:39719
I20260811 05:10:18.894376 15268 heartbeater.cc:464] Registering TS with master...
I20260811 05:10:18.894604 15268 heartbeater.cc:511] Master 127.26.191.254:39719 requested a full tablet report, sending...
I20260811 05:10:18.895037 14497 ts_manager.cc:194] Registered new tserver with Master: fe63cc770503483abd0534e475194ce3 (127.26.191.195:43913)
I20260811 05:10:18.895558 14497 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.191.195@KRBTEST.COM'} at 127.26.191.195:60737
I20260811 05:10:18.905726 27391 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 05:10:18.906473 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 14620
I20260811 05:10:18.945127 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 14840
I20260811 05:10:18.974558 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 15050
I20260811 05:10:18.984637 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 14439
I20260811 05:10:19.001335 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.254:39719
--webserver_interface=127.26.191.254
--webserver_port=41531
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab
--principal=kudu/127.26.191.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:41685
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.191.254:39719
--ranger_config_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.191.212:41673/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.26.191.212:41673/kms with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:10:19.088923 15272 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:10:19.089154 15272 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:10:19.089178 15272 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:10:19.090401 15272 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:10:19.090453 15272 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:10:19.090468 15272 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:10:19.090481 15272 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:10:19.090493 15272 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:10:19.092229 15272 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:41685
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.26.191.212:41673/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.26.191.254:39719
--ranger_config_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab
--principal=kudu/127.26.191.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.254:39719
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.191.254
--webserver_port=41531
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15272
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:10:19.092526 15272 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:10:19.092815 15272 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:10:19.098748 15285 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:10:19.098734 15282 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:10:19.098728 15281 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:10:19.098776 15272 server_base.cc:1034] running on GCE node
I20260811 05:10:19.099349 15272 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:10:19.099691 15272 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:10:19.100879 15272 hybrid_clock.cc:648] HybridClock initialized: now 1786425019100862 us; error 30 us; skew 500 ppm
Aug 11 05:10:19 dist-test-slave-x5fp krb5kdc[13718](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425019, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:10:19.103787 15272 init.cc:377] Logged in from keytab as kudu/127.26.191.254@KRBTEST.COM (short username kudu)
I20260811 05:10:19.104338 15272 webserver.cc:460] Webserver started at http://127.26.191.254:41531/ using document root <none> and password file <none>
I20260811 05:10:19.104604 15272 fs_manager.cc:359] Metadata directory not provided
I20260811 05:10:19.104683 15272 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 05:10:19 dist-test-slave-x5fp krb5kdc[13718](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425019, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.254@KRBTEST.COM for HTTP/127.26.191.212@KRBTEST.COM
I20260811 05:10:19.187507 15272 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:10:19.188469 15298 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:10:19.188899 15272 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:10:19.189034 15272 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/master-0/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/master-0/wal
uuid: "b122260a99014bdf8d1960c3ee461f1c"
format_stamp: "Formatted at 2026-08-11 05:10:17 on dist-test-slave-x5fp"
server_key: "7416a56cbe4e266d0ec6e0cec126efac"
server_key_iv: "e4ecd915b1034f7482ab26bc79d599ef"
server_key_version: "kuduclusterkey@0"
I20260811 05:10:19.189446 15272 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:10:19.206840 15272 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:10:19.209235 15272 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:10:19.209365 15272 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:10:19.214262 15272 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.254:39719
I20260811 05:10:19.214310 15383 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.254:39719 every 8 connection(s)
I20260811 05:10:19.214728 15272 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
I20260811 05:10:19.216053 15384 sys_catalog.cc:263] Verifying existing consensus state
I20260811 05:10:19.216797 15384 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b122260a99014bdf8d1960c3ee461f1c: Bootstrap starting.
I20260811 05:10:19.218983 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 15272
I20260811 05:10:19.219349 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.191.212:41673/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.191.193:35677
--local_ip_for_outbound_sockets=127.26.191.193
--tserver_master_addrs=127.26.191.254:39719
--webserver_port=42553
--webserver_interface=127.26.191.193
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.193.keytab
--principal=kudu/127.26.191.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:41685
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.26.191.212:41673/kms with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 05:10:19.225451 15384 log.cc:824] T 00000000000000000000000000000000 P b122260a99014bdf8d1960c3ee461f1c: Log is configured to *not* fsync() on all Append() calls
I20260811 05:10:19.227212 15384 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b122260a99014bdf8d1960c3ee461f1c: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 05:10:19.227528 15384 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b122260a99014bdf8d1960c3ee461f1c: Bootstrap complete.
I20260811 05:10:19.230049 15384 raft_consensus.cc:348] T 00000000000000000000000000000000 P b122260a99014bdf8d1960c3ee461f1c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b122260a99014bdf8d1960c3ee461f1c" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 39719 } }
I20260811 05:10:19.230283 15384 raft_consensus.cc:729] T 00000000000000000000000000000000 P b122260a99014bdf8d1960c3ee461f1c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b122260a99014bdf8d1960c3ee461f1c, State: Initialized, Role: FOLLOWER
I20260811 05:10:19.230448 15384 consensus_queue.cc:260] T 00000000000000000000000000000000 P b122260a99014bdf8d1960c3ee461f1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b122260a99014bdf8d1960c3ee461f1c" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 39719 } }
I20260811 05:10:19.230522 15384 raft_consensus.cc:388] T 00000000000000000000000000000000 P b122260a99014bdf8d1960c3ee461f1c [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:10:19.230572 15384 raft_consensus.cc:482] T 00000000000000000000000000000000 P b122260a99014bdf8d1960c3ee461f1c [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:10:19.230624 15384 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b122260a99014bdf8d1960c3ee461f1c [term 1 FOLLOWER]: Advancing to term 2
I20260811 05:10:19.231616 15384 raft_consensus.cc:504] T 00000000000000000000000000000000 P b122260a99014bdf8d1960c3ee461f1c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b122260a99014bdf8d1960c3ee461f1c" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 39719 } }
I20260811 05:10:19.231709 15384 leader_election.cc:302] T 00000000000000000000000000000000 P b122260a99014bdf8d1960c3ee461f1c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b122260a99014bdf8d1960c3ee461f1c; no voters:
I20260811 05:10:19.231933 15384 leader_election.cc:288] T 00000000000000000000000000000000 P b122260a99014bdf8d1960c3ee461f1c [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 05:10:19.231968 15391 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b122260a99014bdf8d1960c3ee461f1c [term 2 FOLLOWER]: Leader election won for term 2
I20260811 05:10:19.232081 15391 raft_consensus.cc:686] T 00000000000000000000000000000000 P b122260a99014bdf8d1960c3ee461f1c [term 2 LEADER]: Becoming Leader. State: Replica: b122260a99014bdf8d1960c3ee461f1c, State: Running, Role: LEADER
I20260811 05:10:19.232177 15391 consensus_queue.cc:237] T 00000000000000000000000000000000 P b122260a99014bdf8d1960c3ee461f1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b122260a99014bdf8d1960c3ee461f1c" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 39719 } }
I20260811 05:10:19.232206 15384 sys_catalog.cc:564] T 00000000000000000000000000000000 P b122260a99014bdf8d1960c3ee461f1c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:10:19.232496 15392 sys_catalog.cc:455] T 00000000000000000000000000000000 P b122260a99014bdf8d1960c3ee461f1c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "b122260a99014bdf8d1960c3ee461f1c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b122260a99014bdf8d1960c3ee461f1c" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 39719 } } }
I20260811 05:10:19.232662 15392 sys_catalog.cc:458] T 00000000000000000000000000000000 P b122260a99014bdf8d1960c3ee461f1c [sys.catalog]: This master's current role is: LEADER
I20260811 05:10:19.233060 15399 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:10:19.233096 15393 sys_catalog.cc:455] T 00000000000000000000000000000000 P b122260a99014bdf8d1960c3ee461f1c [sys.catalog]: SysCatalogTable state changed. Reason: New leader b122260a99014bdf8d1960c3ee461f1c. Latest consensus state: current_term: 2 leader_uuid: "b122260a99014bdf8d1960c3ee461f1c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b122260a99014bdf8d1960c3ee461f1c" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 39719 } } }
I20260811 05:10:19.233180 15393 sys_catalog.cc:458] T 00000000000000000000000000000000 P b122260a99014bdf8d1960c3ee461f1c [sys.catalog]: This master's current role is: LEADER
I20260811 05:10:19.233703 15399 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:10:19.233894 15399 catalog_manager.cc:1259] Loaded cluster ID: b38128ad6b6d46ed9d3751da574c2105
I20260811 05:10:19.233975 15399 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:10:19.234050 15384 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260811 05:10:19.238209 15399 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:10:19.238801 15399 catalog_manager.cc:5879] T 00000000000000000000000000000000 P b122260a99014bdf8d1960c3ee461f1c: Loaded TSK: 0
I20260811 05:10:19.239102 15399 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 05:10:19.314260 15389 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:10:19.314556 15389 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:10:19.314599 15389 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:10:19.316398 15389 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:10:19.316502 15389 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:10:19.316552 15389 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.191.193
I20260811 05:10:19.318217 15389 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:41685
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.26.191.212:41673/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.193.keytab
--principal=kudu/127.26.191.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.191.193:35677
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.191.193
--webserver_port=42553
--tserver_master_addrs=127.26.191.254:39719
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15389
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.191.193
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:10:19.318498 15389 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:10:19.318742 15389 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:10:19.324783 15440 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:10:19.324856 15438 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:10:19.325106 15389 server_base.cc:1034] running on GCE node
W20260811 05:10:19.324855 15437 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:10:19.328425 15389 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:10:19.328804 15389 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:10:19.329982 15389 hybrid_clock.cc:648] HybridClock initialized: now 1786425019329962 us; error 51 us; skew 500 ppm
Aug 11 05:10:19 dist-test-slave-x5fp krb5kdc[13718](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425019, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:10:19.333143 15389 init.cc:377] Logged in from keytab as kudu/127.26.191.193@KRBTEST.COM (short username kudu)
I20260811 05:10:19.333811 15389 webserver.cc:460] Webserver started at http://127.26.191.193:42553/ using document root <none> and password file <none>
I20260811 05:10:19.334071 15389 fs_manager.cc:359] Metadata directory not provided
I20260811 05:10:19.334167 15389 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 05:10:19 dist-test-slave-x5fp krb5kdc[13718](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425019, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.193@KRBTEST.COM for HTTP/127.26.191.212@KRBTEST.COM
I20260811 05:10:19.361506 15389 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.001s sys 0.000s
I20260811 05:10:19.362691 15453 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:10:19.362905 15389 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:10:19.363040 15389 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ts-0/wal
uuid: "ee86d999fab24b709d485d283cee4db8"
format_stamp: "Formatted at 2026-08-11 05:10:18 on dist-test-slave-x5fp"
server_key: "e886b3d5e2838f3713b40b07a69d1746"
server_key_iv: "bc643827c8860c66a61b6736837b2c13"
server_key_version: "kuduclusterkey@0"
I20260811 05:10:19.363471 15389 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:10:19.395871 15389 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:10:19.398515 15389 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:10:19.398702 15389 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:10:19.398967 15389 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:10:19.399386 15389 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:10:19.399438 15389 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:10:19.399479 15389 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:10:19.399498 15389 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:10:19.411527 15389 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.193:35677
I20260811 05:10:19.411712 15630 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.193:35677 every 8 connection(s)
I20260811 05:10:19.412268 15389 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ts-0/data/info.pb
I20260811 05:10:19.419154 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 15389
I20260811 05:10:19.419503 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.191.212:41673/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.191.194:45367
--local_ip_for_outbound_sockets=127.26.191.194
--tserver_master_addrs=127.26.191.254:39719
--webserver_port=46489
--webserver_interface=127.26.191.194
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.194.keytab
--principal=kudu/127.26.191.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:41685
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.26.191.212:41673/kms with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 05:10:19 dist-test-slave-x5fp krb5kdc[13718](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425019, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.193@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
I20260811 05:10:19.434128 15633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:19.413229 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:39719 (local address 127.26.191.193:40725)
0811 05:10:19.416888 (+ 3659us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:19.416950 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0811 05:10:19.417723 (+ 773us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:10:19.418339 (+ 616us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:10:19.418343 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:10:19.418610 (+ 267us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:10:19.418926 (+ 316us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:10:19.418933 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:10:19.420662 (+ 1729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:10:19.420663 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:10:19.421926 (+ 1263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:10:19.421929 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:10:19.422862 (+ 933us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:10:19.422863 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:10:19.422989 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:19.423858 (+ 869us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:10:19.423870 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:10:19.429085 (+ 5215us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:10:19.431651 (+ 2566us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:10:19.431663 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:10:19.431666 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:10:19.432063 (+ 397us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:10:19.432466 (+ 403us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:10:19.432467 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:10:19.432467 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:10:19.432639 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:10:19.433300 (+ 661us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:10:19.433308 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:10:19.433486 (+ 178us) client_negotiation.cc:769] Sending connection context
0811 05:10:19.433595 (+ 109us) client_negotiation.cc:240] Negotiation successful
0811 05:10:19.433805 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3594,"thread_start_us":93,"threads_started":1}
I20260811 05:10:19.435130 15635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:19.413646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.193:40725 (local address 127.26.191.254:39719)
0811 05:10:19.413881 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0811 05:10:19.413891 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 05:10:19.417204 (+ 3313us) server_negotiation.cc:407] Connection header received
0811 05:10:19.418022 (+ 818us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:10:19.418031 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:10:19.418098 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:10:19.418258 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:10:19.419078 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:19.420531 (+ 1453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:19.422027 (+ 1496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:19.422636 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:19.422743 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:19.429288 (+ 6545us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:10:19.429294 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:10:19.429295 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:10:19.429311 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:10:19.431523 (+ 2212us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:10:19.432218 (+ 695us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:10:19.432222 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:10:19.432223 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:10:19.432357 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:10:19.432797 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:10:19.432798 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:10:19.432799 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:10:19.433169 (+ 370us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:10:19.434644 (+ 1475us) server_negotiation.cc:1035] Waiting for connection context
0811 05:10:19.434750 (+ 106us) server_negotiation.cc:299] Negotiation successful
0811 05:10:19.434905 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":174,"thread_start_us":108,"threads_started":1}
I20260811 05:10:19.436172 15631 heartbeater.cc:347] Connected to a master server at 127.26.191.254:39719
I20260811 05:10:19.436293 15631 heartbeater.cc:464] Registering TS with master...
I20260811 05:10:19.436534 15631 heartbeater.cc:511] Master 127.26.191.254:39719 requested a full tablet report, sending...
W20260811 05:10:19.437620 15631 heartbeater.cc:644] Failed to heartbeat to 127.26.191.254:39719 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 05:10:19.437700 15631 heartbeater.cc:464] Registering TS with master...
I20260811 05:10:19.437774 15631 heartbeater.cc:511] Master 127.26.191.254:39719 requested a full tablet report, sending...
I20260811 05:10:19.438141 15631 heartbeater.cc:464] Registering TS with master...
I20260811 05:10:19.438212 15631 heartbeater.cc:511] Master 127.26.191.254:39719 requested a full tablet report, sending...
W20260811 05:10:19.438505 15631 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 05:10:19.535171 15638 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:10:19.535468 15638 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:10:19.535504 15638 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:10:19.537205 15638 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:10:19.537276 15638 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:10:19.537315 15638 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.191.194
I20260811 05:10:19.539526 15638 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:41685
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.26.191.212:41673/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.194.keytab
--principal=kudu/127.26.191.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.191.194:45367
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.191.194
--webserver_port=46489
--tserver_master_addrs=127.26.191.254:39719
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15638
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.191.194
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:10:19.539791 15638 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:10:19.540043 15638 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:10:19.546541 15644 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:10:19.546583 15651 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:10:19.546550 15645 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:10:19.547188 15638 server_base.cc:1034] running on GCE node
I20260811 05:10:19.547454 15638 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:10:19.547753 15638 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:10:19.548940 15638 hybrid_clock.cc:648] HybridClock initialized: now 1786425019548924 us; error 38 us; skew 500 ppm
Aug 11 05:10:19 dist-test-slave-x5fp krb5kdc[13718](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425019, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:10:19.552031 15638 init.cc:377] Logged in from keytab as kudu/127.26.191.194@KRBTEST.COM (short username kudu)
I20260811 05:10:19.552582 15638 webserver.cc:460] Webserver started at http://127.26.191.194:46489/ using document root <none> and password file <none>
I20260811 05:10:19.552882 15638 fs_manager.cc:359] Metadata directory not provided
I20260811 05:10:19.552951 15638 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 05:10:19 dist-test-slave-x5fp krb5kdc[13718](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425019, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.194@KRBTEST.COM for HTTP/127.26.191.212@KRBTEST.COM
I20260811 05:10:19.569235 15638 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.001s sys 0.000s
I20260811 05:10:19.570441 15661 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:10:19.570751 15638 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:10:19.570873 15638 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ts-1/wal
uuid: "56acbe8a6ae44e8a93eec447cfb8eb66"
format_stamp: "Formatted at 2026-08-11 05:10:18 on dist-test-slave-x5fp"
server_key: "8653b1dd6c23abc25c63bb84b0a21715"
server_key_iv: "b607285979ca99b01223aa3eee479000"
server_key_version: "kuduclusterkey@0"
I20260811 05:10:19.571374 15638 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:10:19.596643 15638 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:10:19.599316 15638 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:10:19.599495 15638 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:10:19.599783 15638 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:10:19.600165 15638 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:10:19.600214 15638 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:10:19.600246 15638 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:10:19.600271 15638 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:10:19.607996 15638 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.194:45367
I20260811 05:10:19.608057 15828 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.194:45367 every 8 connection(s)
I20260811 05:10:19.608423 15638 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ts-1/data/info.pb
I20260811 05:10:19.609207 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 15638
I20260811 05:10:19.609529 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.191.212:41673/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.191.195:43913
--local_ip_for_outbound_sockets=127.26.191.195
--tserver_master_addrs=127.26.191.254:39719
--webserver_port=41253
--webserver_interface=127.26.191.195
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.195.keytab
--principal=kudu/127.26.191.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:41685
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.26.191.212:41673/kms with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 05:10:19 dist-test-slave-x5fp krb5kdc[13718](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425019, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.194@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
I20260811 05:10:19.619189 15635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:19.609212 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.194:53355 (local address 127.26.191.254:39719)
0811 05:10:19.609263 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 05:10:19.609266 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:10:19.609527 (+ 261us) server_negotiation.cc:407] Connection header received
0811 05:10:19.610060 (+ 533us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:10:19.610062 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:10:19.610080 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:10:19.610130 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:10:19.610693 (+ 563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:19.611203 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:19.612322 (+ 1119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:19.612586 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:19.612671 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:19.615409 (+ 2738us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:10:19.615411 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:10:19.615411 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:10:19.615420 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:10:19.617359 (+ 1939us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:10:19.617948 (+ 589us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:10:19.617950 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:10:19.617950 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:10:19.618021 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:10:19.618343 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:10:19.618345 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:10:19.618345 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:10:19.618497 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:10:19.618542 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0811 05:10:19.618974 (+ 432us) server_negotiation.cc:299] Negotiation successful
0811 05:10:19.619081 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 05:10:19.620198 15834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:19.609218 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:39719 (local address 127.26.191.194:53355)
0811 05:10:19.609379 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:19.609422 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 05:10:19.609944 (+ 522us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:10:19.610206 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:10:19.610209 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:10:19.610388 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:10:19.610587 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:10:19.610592 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:10:19.611307 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:10:19.611309 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:10:19.612225 (+ 916us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:10:19.612227 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:10:19.612698 (+ 471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:10:19.612699 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:10:19.612915 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:19.613693 (+ 778us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:10:19.613702 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:10:19.615283 (+ 1581us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:10:19.617453 (+ 2170us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:10:19.617460 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:10:19.617479 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:10:19.617847 (+ 368us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:10:19.618097 (+ 250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:10:19.618098 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:10:19.618099 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:10:19.618257 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:10:19.618593 (+ 336us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:10:19.618600 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:10:19.618796 (+ 196us) client_negotiation.cc:769] Sending connection context
0811 05:10:19.619758 (+ 962us) client_negotiation.cc:240] Negotiation successful
0811 05:10:19.619946 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":82,"threads_started":1}
I20260811 05:10:19.621076 15829 heartbeater.cc:347] Connected to a master server at 127.26.191.254:39719
I20260811 05:10:19.621204 15829 heartbeater.cc:464] Registering TS with master...
I20260811 05:10:19.621407 15829 heartbeater.cc:511] Master 127.26.191.254:39719 requested a full tablet report, sending...
W20260811 05:10:19.622107 15829 heartbeater.cc:644] Failed to heartbeat to 127.26.191.254:39719 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 05:10:19.622195 15829 heartbeater.cc:464] Registering TS with master...
I20260811 05:10:19.622283 15829 heartbeater.cc:511] Master 127.26.191.254:39719 requested a full tablet report, sending...
I20260811 05:10:19.622596 15829 heartbeater.cc:464] Registering TS with master...
I20260811 05:10:19.622681 15829 heartbeater.cc:511] Master 127.26.191.254:39719 requested a full tablet report, sending...
W20260811 05:10:19.622961 15829 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 05:10:19.742214 15835 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:10:19.742537 15835 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:10:19.742583 15835 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:10:19.744438 15835 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:10:19.744505 15835 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:10:19.744549 15835 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.191.195
I20260811 05:10:19.746937 15835 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:41685
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.26.191.212:41673/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.195.keytab
--principal=kudu/127.26.191.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.191.195:43913
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.191.195
--webserver_port=41253
--tserver_master_addrs=127.26.191.254:39719
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15835
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.191.195
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:10:19.747216 15835 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:10:19.747509 15835 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:10:19.756971 15847 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:10:19.756971 15841 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:10:19.757002 15845 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:10:19.757530 15835 server_base.cc:1034] running on GCE node
I20260811 05:10:19.757787 15835 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:10:19.758122 15835 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:10:19.759330 15835 hybrid_clock.cc:648] HybridClock initialized: now 1786425019759312 us; error 29 us; skew 500 ppm
Aug 11 05:10:19 dist-test-slave-x5fp krb5kdc[13718](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425019, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:10:19.762851 15835 init.cc:377] Logged in from keytab as kudu/127.26.191.195@KRBTEST.COM (short username kudu)
I20260811 05:10:19.763486 15835 webserver.cc:460] Webserver started at http://127.26.191.195:41253/ using document root <none> and password file <none>
I20260811 05:10:19.763799 15835 fs_manager.cc:359] Metadata directory not provided
I20260811 05:10:19.763901 15835 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 05:10:19 dist-test-slave-x5fp krb5kdc[13718](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425019, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.195@KRBTEST.COM for HTTP/127.26.191.212@KRBTEST.COM
I20260811 05:10:19.778595 15835 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:10:19.779605 15861 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:10:19.779879 15835 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:10:19.779990 15835 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ts-2/wal
uuid: "fe63cc770503483abd0534e475194ce3"
format_stamp: "Formatted at 2026-08-11 05:10:18 on dist-test-slave-x5fp"
server_key: "608ee6c99ec1759fadc8611182888446"
server_key_iv: "77ce28aa2846a40b170c1d942b897a1d"
server_key_version: "kuduclusterkey@0"
I20260811 05:10:19.780515 15835 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:10:19.809273 15835 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:10:19.811851 15835 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:10:19.812036 15835 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:10:19.812355 15835 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:10:19.812876 15835 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:10:19.812935 15835 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:10:19.812969 15835 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:10:19.812997 15835 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:10:19.820425 15835 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.195:43913
I20260811 05:10:19.820616 16039 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.195:43913 every 8 connection(s)
I20260811 05:10:19.820909 15835 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ts-2/data/info.pb
Aug 11 05:10:19 dist-test-slave-x5fp krb5kdc[13718](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425019, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.195@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
I20260811 05:10:19.829353 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 15835
I20260811 05:10:19.832325 15635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:19.821845 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.195:44101 (local address 127.26.191.254:39719)
0811 05:10:19.821921 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0811 05:10:19.821924 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:10:19.822194 (+ 270us) server_negotiation.cc:407] Connection header received
0811 05:10:19.822899 (+ 705us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:10:19.822900 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:10:19.822913 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:10:19.822972 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:10:19.823805 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:19.824583 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:19.825790 (+ 1207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:19.826071 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:19.826166 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:19.828771 (+ 2605us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:10:19.828773 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:10:19.828774 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:10:19.828782 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:10:19.830635 (+ 1853us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:10:19.831151 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:10:19.831153 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:10:19.831153 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:10:19.831224 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:10:19.831522 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:10:19.831523 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:10:19.831524 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:10:19.831672 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:10:19.831716 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0811 05:10:19.832126 (+ 410us) server_negotiation.cc:299] Negotiation successful
0811 05:10:19.832217 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 05:10:19.832895 16046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:19.821848 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:39719 (local address 127.26.191.195:44101)
0811 05:10:19.822051 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:19.822097 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 05:10:19.822751 (+ 654us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:10:19.823109 (+ 358us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:10:19.823114 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:10:19.823380 (+ 266us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:10:19.823710 (+ 330us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:10:19.823716 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:10:19.824689 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:10:19.824690 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:10:19.825662 (+ 972us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:10:19.825665 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:10:19.826193 (+ 528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:10:19.826194 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:10:19.826304 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:19.826936 (+ 632us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:10:19.826947 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:10:19.828631 (+ 1684us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:10:19.830731 (+ 2100us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:10:19.830738 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:10:19.830741 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:10:19.831060 (+ 319us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:10:19.831293 (+ 233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:10:19.831294 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:10:19.831295 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:10:19.831439 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:10:19.831765 (+ 326us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:10:19.831771 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:10:19.831942 (+ 171us) client_negotiation.cc:769] Sending connection context
0811 05:10:19.832443 (+ 501us) client_negotiation.cc:240] Negotiation successful
0811 05:10:19.832624 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":108,"threads_started":1}
I20260811 05:10:19.833693 16042 heartbeater.cc:347] Connected to a master server at 127.26.191.254:39719
I20260811 05:10:19.833803 16042 heartbeater.cc:464] Registering TS with master...
I20260811 05:10:19.833997 16042 heartbeater.cc:511] Master 127.26.191.254:39719 requested a full tablet report, sending...
W20260811 05:10:19.834669 16042 heartbeater.cc:644] Failed to heartbeat to 127.26.191.254:39719 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 05:10:19.834762 16042 heartbeater.cc:464] Registering TS with master...
I20260811 05:10:19.834844 16042 heartbeater.cc:511] Master 127.26.191.254:39719 requested a full tablet report, sending...
I20260811 05:10:19.835156 16042 heartbeater.cc:464] Registering TS with master...
I20260811 05:10:19.835230 16042 heartbeater.cc:511] Master 127.26.191.254:39719 requested a full tablet report, sending...
W20260811 05:10:19.836747 16042 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 05:10:19.846939 16048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:19.830052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37240 (local address 127.26.191.254:39719)
0811 05:10:19.830195 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0811 05:10:19.830197 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:10:19.831152 (+ 955us) server_negotiation.cc:407] Connection header received
0811 05:10:19.831180 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:10:19.831181 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:10:19.831195 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:10:19.831258 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:10:19.833057 (+ 1799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:19.833783 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:19.841774 (+ 7991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:19.841994 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:19.842060 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:19.843672 (+ 1612us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:10:19.843674 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:10:19.843674 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:10:19.843682 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:10:19.845493 (+ 1811us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:10:19.845972 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:10:19.845974 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:10:19.845974 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:10:19.846040 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:10:19.846295 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:10:19.846296 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:10:19.846296 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:10:19.846414 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:10:19.846565 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0811 05:10:19.846743 (+ 178us) server_negotiation.cc:299] Negotiation successful
0811 05:10:19.846834 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121,"thread_start_us":98,"threads_started":1}
Aug 11 05:10:20 dist-test-slave-x5fp krb5kdc[13718](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786425020, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:10:20.438720 15631 heartbeater.cc:464] Registering TS with master...
I20260811 05:10:20.438884 15631 heartbeater.cc:511] Master 127.26.191.254:39719 requested a full tablet report, sending...
I20260811 05:10:20.439311 15329 ts_manager.cc:194] Registered new tserver with Master: ee86d999fab24b709d485d283cee4db8 (127.26.191.193:35677)
I20260811 05:10:20.440426 15329 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.191.193@KRBTEST.COM'} at 127.26.191.193:40725
I20260811 05:10:20.623164 15829 heartbeater.cc:464] Registering TS with master...
I20260811 05:10:20.623340 15829 heartbeater.cc:511] Master 127.26.191.254:39719 requested a full tablet report, sending...
I20260811 05:10:20.623617 15329 ts_manager.cc:194] Registered new tserver with Master: 56acbe8a6ae44e8a93eec447cfb8eb66 (127.26.191.194:45367)
I20260811 05:10:20.624166 15329 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.191.194@KRBTEST.COM'} at 127.26.191.194:53355
Aug 11 05:10:20 dist-test-slave-x5fp krb5kdc[13718](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425020, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.254@KRBTEST.COM for HTTP/127.26.191.212@KRBTEST.COM
I20260811 05:10:20.836934 16042 heartbeater.cc:464] Registering TS with master...
I20260811 05:10:20.837096 16042 heartbeater.cc:511] Master 127.26.191.254:39719 requested a full tablet report, sending...
I20260811 05:10:20.837482 15329 ts_manager.cc:194] Registered new tserver with Master: fe63cc770503483abd0534e475194ce3 (127.26.191.195:43913)
I20260811 05:10:20.838027 15329 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.191.195@KRBTEST.COM'} at 127.26.191.195:44101
I20260811 05:10:20.844406 27391 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 05:10:20.864595 16078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:20.851861 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38656 (local address 127.26.191.254:39719)
0811 05:10:20.852634 (+ 773us) server_negotiation.cc:206] Beginning negotiation
0811 05:10:20.852637 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:10:20.854334 (+ 1697us) server_negotiation.cc:407] Connection header received
0811 05:10:20.854378 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:10:20.854379 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:10:20.854396 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:10:20.854977 (+ 581us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:10:20.856876 (+ 1899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:20.858092 (+ 1216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:20.859339 (+ 1247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:20.859635 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:20.859699 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:20.861320 (+ 1621us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:10:20.861321 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:10:20.861321 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:10:20.861329 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:10:20.863122 (+ 1793us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:10:20.863525 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:10:20.863527 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:10:20.863527 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:10:20.863591 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:10:20.863774 (+ 183us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:10:20.863775 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:10:20.863775 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:10:20.863910 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:10:20.864006 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0811 05:10:20.864383 (+ 377us) server_negotiation.cc:299] Negotiation successful
0811 05:10:20.864484 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":744,"thread_start_us":83,"threads_started":1}
I20260811 05:10:20.867072 15329 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38656:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 05:10:20.869380 15329 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 05:10:20.882193 16093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:20.872940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35264 (local address 127.26.191.194:45367)
0811 05:10:20.873141 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0811 05:10:20.873146 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:10:20.876977 (+ 3831us) server_negotiation.cc:407] Connection header received
0811 05:10:20.877154 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:10:20.877158 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:10:20.877178 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:10:20.877269 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:10:20.877597 (+ 328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:20.878644 (+ 1047us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:20.880852 (+ 2208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:20.881610 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:20.881664 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:20.881725 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 05:10:20.882043 (+ 318us) server_negotiation.cc:299] Negotiation successful
0811 05:10:20.882093 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":170,"thread_start_us":64,"threads_started":1}
I20260811 05:10:20.882505 16087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:20.872631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.194:45367 (local address 127.0.0.1:35264)
0811 05:10:20.876845 (+ 4214us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:20.876904 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0811 05:10:20.877023 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:10:20.877401 (+ 378us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:10:20.877406 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:10:20.877409 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:10:20.877504 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:10:20.877506 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:10:20.879436 (+ 1930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:10:20.879437 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:10:20.880702 (+ 1265us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:10:20.880706 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:10:20.881792 (+ 1086us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:10:20.881793 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:10:20.881889 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:20.881905 (+ 16us) client_negotiation.cc:769] Sending connection context
0811 05:10:20.882339 (+ 434us) client_negotiation.cc:240] Negotiation successful
0811 05:10:20.882425 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4177,"mutex_wait_us":42,"thread_start_us":133,"threads_started":1}
I20260811 05:10:20.883505 15707 tablet_service.cc:1467] Processing CreateTablet for tablet 61947c1efb744c5b9482c3f2f2f0677e (DEFAULT_TABLE table=test-table [id=990c0f1f6ad247e6be784721b83ff396]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:10:20.883941 15707 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 61947c1efb744c5b9482c3f2f2f0677e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:10:20.885010 16090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:20.872903 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.195:43913 (local address 127.0.0.1:34870)
0811 05:10:20.878033 (+ 5130us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:20.878048 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 05:10:20.878132 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:10:20.878393 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:10:20.878394 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:10:20.878397 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:10:20.878437 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:10:20.878438 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:10:20.879415 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:10:20.879417 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:10:20.883673 (+ 4256us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:10:20.883677 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:10:20.884784 (+ 1107us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:10:20.884785 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:10:20.884845 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:20.884849 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 05:10:20.884890 (+ 41us) client_negotiation.cc:240] Negotiation successful
0811 05:10:20.884931 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5019,"mutex_wait_us":2901,"thread_start_us":71,"threads_started":1}
I20260811 05:10:20.885334 16094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:20.872999 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34870 (local address 127.26.191.195:43913)
0811 05:10:20.876857 (+ 3858us) server_negotiation.cc:206] Beginning negotiation
0811 05:10:20.876862 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:10:20.878159 (+ 1297us) server_negotiation.cc:407] Connection header received
0811 05:10:20.878206 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:10:20.878209 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:10:20.878226 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:10:20.878306 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:10:20.878506 (+ 200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:20.879322 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:20.883786 (+ 4464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:20.884571 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:20.884654 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:20.885175 (+ 521us) server_negotiation.cc:1035] Waiting for connection context
0811 05:10:20.885205 (+ 30us) server_negotiation.cc:299] Negotiation successful
0811 05:10:20.885251 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3807,"thread_start_us":76,"threads_started":1}
I20260811 05:10:20.886056 15938 tablet_service.cc:1467] Processing CreateTablet for tablet 61947c1efb744c5b9482c3f2f2f0677e (DEFAULT_TABLE table=test-table [id=990c0f1f6ad247e6be784721b83ff396]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:10:20.886451 15938 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 61947c1efb744c5b9482c3f2f2f0677e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:10:20.888334 16095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:20.873102 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50088 (local address 127.26.191.193:35677)
0811 05:10:20.873300 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0811 05:10:20.873303 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:10:20.877211 (+ 3908us) server_negotiation.cc:407] Connection header received
0811 05:10:20.877319 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:10:20.877321 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:10:20.877338 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:10:20.877401 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:10:20.878357 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:20.879446 (+ 1089us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:20.881413 (+ 1967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:20.882159 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:20.882218 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:20.882267 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 05:10:20.882563 (+ 296us) server_negotiation.cc:299] Negotiation successful
0811 05:10:20.888235 (+ 5672us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":165,"thread_start_us":67,"threads_started":1}
I20260811 05:10:20.888540 16086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:20.872631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.193:35677 (local address 127.0.0.1:50088)
0811 05:10:20.877149 (+ 4518us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:20.877157 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 05:10:20.877236 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:10:20.877523 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:10:20.877523 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:10:20.877526 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:10:20.877574 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:10:20.877575 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:10:20.879562 (+ 1987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:10:20.879562 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:10:20.881310 (+ 1748us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:10:20.881313 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:10:20.882348 (+ 1035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:10:20.882348 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:10:20.882422 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:20.882425 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 05:10:20.882471 (+ 46us) client_negotiation.cc:240] Negotiation successful
0811 05:10:20.882512 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4500,"mutex_wait_us":2,"thread_start_us":112,"threads_started":1}
I20260811 05:10:20.889262 15495 tablet_service.cc:1467] Processing CreateTablet for tablet 61947c1efb744c5b9482c3f2f2f0677e (DEFAULT_TABLE table=test-table [id=990c0f1f6ad247e6be784721b83ff396]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:10:20.889614 15495 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 61947c1efb744c5b9482c3f2f2f0677e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:10:20.893707 16097 tablet_bootstrap.cc:492] T 61947c1efb744c5b9482c3f2f2f0677e P 56acbe8a6ae44e8a93eec447cfb8eb66: Bootstrap starting.
I20260811 05:10:20.894495 16097 tablet_bootstrap.cc:654] T 61947c1efb744c5b9482c3f2f2f0677e P 56acbe8a6ae44e8a93eec447cfb8eb66: Neither blocks nor log segments found. Creating new log.
I20260811 05:10:20.894819 16097 log.cc:824] T 61947c1efb744c5b9482c3f2f2f0677e P 56acbe8a6ae44e8a93eec447cfb8eb66: Log is configured to *not* fsync() on all Append() calls
I20260811 05:10:20.895169 16103 tablet_bootstrap.cc:492] T 61947c1efb744c5b9482c3f2f2f0677e P ee86d999fab24b709d485d283cee4db8: Bootstrap starting.
I20260811 05:10:20.895787 16103 tablet_bootstrap.cc:654] T 61947c1efb744c5b9482c3f2f2f0677e P ee86d999fab24b709d485d283cee4db8: Neither blocks nor log segments found. Creating new log.
I20260811 05:10:20.896086 16103 log.cc:824] T 61947c1efb744c5b9482c3f2f2f0677e P ee86d999fab24b709d485d283cee4db8: Log is configured to *not* fsync() on all Append() calls
I20260811 05:10:20.896903 16101 tablet_bootstrap.cc:492] T 61947c1efb744c5b9482c3f2f2f0677e P fe63cc770503483abd0534e475194ce3: Bootstrap starting.
I20260811 05:10:20.896971 16097 tablet_bootstrap.cc:492] T 61947c1efb744c5b9482c3f2f2f0677e P 56acbe8a6ae44e8a93eec447cfb8eb66: No bootstrap required, opened a new log
I20260811 05:10:20.897034 16097 ts_tablet_manager.cc:1397] T 61947c1efb744c5b9482c3f2f2f0677e P 56acbe8a6ae44e8a93eec447cfb8eb66: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260811 05:10:20.897615 16101 tablet_bootstrap.cc:654] T 61947c1efb744c5b9482c3f2f2f0677e P fe63cc770503483abd0534e475194ce3: Neither blocks nor log segments found. Creating new log.
I20260811 05:10:20.897996 16101 log.cc:824] T 61947c1efb744c5b9482c3f2f2f0677e P fe63cc770503483abd0534e475194ce3: Log is configured to *not* fsync() on all Append() calls
I20260811 05:10:20.900003 16097 raft_consensus.cc:348] T 61947c1efb744c5b9482c3f2f2f0677e P 56acbe8a6ae44e8a93eec447cfb8eb66 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee86d999fab24b709d485d283cee4db8" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 35677 } } peers { permanent_uuid: "fe63cc770503483abd0534e475194ce3" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 43913 } } peers { permanent_uuid: "56acbe8a6ae44e8a93eec447cfb8eb66" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 45367 } }
I20260811 05:10:20.900197 16097 raft_consensus.cc:374] T 61947c1efb744c5b9482c3f2f2f0677e P 56acbe8a6ae44e8a93eec447cfb8eb66 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:10:20.900235 16097 raft_consensus.cc:729] T 61947c1efb744c5b9482c3f2f2f0677e P 56acbe8a6ae44e8a93eec447cfb8eb66 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56acbe8a6ae44e8a93eec447cfb8eb66, State: Initialized, Role: FOLLOWER
I20260811 05:10:20.900390 16097 consensus_queue.cc:260] T 61947c1efb744c5b9482c3f2f2f0677e P 56acbe8a6ae44e8a93eec447cfb8eb66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee86d999fab24b709d485d283cee4db8" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 35677 } } peers { permanent_uuid: "fe63cc770503483abd0534e475194ce3" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 43913 } } peers { permanent_uuid: "56acbe8a6ae44e8a93eec447cfb8eb66" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 45367 } }
I20260811 05:10:20.900658 16097 ts_tablet_manager.cc:1428] T 61947c1efb744c5b9482c3f2f2f0677e P 56acbe8a6ae44e8a93eec447cfb8eb66: Time spent starting tablet: real 0.004s user 0.000s sys 0.004s
I20260811 05:10:20.900818 15829 heartbeater.cc:503] Master 127.26.191.254:39719 was elected leader, sending a full tablet report...
I20260811 05:10:20.901541 16103 tablet_bootstrap.cc:492] T 61947c1efb744c5b9482c3f2f2f0677e P ee86d999fab24b709d485d283cee4db8: No bootstrap required, opened a new log
I20260811 05:10:20.901628 16103 ts_tablet_manager.cc:1397] T 61947c1efb744c5b9482c3f2f2f0677e P ee86d999fab24b709d485d283cee4db8: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.000s
I20260811 05:10:20.904044 16103 raft_consensus.cc:348] T 61947c1efb744c5b9482c3f2f2f0677e P ee86d999fab24b709d485d283cee4db8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee86d999fab24b709d485d283cee4db8" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 35677 } } peers { permanent_uuid: "fe63cc770503483abd0534e475194ce3" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 43913 } } peers { permanent_uuid: "56acbe8a6ae44e8a93eec447cfb8eb66" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 45367 } }
I20260811 05:10:20.904237 16103 raft_consensus.cc:374] T 61947c1efb744c5b9482c3f2f2f0677e P ee86d999fab24b709d485d283cee4db8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:10:20.904300 16103 raft_consensus.cc:729] T 61947c1efb744c5b9482c3f2f2f0677e P ee86d999fab24b709d485d283cee4db8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee86d999fab24b709d485d283cee4db8, State: Initialized, Role: FOLLOWER
I20260811 05:10:20.904430 16103 consensus_queue.cc:260] T 61947c1efb744c5b9482c3f2f2f0677e P ee86d999fab24b709d485d283cee4db8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee86d999fab24b709d485d283cee4db8" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 35677 } } peers { permanent_uuid: "fe63cc770503483abd0534e475194ce3" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 43913 } } peers { permanent_uuid: "56acbe8a6ae44e8a93eec447cfb8eb66" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 45367 } }
I20260811 05:10:20.904750 15631 heartbeater.cc:503] Master 127.26.191.254:39719 was elected leader, sending a full tablet report...
I20260811 05:10:20.904989 16103 ts_tablet_manager.cc:1428] T 61947c1efb744c5b9482c3f2f2f0677e P ee86d999fab24b709d485d283cee4db8: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 05:10:20.909268 16101 tablet_bootstrap.cc:492] T 61947c1efb744c5b9482c3f2f2f0677e P fe63cc770503483abd0534e475194ce3: No bootstrap required, opened a new log
I20260811 05:10:20.909363 16101 ts_tablet_manager.cc:1397] T 61947c1efb744c5b9482c3f2f2f0677e P fe63cc770503483abd0534e475194ce3: Time spent bootstrapping tablet: real 0.013s user 0.001s sys 0.000s
I20260811 05:10:20.911281 16101 raft_consensus.cc:348] T 61947c1efb744c5b9482c3f2f2f0677e P fe63cc770503483abd0534e475194ce3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee86d999fab24b709d485d283cee4db8" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 35677 } } peers { permanent_uuid: "fe63cc770503483abd0534e475194ce3" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 43913 } } peers { permanent_uuid: "56acbe8a6ae44e8a93eec447cfb8eb66" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 45367 } }
I20260811 05:10:20.911458 16101 raft_consensus.cc:374] T 61947c1efb744c5b9482c3f2f2f0677e P fe63cc770503483abd0534e475194ce3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:10:20.911509 16101 raft_consensus.cc:729] T 61947c1efb744c5b9482c3f2f2f0677e P fe63cc770503483abd0534e475194ce3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe63cc770503483abd0534e475194ce3, State: Initialized, Role: FOLLOWER
I20260811 05:10:20.911638 16101 consensus_queue.cc:260] T 61947c1efb744c5b9482c3f2f2f0677e P fe63cc770503483abd0534e475194ce3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee86d999fab24b709d485d283cee4db8" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 35677 } } peers { permanent_uuid: "fe63cc770503483abd0534e475194ce3" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 43913 } } peers { permanent_uuid: "56acbe8a6ae44e8a93eec447cfb8eb66" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 45367 } }
I20260811 05:10:20.911962 16101 ts_tablet_manager.cc:1428] T 61947c1efb744c5b9482c3f2f2f0677e P fe63cc770503483abd0534e475194ce3: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 05:10:20.912098 16042 heartbeater.cc:503] Master 127.26.191.254:39719 was elected leader, sending a full tablet report...
W20260811 05:10:20.914000 15632 tablet.cc:2369] T 61947c1efb744c5b9482c3f2f2f0677e P ee86d999fab24b709d485d283cee4db8: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 05:10:21.072121 16044 tablet.cc:2369] T 61947c1efb744c5b9482c3f2f2f0677e P fe63cc770503483abd0534e475194ce3: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 11 05:10:21 dist-test-slave-x5fp krb5kdc[13718](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425020, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.254@KRBTEST.COM for HTTP/127.26.191.212@KRBTEST.COM
W20260811 05:10:21.110684 15830 tablet.cc:2369] T 61947c1efb744c5b9482c3f2f2f0677e P 56acbe8a6ae44e8a93eec447cfb8eb66: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 05:10:21.160534 16113 raft_consensus.cc:482] T 61947c1efb744c5b9482c3f2f2f0677e P fe63cc770503483abd0534e475194ce3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 05:10:21.160717 16113 raft_consensus.cc:504] T 61947c1efb744c5b9482c3f2f2f0677e P fe63cc770503483abd0534e475194ce3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee86d999fab24b709d485d283cee4db8" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 35677 } } peers { permanent_uuid: "fe63cc770503483abd0534e475194ce3" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 43913 } } peers { permanent_uuid: "56acbe8a6ae44e8a93eec447cfb8eb66" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 45367 } }
I20260811 05:10:21.161248 16113 leader_election.cc:288] T 61947c1efb744c5b9482c3f2f2f0677e P fe63cc770503483abd0534e475194ce3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee86d999fab24b709d485d283cee4db8 (127.26.191.193:35677), 56acbe8a6ae44e8a93eec447cfb8eb66 (127.26.191.194:45367)
I20260811 05:10:21.169068 16095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:21.161647 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.195:52699 (local address 127.26.191.193:35677)
0811 05:10:21.161779 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0811 05:10:21.161781 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:10:21.161951 (+ 170us) server_negotiation.cc:407] Connection header received
0811 05:10:21.162058 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:10:21.162059 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:10:21.162069 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:10:21.162099 (+ 30us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:10:21.162369 (+ 270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:21.163136 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:21.165480 (+ 2344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:21.166081 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:21.166135 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:21.166146 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0811 05:10:21.168929 (+ 2783us) server_negotiation.cc:299] Negotiation successful
0811 05:10:21.168987 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108}
I20260811 05:10:21.169551 16117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:21.161408 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.193:35677 (local address 127.26.191.195:52699)
0811 05:10:21.161882 (+ 474us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:21.161895 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 05:10:21.161982 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:10:21.162168 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:10:21.162168 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:10:21.162170 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:10:21.162273 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:10:21.162275 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:10:21.163670 (+ 1395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:10:21.163671 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:10:21.165371 (+ 1700us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:10:21.165375 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:10:21.168745 (+ 3370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:10:21.168746 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:10:21.168823 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:21.168828 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 05:10:21.169388 (+ 560us) client_negotiation.cc:240] Negotiation successful
0811 05:10:21.169442 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":452,"thread_start_us":105,"threads_started":1}
I20260811 05:10:21.172134 15536 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "61947c1efb744c5b9482c3f2f2f0677e" candidate_uuid: "fe63cc770503483abd0534e475194ce3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee86d999fab24b709d485d283cee4db8" is_pre_election: true
I20260811 05:10:21.172345 15536 raft_consensus.cc:2454] T 61947c1efb744c5b9482c3f2f2f0677e P ee86d999fab24b709d485d283cee4db8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe63cc770503483abd0534e475194ce3 in term 0.
I20260811 05:10:21.172658 15866 leader_election.cc:302] T 61947c1efb744c5b9482c3f2f2f0677e P fe63cc770503483abd0534e475194ce3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ee86d999fab24b709d485d283cee4db8, fe63cc770503483abd0534e475194ce3; no voters:
I20260811 05:10:21.172840 16113 raft_consensus.cc:2781] T 61947c1efb744c5b9482c3f2f2f0677e P fe63cc770503483abd0534e475194ce3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 05:10:21.172914 16113 raft_consensus.cc:482] T 61947c1efb744c5b9482c3f2f2f0677e P fe63cc770503483abd0534e475194ce3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 05:10:21.172945 16113 raft_consensus.cc:3037] T 61947c1efb744c5b9482c3f2f2f0677e P fe63cc770503483abd0534e475194ce3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:10:21.173794 16113 raft_consensus.cc:504] T 61947c1efb744c5b9482c3f2f2f0677e P fe63cc770503483abd0534e475194ce3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee86d999fab24b709d485d283cee4db8" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 35677 } } peers { permanent_uuid: "fe63cc770503483abd0534e475194ce3" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 43913 } } peers { permanent_uuid: "56acbe8a6ae44e8a93eec447cfb8eb66" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 45367 } }
I20260811 05:10:21.174003 16113 leader_election.cc:288] T 61947c1efb744c5b9482c3f2f2f0677e P fe63cc770503483abd0534e475194ce3 [CANDIDATE]: Term 1 election: Requested vote from peers ee86d999fab24b709d485d283cee4db8 (127.26.191.193:35677), 56acbe8a6ae44e8a93eec447cfb8eb66 (127.26.191.194:45367)
I20260811 05:10:21.174217 15536 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "61947c1efb744c5b9482c3f2f2f0677e" candidate_uuid: "fe63cc770503483abd0534e475194ce3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee86d999fab24b709d485d283cee4db8"
I20260811 05:10:21.174325 15536 raft_consensus.cc:3037] T 61947c1efb744c5b9482c3f2f2f0677e P ee86d999fab24b709d485d283cee4db8 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:10:21.175294 15536 raft_consensus.cc:2454] T 61947c1efb744c5b9482c3f2f2f0677e P ee86d999fab24b709d485d283cee4db8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe63cc770503483abd0534e475194ce3 in term 1.
I20260811 05:10:21.175562 15866 leader_election.cc:302] T 61947c1efb744c5b9482c3f2f2f0677e P fe63cc770503483abd0534e475194ce3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ee86d999fab24b709d485d283cee4db8, fe63cc770503483abd0534e475194ce3; no voters:
I20260811 05:10:21.175657 16113 raft_consensus.cc:2781] T 61947c1efb744c5b9482c3f2f2f0677e P fe63cc770503483abd0534e475194ce3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:10:21.175863 16113 raft_consensus.cc:686] T 61947c1efb744c5b9482c3f2f2f0677e P fe63cc770503483abd0534e475194ce3 [term 1 LEADER]: Becoming Leader. State: Replica: fe63cc770503483abd0534e475194ce3, State: Running, Role: LEADER
I20260811 05:10:21.175976 16113 consensus_queue.cc:237] T 61947c1efb744c5b9482c3f2f2f0677e P fe63cc770503483abd0534e475194ce3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee86d999fab24b709d485d283cee4db8" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 35677 } } peers { permanent_uuid: "fe63cc770503483abd0534e475194ce3" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 43913 } } peers { permanent_uuid: "56acbe8a6ae44e8a93eec447cfb8eb66" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 45367 } }
I20260811 05:10:21.180927 15329 catalog_manager.cc:5495] T 61947c1efb744c5b9482c3f2f2f0677e P fe63cc770503483abd0534e475194ce3 reported cstate change: term changed from 0 to 1, leader changed from <none> to fe63cc770503483abd0534e475194ce3 (127.26.191.195). New cstate: current_term: 1 leader_uuid: "fe63cc770503483abd0534e475194ce3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee86d999fab24b709d485d283cee4db8" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 35677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe63cc770503483abd0534e475194ce3" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 43913 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56acbe8a6ae44e8a93eec447cfb8eb66" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 45367 } health_report { overall_health: UNKNOWN } } }
I20260811 05:10:21.183887 16093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:21.161726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.195:37559 (local address 127.26.191.194:45367)
0811 05:10:21.161825 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0811 05:10:21.161827 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:10:21.164944 (+ 3117us) server_negotiation.cc:407] Connection header received
0811 05:10:21.179539 (+ 14595us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:10:21.179541 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:10:21.179559 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:10:21.179591 (+ 32us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:10:21.179835 (+ 244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:21.180546 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:21.182627 (+ 2081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:21.183442 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:21.183525 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:21.183537 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0811 05:10:21.183758 (+ 221us) server_negotiation.cc:299] Negotiation successful
0811 05:10:21.183812 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260811 05:10:21.184274 16116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:21.161466 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.194:45367 (local address 127.26.191.195:37559)
0811 05:10:21.164868 (+ 3402us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:21.164881 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 05:10:21.164974 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:10:21.179669 (+ 14695us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:10:21.179670 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:10:21.179673 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:10:21.179752 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:10:21.179754 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:10:21.181374 (+ 1620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:10:21.181375 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:10:21.182515 (+ 1140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:10:21.182519 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:10:21.183575 (+ 1056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:10:21.183576 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:10:21.183661 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:21.183666 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 05:10:21.184138 (+ 472us) client_negotiation.cc:240] Negotiation successful
0811 05:10:21.184189 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3376,"thread_start_us":107,"threads_started":1}
I20260811 05:10:21.185415 15768 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "61947c1efb744c5b9482c3f2f2f0677e" candidate_uuid: "fe63cc770503483abd0534e475194ce3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56acbe8a6ae44e8a93eec447cfb8eb66" is_pre_election: true
I20260811 05:10:21.185431 15770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "61947c1efb744c5b9482c3f2f2f0677e" candidate_uuid: "fe63cc770503483abd0534e475194ce3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56acbe8a6ae44e8a93eec447cfb8eb66"
I20260811 05:10:21.185606 15768 raft_consensus.cc:2454] T 61947c1efb744c5b9482c3f2f2f0677e P 56acbe8a6ae44e8a93eec447cfb8eb66 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe63cc770503483abd0534e475194ce3 in term 0.
I20260811 05:10:21.237754 16094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:21.233907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34884 (local address 127.26.191.195:43913)
0811 05:10:21.234015 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0811 05:10:21.234018 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:10:21.234026 (+ 8us) server_negotiation.cc:407] Connection header received
0811 05:10:21.234073 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:10:21.234075 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:10:21.234099 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:10:21.234177 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:10:21.234401 (+ 224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:21.235238 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:21.236457 (+ 1219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:21.236809 (+ 352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:21.236893 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:21.237134 (+ 241us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:10:21.237295 (+ 161us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:10:21.237411 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0811 05:10:21.237619 (+ 208us) server_negotiation.cc:299] Negotiation successful
0811 05:10:21.237646 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260811 05:10:21.240890 15770 raft_consensus.cc:3037] T 61947c1efb744c5b9482c3f2f2f0677e P 56acbe8a6ae44e8a93eec447cfb8eb66 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:10:21.242036 15770 raft_consensus.cc:1261] T 61947c1efb744c5b9482c3f2f2f0677e P 56acbe8a6ae44e8a93eec447cfb8eb66 [term 1 FOLLOWER]: Refusing update from remote peer fe63cc770503483abd0534e475194ce3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:10:21.242377 15536 raft_consensus.cc:1261] T 61947c1efb744c5b9482c3f2f2f0677e P ee86d999fab24b709d485d283cee4db8 [term 1 FOLLOWER]: Refusing update from remote peer fe63cc770503483abd0534e475194ce3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:10:21.242957 16113 consensus_queue.cc:1035] T 61947c1efb744c5b9482c3f2f2f0677e P fe63cc770503483abd0534e475194ce3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee86d999fab24b709d485d283cee4db8" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 35677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:10:21.243398 16113 consensus_queue.cc:1035] T 61947c1efb744c5b9482c3f2f2f0677e P fe63cc770503483abd0534e475194ce3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56acbe8a6ae44e8a93eec447cfb8eb66" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 45367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:10:21.250188 16122 mvcc.cc:205] Tried to move back new op lower bound from 7317196886998573056 to 7317196886737395712. Current Snapshot: MvccSnapshot[applied={T|T < 7317196886998573056}]
I20260811 05:10:21.251997 16126 mvcc.cc:205] Tried to move back new op lower bound from 7317196886998573056 to 7317196886737395712. Current Snapshot: MvccSnapshot[applied={T|T < 7317196886998573056}]
I20260811 05:10:21.252760 16128 mvcc.cc:205] Tried to move back new op lower bound from 7317196886998573056 to 7317196886737395712. Current Snapshot: MvccSnapshot[applied={T|T < 7317196886998573056}]
I20260811 05:10:21.255155 15329 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38656:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:10:21.255266 15329 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38656:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:10:21.256042 15329 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b122260a99014bdf8d1960c3ee461f1c: Sending DeleteTablet for 3 replicas of tablet 61947c1efb744c5b9482c3f2f2f0677e
I20260811 05:10:21.256812 15938 tablet_service.cc:1514] Processing DeleteTablet for tablet 61947c1efb744c5b9482c3f2f2f0677e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:10:21 UTC) from {username='kudu', principal='kudu/127.26.191.254@KRBTEST.COM'} at 127.0.0.1:34870
I20260811 05:10:21.256996 15707 tablet_service.cc:1514] Processing DeleteTablet for tablet 61947c1efb744c5b9482c3f2f2f0677e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:10:21 UTC) from {username='kudu', principal='kudu/127.26.191.254@KRBTEST.COM'} at 127.0.0.1:35264
I20260811 05:10:21.257465 15495 tablet_service.cc:1514] Processing DeleteTablet for tablet 61947c1efb744c5b9482c3f2f2f0677e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:10:21 UTC) from {username='kudu', principal='kudu/127.26.191.254@KRBTEST.COM'} at 127.0.0.1:50088
I20260811 05:10:21.257954 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 15389
I20260811 05:10:21.276859 16137 tablet_replica.cc:330] T 61947c1efb744c5b9482c3f2f2f0677e P 56acbe8a6ae44e8a93eec447cfb8eb66: stopping tablet replica
I20260811 05:10:21.277050 16137 raft_consensus.cc:2229] T 61947c1efb744c5b9482c3f2f2f0677e P 56acbe8a6ae44e8a93eec447cfb8eb66 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 05:10:21.277211 16137 raft_consensus.cc:2258] T 61947c1efb744c5b9482c3f2f2f0677e P 56acbe8a6ae44e8a93eec447cfb8eb66 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:10:21.277786 16137 ts_tablet_manager.cc:1905] T 61947c1efb744c5b9482c3f2f2f0677e P 56acbe8a6ae44e8a93eec447cfb8eb66: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:10:21.279996 16137 ts_tablet_manager.cc:1918] T 61947c1efb744c5b9482c3f2f2f0677e P 56acbe8a6ae44e8a93eec447cfb8eb66: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 05:10:21.280088 16137 log.cc:1196] T 61947c1efb744c5b9482c3f2f2f0677e P 56acbe8a6ae44e8a93eec447cfb8eb66: Deleting WAL directory at /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ts-1/wal/wals/61947c1efb744c5b9482c3f2f2f0677e
I20260811 05:10:21.280391 16137 ts_tablet_manager.cc:1939] T 61947c1efb744c5b9482c3f2f2f0677e P 56acbe8a6ae44e8a93eec447cfb8eb66: Deleting consensus metadata
I20260811 05:10:21.280936 15299 catalog_manager.cc:4841] TS 56acbe8a6ae44e8a93eec447cfb8eb66 (127.26.191.194:45367): tablet 61947c1efb744c5b9482c3f2f2f0677e (table test-table [id=990c0f1f6ad247e6be784721b83ff396]) successfully deleted
I20260811 05:10:21.281142 16145 tablet_replica.cc:330] T 61947c1efb744c5b9482c3f2f2f0677e P fe63cc770503483abd0534e475194ce3: stopping tablet replica
I20260811 05:10:21.281270 16145 raft_consensus.cc:2229] T 61947c1efb744c5b9482c3f2f2f0677e P fe63cc770503483abd0534e475194ce3 [term 1 LEADER]: Raft consensus shutting down.
I20260811 05:10:21.281430 16145 raft_consensus.cc:2258] T 61947c1efb744c5b9482c3f2f2f0677e P fe63cc770503483abd0534e475194ce3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:10:21.282027 16145 ts_tablet_manager.cc:1905] T 61947c1efb744c5b9482c3f2f2f0677e P fe63cc770503483abd0534e475194ce3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:10:21.283759 16145 ts_tablet_manager.cc:1918] T 61947c1efb744c5b9482c3f2f2f0677e P fe63cc770503483abd0534e475194ce3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 05:10:21.283844 16145 log.cc:1196] T 61947c1efb744c5b9482c3f2f2f0677e P fe63cc770503483abd0534e475194ce3: Deleting WAL directory at /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424853995437-27391-0/minicluster-data/ts-2/wal/wals/61947c1efb744c5b9482c3f2f2f0677e
I20260811 05:10:21.284117 16145 ts_tablet_manager.cc:1939] T 61947c1efb744c5b9482c3f2f2f0677e P fe63cc770503483abd0534e475194ce3: Deleting consensus metadata
I20260811 05:10:21.284627 15303 catalog_manager.cc:4841] TS fe63cc770503483abd0534e475194ce3 (127.26.191.195:43913): tablet 61947c1efb744c5b9482c3f2f2f0677e (table test-table [id=990c0f1f6ad247e6be784721b83ff396]) successfully deleted
W20260811 05:10:21.287882 15303 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.191.193:35677 (error 108)
I20260811 05:10:21.288869 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 15638
I20260811 05:10:21.358891 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 15835
I20260811 05:10:21.363956 16086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:21.363800 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.193:35677 (local address 127.0.0.1:50094)
0811 05:10:21.363861 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:21.363910 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.193:35677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260811 05:10:21.364859 15303 catalog_manager.cc:4584] TS ee86d999fab24b709d485d283cee4db8 (127.26.191.193:35677): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 61947c1efb744c5b9482c3f2f2f0677e: Network error: Client connection negotiation failed: client connection to 127.26.191.193:35677: connect: Connection refused (error 111)
I20260811 05:10:21.370360 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 15272
I20260811 05:10:21.398180 27391 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260811 05:10:21.756851 27391 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260811 05:10:21.757004 27391 mini_ranger.cc:66] Stopping Ranger...
I20260811 05:10:22.101979 27391 mini_ranger.cc:68] Stopped Ranger
2026-08-11 05:10:22.102 UTC [13762] LOG: received smart shutdown request
2026-08-11 05:10:22.106 UTC [13762] LOG: background worker "logical replication launcher" (PID 13775) exited with exit code 1
2026-08-11 05:10:22.107 UTC [13768] LOG: shutting down
2026-08-11 05:10:22.297 UTC [13762] LOG: database system is shut down
2026-08-11T05:10:22Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (52750 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424853995437-27391-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 05:10:22 dist-test-slave-x5fp krb5kdc[16167](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 05:10:22 dist-test-slave-x5fp krb5kdc[16167](info): set up 2 sockets
Aug 11 05:10:22 dist-test-slave-x5fp krb5kdc[16167](info): commencing operation
krb5kdc: starting...
W20260811 05:10:23.744231 27391 mini_kdc.cc:121] Time spent starting KDC: real 1.306s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424853995437-27391-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424853995437-27391-0/krb5kdc/test-user.keytab.
Aug 11 05:10:23 dist-test-slave-x5fp krb5kdc[16167](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425023, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T05:10:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:10:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.191.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.191.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.191.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab.
Entry for principal kudu/127.26.191.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab.
I20260811 05:10:23.890558 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424853995437-27391-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424853995437-27391-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424853995437-27391-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.254:33881
--webserver_interface=127.26.191.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab
--principal=kudu/127.26.191.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:33533
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.191.254:33881,127.26.191.253:40975,127.26.191.252:37203
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:10:23.982084 16184 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:10:23.982326 16184 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:10:23.982352 16184 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:10:23.983577 16184 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:10:23.983626 16184 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:10:23.983641 16184 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:10:23.983654 16184 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:10:23.983666 16184 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:10:23.985410 16184 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:33533
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424853995437-27391-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424853995437-27391-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.191.254:33881,127.26.191.253:40975,127.26.191.252:37203
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab
--principal=kudu/127.26.191.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.254:33881
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.191.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16184
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424853995437-27391-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:10:23.985713 16184 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:10:23.985975 16184 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:10:23.991334 16196 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:10:23.991334 16192 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:10:23.991539 16184 server_base.cc:1034] running on GCE node
W20260811 05:10:23.991358 16193 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:10:23.991899 16184 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:10:23.992254 16184 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:10:23.993424 16184 hybrid_clock.cc:648] HybridClock initialized: now 1786425023993409 us; error 31 us; skew 500 ppm
Aug 11 05:10:23 dist-test-slave-x5fp krb5kdc[16167](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425023, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:10:23.996179 16184 init.cc:377] Logged in from keytab as kudu/127.26.191.254@KRBTEST.COM (short username kudu)
I20260811 05:10:23.996610 16184 webserver.cc:460] Webserver started at http://127.26.191.254:41983/ using document root <none> and password file <none>
I20260811 05:10:23.996912 16184 fs_manager.cc:359] Metadata directory not provided
I20260811 05:10:23.996984 16184 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:10:23.997131 16184 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:10:23.998211 16184 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424853995437-27391-0/minicluster-data/master-0/data/instance:
uuid: "0f8af509c9b2495ca39d42b9a9f14da1"
format_stamp: "Formatted at 2026-08-11 05:10:23 on dist-test-slave-x5fp"
server_key: "e5f96e1f9e46bf457e61ad7268528cea"
server_key_iv: "e9c483e6b76656c5b4ed86b7d83982a2"
server_key_version: "encryptionkey@0"
I20260811 05:10:23.998589 16184 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424853995437-27391-0/minicluster-data/master-0/wal/instance:
uuid: "0f8af509c9b2495ca39d42b9a9f14da1"
format_stamp: "Formatted at 2026-08-11 05:10:23 on dist-test-slave-x5fp"
server_key: "e5f96e1f9e46bf457e61ad7268528cea"
server_key_iv: "e9c483e6b76656c5b4ed86b7d83982a2"
server_key_version: "encryptionkey@0"
I20260811 05:10:24.000100 16184 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 05:10:24.001133 16207 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:10:24.001396 16184 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:10:24.001523 16184 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424853995437-27391-0/minicluster-data/master-0/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424853995437-27391-0/minicluster-data/master-0/wal
uuid: "0f8af509c9b2495ca39d42b9a9f14da1"
format_stamp: "Formatted at 2026-08-11 05:10:23 on dist-test-slave-x5fp"
server_key: "e5f96e1f9e46bf457e61ad7268528cea"
server_key_iv: "e9c483e6b76656c5b4ed86b7d83982a2"
server_key_version: "encryptionkey@0"
I20260811 05:10:24.001610 16184 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424853995437-27391-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424853995437-27391-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424853995437-27391-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:10:24.019001 16184 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:10:24.021692 16184 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:10:24.021869 16184 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:10:24.026333 16184 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.254:33881
I20260811 05:10:24.026463 16298 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.254:33881 every 8 connection(s)
I20260811 05:10:24.026799 16184 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
I20260811 05:10:24.027279 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 16184
I20260811 05:10:24.027438 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424853995437-27391-0/minicluster-data/master-0/wal/instance
I20260811 05:10:24.027673 27391 external_mini_cluster.cc:1428] Setting key cfd34435b46c956f544b87584278a6c0
I20260811 05:10:24.028005 16299 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:10:24.030342 16299 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.191.254" port: 33881 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.26.191.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.191.253@KRBTEST.COM" created.
Aug 11 05:10:24 dist-test-slave-x5fp krb5kdc[16167](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425023, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.254@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
I20260811 05:10:24.044265 16305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:24.031160 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43600 (local address 127.26.191.254:33881)
0811 05:10:24.031341 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0811 05:10:24.031353 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 05:10:24.031505 (+ 152us) server_negotiation.cc:407] Connection header received
0811 05:10:24.032116 (+ 611us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:10:24.032119 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:10:24.032139 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:10:24.032258 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:10:24.032945 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:24.033783 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:24.034672 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:24.035008 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:24.035145 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:24.040683 (+ 5538us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:10:24.040693 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:10:24.040693 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:10:24.040702 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:10:24.042536 (+ 1834us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:10:24.043066 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:10:24.043069 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:10:24.043069 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:10:24.043160 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:10:24.043428 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:10:24.043429 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:10:24.043429 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:10:24.043665 (+ 236us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:10:24.043731 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 05:10:24.043971 (+ 240us) server_negotiation.cc:299] Negotiation successful
0811 05:10:24.044084 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":99,"threads_started":1}
I20260811 05:10:24.044389 16307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:24.031142 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:33881 (local address 127.0.0.1:43600)
0811 05:10:24.031367 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:24.031408 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 05:10:24.031947 (+ 539us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:10:24.032265 (+ 318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:10:24.032268 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:10:24.032589 (+ 321us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:10:24.032835 (+ 246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:10:24.032841 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:10:24.033896 (+ 1055us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:10:24.033897 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:10:24.034575 (+ 678us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:10:24.034576 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:10:24.035107 (+ 531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:10:24.035108 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:10:24.035173 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:24.035855 (+ 682us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:10:24.035865 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:10:24.040548 (+ 4683us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:10:24.042635 (+ 2087us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:10:24.042645 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:10:24.042648 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:10:24.042968 (+ 320us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:10:24.043229 (+ 261us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:10:24.043230 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:10:24.043231 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:10:24.043354 (+ 123us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:10:24.043733 (+ 379us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:10:24.043741 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:10:24.043829 (+ 88us) client_negotiation.cc:769] Sending connection context
0811 05:10:24.043937 (+ 108us) client_negotiation.cc:240] Negotiation successful
0811 05:10:24.044170 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":191,"mutex_wait_us":49,"thread_start_us":118,"threads_started":1}
I20260811 05:10:24.045290 16299 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.191.253" port: 40975 } has no permanent_uuid. Determining permanent_uuid...
I20260811 05:10:24.045725 16307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:24.045553 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.253:40975 (local address 127.0.0.1:45988)
0811 05:10:24.045633 (+ 80us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:24.045697 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.253:40975: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260811 05:10:24.045915 16208 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.191.253:40975: connect: Connection refused (error 111)
I20260811 05:10:24.046451 16307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:24.046320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.253:40975 (local address 127.0.0.1:46000)
0811 05:10:24.046396 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:24.046429 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.253:40975: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260811 05:10:24.046609 16299 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.191.253:40975: Network error: Client connection negotiation failed: client connection to 127.26.191.253:40975: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.191.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.253.keytab.
Entry for principal kudu/127.26.191.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.253.keytab.
I20260811 05:10:24.061278 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424853995437-27391-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424853995437-27391-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424853995437-27391-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424853995437-27391-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.253:40975
--webserver_interface=127.26.191.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.253.keytab
--principal=kudu/127.26.191.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:33533
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.191.254:33881,127.26.191.253:40975,127.26.191.252:37203
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 05:10:24.095922 16299 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.191.253" port: 40975 } attempt: 1
I20260811 05:10:24.096619 16307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:24.096416 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.253:40975 (local address 127.0.0.1:46010)
0811 05:10:24.096519 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:24.096578 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.253:40975: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260811 05:10:24.097149 16307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:24.097048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.253:40975 (local address 127.0.0.1:46024)
0811 05:10:24.097094 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:24.097125 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.253:40975: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260811 05:10:24.097276 16299 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.191.253:40975: Network error: Client connection negotiation failed: client connection to 127.26.191.253:40975: connect: Connection refused (error 111)
W20260811 05:10:24.154574 16311 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:10:24.154855 16311 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:10:24.154882 16311 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:10:24.156126 16311 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:10:24.156168 16311 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:10:24.156184 16311 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:10:24.156199 16311 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:10:24.156212 16311 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:10:24.157974 16311 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:33533
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424853995437-27391-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424853995437-27391-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.26.191.254:33881,127.26.191.253:40975,127.26.191.252:37203
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.253.keytab
--principal=kudu/127.26.191.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.253:40975
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424853995437-27391-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.26.191.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16311
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424853995437-27391-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:10:24.158216 16311 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:10:24.158420 16311 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:10:24.164041 16324 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:10:24.164065 16329 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:10:24.164050 16333 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:10:24.164599 16311 server_base.cc:1034] running on GCE node
I20260811 05:10:24.165046 16311 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:10:24.165343 16311 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:10:24.165458 16299 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.191.253" port: 40975 } attempt: 2
I20260811 05:10:24.165876 16307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:24.165748 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.253:40975 (local address 127.0.0.1:46040)
0811 05:10:24.165804 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:24.165841 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.253:40975: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260811 05:10:24.166218 16307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:24.166121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.253:40975 (local address 127.0.0.1:46054)
0811 05:10:24.166167 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:24.166192 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.253:40975: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260811 05:10:24.166316 16299 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.191.253:40975: Network error: Client connection negotiation failed: client connection to 127.26.191.253:40975: connect: Connection refused (error 111)
I20260811 05:10:24.166478 16311 hybrid_clock.cc:648] HybridClock initialized: now 1786425024166467 us; error 32 us; skew 500 ppm
Aug 11 05:10:24 dist-test-slave-x5fp krb5kdc[16167](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425024, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:10:24.169478 16311 init.cc:377] Logged in from keytab as kudu/127.26.191.253@KRBTEST.COM (short username kudu)
I20260811 05:10:24.170023 16311 webserver.cc:460] Webserver started at http://127.26.191.253:43839/ using document root <none> and password file <none>
I20260811 05:10:24.170298 16311 fs_manager.cc:359] Metadata directory not provided
I20260811 05:10:24.170368 16311 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:10:24.170509 16311 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:10:24.171643 16311 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424853995437-27391-0/minicluster-data/master-1/data/instance:
uuid: "7d876568aeb14bc28b7078663625953a"
format_stamp: "Formatted at 2026-08-11 05:10:24 on dist-test-slave-x5fp"
server_key: "678049beec22976fdea9257cda4d93f0"
server_key_iv: "eb6b5d49e83ef34c16ec5728b4b2950d"
server_key_version: "encryptionkey@0"
I20260811 05:10:24.172026 16311 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424853995437-27391-0/minicluster-data/master-1/wal/instance:
uuid: "7d876568aeb14bc28b7078663625953a"
format_stamp: "Formatted at 2026-08-11 05:10:24 on dist-test-slave-x5fp"
server_key: "678049beec22976fdea9257cda4d93f0"
server_key_iv: "eb6b5d49e83ef34c16ec5728b4b2950d"
server_key_version: "encryptionkey@0"
I20260811 05:10:24.173538 16311 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 05:10:24.174379 16347 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:10:24.174569 16311 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 05:10:24.174683 16311 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424853995437-27391-0/minicluster-data/master-1/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424853995437-27391-0/minicluster-data/master-1/wal
uuid: "7d876568aeb14bc28b7078663625953a"
format_stamp: "Formatted at 2026-08-11 05:10:24 on dist-test-slave-x5fp"
server_key: "678049beec22976fdea9257cda4d93f0"
server_key_iv: "eb6b5d49e83ef34c16ec5728b4b2950d"
server_key_version: "encryptionkey@0"
I20260811 05:10:24.174762 16311 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424853995437-27391-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424853995437-27391-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424853995437-27391-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:10:24.200322 16311 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:10:24.202569 16311 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:10:24.202740 16311 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:10:24.207448 16311 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.253:40975
I20260811 05:10:24.207508 16436 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.253:40975 every 8 connection(s)
I20260811 05:10:24.207901 16311 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424853995437-27391-0/minicluster-data/master-1/data/info.pb
I20260811 05:10:24.208195 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 16311
I20260811 05:10:24.208334 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424853995437-27391-0/minicluster-data/master-1/wal/instance
I20260811 05:10:24.208534 27391 external_mini_cluster.cc:1428] Setting key 4daa6394c608bd45f4830f56f067b9da
I20260811 05:10:24.209007 16437 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:10:24.210716 16437 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.191.254" port: 33881 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.26.191.252@KRBTEST.COM; defaulting to no policy
Aug 11 05:10:24 dist-test-slave-x5fp krb5kdc[16167](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425024, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.253@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.191.252@KRBTEST.COM" created.
I20260811 05:10:24.221771 16444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:24.211460 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:33881 (local address 127.0.0.1:43612)
0811 05:10:24.211664 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:24.211712 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 05:10:24.212246 (+ 534us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:10:24.212550 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:10:24.212554 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:10:24.212907 (+ 353us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:10:24.213144 (+ 237us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:10:24.213151 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:10:24.214225 (+ 1074us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:10:24.214226 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:10:24.215160 (+ 934us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:10:24.215163 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:10:24.215745 (+ 582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:10:24.215746 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:10:24.215898 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:24.216483 (+ 585us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:10:24.216492 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:10:24.217981 (+ 1489us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:10:24.220025 (+ 2044us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:10:24.220034 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:10:24.220037 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:10:24.220396 (+ 359us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:10:24.220647 (+ 251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:10:24.220649 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:10:24.220649 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:10:24.220879 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:10:24.221234 (+ 355us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:10:24.221240 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:10:24.221374 (+ 134us) client_negotiation.cc:769] Sending connection context
0811 05:10:24.221461 (+ 87us) client_negotiation.cc:240] Negotiation successful
0811 05:10:24.221594 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":92,"threads_started":1}
I20260811 05:10:24.221839 16305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:24.211507 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43612 (local address 127.26.191.254:33881)
0811 05:10:24.211600 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0811 05:10:24.211603 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:10:24.211802 (+ 199us) server_negotiation.cc:407] Connection header received
0811 05:10:24.212370 (+ 568us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:10:24.212372 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:10:24.212390 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:10:24.212475 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:10:24.213279 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:24.214095 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:24.215256 (+ 1161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:24.215616 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:24.215709 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:24.218091 (+ 2382us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:10:24.218092 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:10:24.218093 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:10:24.218101 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:10:24.219902 (+ 1801us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:10:24.220480 (+ 578us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:10:24.220481 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:10:24.220482 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:10:24.220551 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:10:24.220959 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:10:24.220960 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:10:24.220973 (+ 13us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:10:24.221152 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:10:24.221236 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0811 05:10:24.221523 (+ 287us) server_negotiation.cc:299] Negotiation successful
0811 05:10:24.221633 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 05:10:24.222579 16437 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.191.253" port: 40975 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 05:10:24 dist-test-slave-x5fp krb5kdc[16167](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425024, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.253@KRBTEST.COM for kudu/127.26.191.253@KRBTEST.COM
I20260811 05:10:24.231370 16444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:24.222905 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.253:40975 (local address 127.0.0.1:46062)
0811 05:10:24.223143 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:24.223158 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 05:10:24.223224 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:10:24.223375 (+ 151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:10:24.223375 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:10:24.223557 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:10:24.223635 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:10:24.223638 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:10:24.224592 (+ 954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:10:24.224593 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:10:24.225238 (+ 645us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:10:24.225241 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:10:24.225976 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:10:24.225977 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:10:24.226046 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:24.226557 (+ 511us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:10:24.226562 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:10:24.227895 (+ 1333us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:10:24.230158 (+ 2263us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:10:24.230159 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:10:24.230159 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:10:24.230364 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:10:24.230608 (+ 244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:10:24.230609 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:10:24.230609 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:10:24.230672 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:10:24.231058 (+ 386us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:10:24.231060 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:10:24.231105 (+ 45us) client_negotiation.cc:769] Sending connection context
0811 05:10:24.231205 (+ 100us) client_negotiation.cc:240] Negotiation successful
0811 05:10:24.231296 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":220}
I20260811 05:10:24.231551 16446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:24.222984 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46062 (local address 127.26.191.253:40975)
0811 05:10:24.223150 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0811 05:10:24.223154 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:10:24.223224 (+ 70us) server_negotiation.cc:407] Connection header received
0811 05:10:24.223289 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:10:24.223291 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:10:24.223306 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:10:24.223371 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:10:24.223713 (+ 342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:24.224475 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:24.225328 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:24.225868 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:24.225949 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:24.227984 (+ 2035us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:10:24.227994 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:10:24.227994 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:10:24.228002 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:10:24.230045 (+ 2043us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:10:24.230454 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:10:24.230459 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:10:24.230459 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:10:24.230530 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:10:24.230744 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:10:24.230745 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:10:24.230745 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:10:24.230961 (+ 216us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:10:24.231060 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0811 05:10:24.231283 (+ 223us) server_negotiation.cc:299] Negotiation successful
0811 05:10:24.231365 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":97,"threads_started":1}
I20260811 05:10:24.232432 16437 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.191.252" port: 37203 } has no permanent_uuid. Determining permanent_uuid...
I20260811 05:10:24.233057 16444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:24.232877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.252:37203 (local address 127.0.0.1:51128)
0811 05:10:24.232969 (+ 92us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:24.233031 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.252:37203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260811 05:10:24.233260 16350 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.191.252:37203: connect: Connection refused (error 111)
I20260811 05:10:24.233814 16444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:24.233699 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.252:37203 (local address 127.0.0.1:51134)
0811 05:10:24.233758 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:24.233791 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.252:37203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260811 05:10:24.233985 16437 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.191.252:37203: Network error: Client connection negotiation failed: client connection to 127.26.191.252:37203: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.191.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.252.keytab.
Entry for principal kudu/127.26.191.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.252.keytab.
I20260811 05:10:24.240336 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424853995437-27391-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424853995437-27391-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424853995437-27391-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424853995437-27391-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.252:37203
--webserver_interface=127.26.191.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.252.keytab
--principal=kudu/127.26.191.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:33533
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.191.254:33881,127.26.191.253:40975,127.26.191.252:37203
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 05:10:24.257483 16299 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.191.253" port: 40975 } attempt: 3
Aug 11 05:10:24 dist-test-slave-x5fp krb5kdc[16167](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425023, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.254@KRBTEST.COM for kudu/127.26.191.253@KRBTEST.COM
I20260811 05:10:24.265684 16307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:24.257974 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.253:40975 (local address 127.0.0.1:46064)
0811 05:10:24.258065 (+ 91us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:24.258080 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 05:10:24.258178 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:10:24.258384 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:10:24.258385 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:10:24.258579 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:10:24.258658 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:10:24.258661 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:10:24.259446 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:10:24.259448 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:10:24.260008 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:10:24.260010 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:10:24.260453 (+ 443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:10:24.260454 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:10:24.260566 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:24.261111 (+ 545us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:10:24.261116 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:10:24.262687 (+ 1571us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:10:24.264526 (+ 1839us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:10:24.264527 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:10:24.264527 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:10:24.264715 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:10:24.264978 (+ 263us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:10:24.264979 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:10:24.264980 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:10:24.265044 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:10:24.265324 (+ 280us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:10:24.265325 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:10:24.265383 (+ 58us) client_negotiation.cc:769] Sending connection context
0811 05:10:24.265459 (+ 76us) client_negotiation.cc:240] Negotiation successful
0811 05:10:24.265576 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":56}
I20260811 05:10:24.265684 16446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:24.258088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46064 (local address 127.26.191.253:40975)
0811 05:10:24.258153 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 05:10:24.258156 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:10:24.258169 (+ 13us) server_negotiation.cc:407] Connection header received
0811 05:10:24.258285 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:10:24.258286 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:10:24.258306 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:10:24.258376 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:10:24.258786 (+ 410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:24.259352 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:24.260102 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:24.260355 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:24.260453 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:24.262858 (+ 2405us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:10:24.262860 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:10:24.262864 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:10:24.262873 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:10:24.264416 (+ 1543us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:10:24.264848 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:10:24.264849 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:10:24.264849 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:10:24.264911 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:10:24.265122 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:10:24.265123 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:10:24.265124 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:10:24.265256 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:10:24.265333 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 05:10:24.265486 (+ 153us) server_negotiation.cc:299] Negotiation successful
0811 05:10:24.265576 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 05:10:24.266456 16299 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.191.252" port: 37203 } has no permanent_uuid. Determining permanent_uuid...
I20260811 05:10:24.266852 16307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:24.266742 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.252:37203 (local address 127.0.0.1:51150)
0811 05:10:24.266791 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:24.266827 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.252:37203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260811 05:10:24.267251 16307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:24.267143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.252:37203 (local address 127.0.0.1:51154)
0811 05:10:24.267190 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:24.267224 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.252:37203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260811 05:10:24.267344 16299 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.191.252:37203: Network error: Client connection negotiation failed: client connection to 127.26.191.252:37203: connect: Connection refused (error 111)
I20260811 05:10:24.283221 16437 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.191.252" port: 37203 } attempt: 1
I20260811 05:10:24.283813 16444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:24.283642 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.252:37203 (local address 127.0.0.1:51168)
0811 05:10:24.283742 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:24.283777 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.252:37203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
I20260811 05:10:24.284209 16444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:24.284115 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.252:37203 (local address 127.0.0.1:51170)
0811 05:10:24.284156 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:24.284185 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.252:37203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260811 05:10:24.284312 16437 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.191.252:37203: Network error: Client connection negotiation failed: client connection to 127.26.191.252:37203: connect: Connection refused (error 111)
I20260811 05:10:24.298501 16299 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.191.252" port: 37203 } attempt: 1
I20260811 05:10:24.298977 16307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:24.298841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.252:37203 (local address 127.0.0.1:51186)
0811 05:10:24.298906 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:24.298945 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.252:37203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260811 05:10:24.299320 16307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:24.299223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.252:37203 (local address 127.0.0.1:51202)
0811 05:10:24.299268 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:24.299298 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.252:37203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260811 05:10:24.299412 16299 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.191.252:37203: Network error: Client connection negotiation failed: client connection to 127.26.191.252:37203: connect: Connection refused (error 111)
W20260811 05:10:24.330065 16449 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:10:24.330294 16449 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:10:24.330317 16449 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:10:24.331511 16449 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:10:24.331559 16449 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:10:24.331574 16449 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:10:24.331588 16449 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:10:24.331600 16449 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:10:24.333257 16449 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:33533
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424853995437-27391-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424853995437-27391-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.26.191.254:33881,127.26.191.253:40975,127.26.191.252:37203
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.252.keytab
--principal=kudu/127.26.191.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.252:37203
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424853995437-27391-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.26.191.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16449
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424853995437-27391-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:10:24.333529 16449 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:10:24.333779 16449 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:10:24.339077 16458 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:10:24.339079 16457 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:10:24.339107 16463 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:10:24.339164 16449 server_base.cc:1034] running on GCE node
I20260811 05:10:24.339704 16449 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:10:24.339969 16449 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:10:24.341113 16449 hybrid_clock.cc:648] HybridClock initialized: now 1786425024341099 us; error 33 us; skew 500 ppm
Aug 11 05:10:24 dist-test-slave-x5fp krb5kdc[16167](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425024, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:10:24.343775 16449 init.cc:377] Logged in from keytab as kudu/127.26.191.252@KRBTEST.COM (short username kudu)
I20260811 05:10:24.344265 16449 webserver.cc:460] Webserver started at http://127.26.191.252:35833/ using document root <none> and password file <none>
I20260811 05:10:24.344504 16449 fs_manager.cc:359] Metadata directory not provided
I20260811 05:10:24.344550 16449 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:10:24.344712 16449 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:10:24.345871 16449 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424853995437-27391-0/minicluster-data/master-2/data/instance:
uuid: "4f8e2249bb0a4630a1fe728dd093a383"
format_stamp: "Formatted at 2026-08-11 05:10:24 on dist-test-slave-x5fp"
server_key: "c4d30224bcb7f86ef6f903455ea4f153"
server_key_iv: "2d2f2dd278ad35abc11cc2af8b998639"
server_key_version: "encryptionkey@0"
I20260811 05:10:24.346247 16449 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424853995437-27391-0/minicluster-data/master-2/wal/instance:
uuid: "4f8e2249bb0a4630a1fe728dd093a383"
format_stamp: "Formatted at 2026-08-11 05:10:24 on dist-test-slave-x5fp"
server_key: "c4d30224bcb7f86ef6f903455ea4f153"
server_key_iv: "2d2f2dd278ad35abc11cc2af8b998639"
server_key_version: "encryptionkey@0"
I20260811 05:10:24.347643 16449 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 05:10:24.348472 16477 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:10:24.348811 16449 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 05:10:24.348925 16449 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424853995437-27391-0/minicluster-data/master-2/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424853995437-27391-0/minicluster-data/master-2/wal
uuid: "4f8e2249bb0a4630a1fe728dd093a383"
format_stamp: "Formatted at 2026-08-11 05:10:24 on dist-test-slave-x5fp"
server_key: "c4d30224bcb7f86ef6f903455ea4f153"
server_key_iv: "2d2f2dd278ad35abc11cc2af8b998639"
server_key_version: "encryptionkey@0"
I20260811 05:10:24.349014 16449 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424853995437-27391-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424853995437-27391-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424853995437-27391-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:10:24.352473 16437 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.191.252" port: 37203 } attempt: 2
I20260811 05:10:24.352921 16444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:24.352802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.252:37203 (local address 127.0.0.1:51216)
0811 05:10:24.352853 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:24.352893 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.252:37203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260811 05:10:24.353267 16444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:24.353174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.252:37203 (local address 127.0.0.1:51232)
0811 05:10:24.353215 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:24.353242 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.252:37203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260811 05:10:24.353345 16437 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.191.252:37203: Network error: Client connection negotiation failed: client connection to 127.26.191.252:37203: connect: Connection refused (error 111)
I20260811 05:10:24.370002 16449 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:10:24.372514 16449 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:10:24.372766 16449 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:10:24.374581 16299 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.191.252" port: 37203 } attempt: 2
I20260811 05:10:24.375062 16307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:24.374899 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.252:37203 (local address 127.0.0.1:51236)
0811 05:10:24.374962 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:24.375016 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.252:37203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260811 05:10:24.375474 16307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:24.375330 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.252:37203 (local address 127.0.0.1:51250)
0811 05:10:24.375401 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:24.375435 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.252:37203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260811 05:10:24.375566 16299 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.191.252:37203: Network error: Client connection negotiation failed: client connection to 127.26.191.252:37203: connect: Connection refused (error 111)
I20260811 05:10:24.377799 16449 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.252:37203
I20260811 05:10:24.377840 16559 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.252:37203 every 8 connection(s)
I20260811 05:10:24.378245 16449 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424853995437-27391-0/minicluster-data/master-2/data/info.pb
I20260811 05:10:24.379343 16560 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:10:24.381175 16560 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.191.254" port: 33881 } has no permanent_uuid. Determining permanent_uuid...
I20260811 05:10:24.386942 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 16449
I20260811 05:10:24.387054 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424853995437-27391-0/minicluster-data/master-2/wal/instance
I20260811 05:10:24.387279 27391 external_mini_cluster.cc:1428] Setting key eef9280e969dd244dcd3296f748edb79
Aug 11 05:10:24 dist-test-slave-x5fp krb5kdc[16167](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425024, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.252@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
I20260811 05:10:24.392263 16305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:24.381980 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43620 (local address 127.26.191.254:33881)
0811 05:10:24.382075 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0811 05:10:24.382077 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:10:24.382307 (+ 230us) server_negotiation.cc:407] Connection header received
0811 05:10:24.382908 (+ 601us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:10:24.382909 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:10:24.382919 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:10:24.382975 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:10:24.383681 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:24.384248 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:24.385534 (+ 1286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:24.385773 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:24.385887 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:24.389141 (+ 3254us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:10:24.389143 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:10:24.389143 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:10:24.389152 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:10:24.390721 (+ 1569us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:10:24.391179 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:10:24.391181 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:10:24.391182 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:10:24.391272 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:10:24.391553 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:10:24.391554 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:10:24.391554 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:10:24.391677 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:10:24.391751 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 05:10:24.392052 (+ 301us) server_negotiation.cc:299] Negotiation successful
0811 05:10:24.392155 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 05:10:24.392443 16564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:24.381939 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:33881 (local address 127.0.0.1:43620)
0811 05:10:24.382138 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:24.382179 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 05:10:24.382767 (+ 588us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:10:24.383044 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:10:24.383049 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:10:24.383346 (+ 297us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:10:24.383565 (+ 219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:10:24.383571 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:10:24.384389 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:10:24.384390 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:10:24.385400 (+ 1010us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:10:24.385403 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:10:24.386020 (+ 617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:10:24.386021 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:10:24.386147 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:24.387085 (+ 938us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:10:24.387098 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:10:24.389051 (+ 1953us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:10:24.390836 (+ 1785us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:10:24.390843 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:10:24.390846 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:10:24.391097 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:10:24.391336 (+ 239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:10:24.391337 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:10:24.391338 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:10:24.391474 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:10:24.391744 (+ 270us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:10:24.391751 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:10:24.391909 (+ 158us) client_negotiation.cc:769] Sending connection context
0811 05:10:24.392016 (+ 107us) client_negotiation.cc:240] Negotiation successful
0811 05:10:24.392181 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":107,"threads_started":1}
I20260811 05:10:24.393082 16560 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.191.253" port: 40975 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 05:10:24 dist-test-slave-x5fp krb5kdc[16167](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425023, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.191.252@KRBTEST.COM
Aug 11 05:10:24 dist-test-slave-x5fp krb5kdc[16167](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425024, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.252@KRBTEST.COM for kudu/127.26.191.253@KRBTEST.COM
I20260811 05:10:24.397701 16566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:24.387880 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51266 (local address 127.26.191.252:37203)
0811 05:10:24.388103 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0811 05:10:24.388108 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:10:24.388137 (+ 29us) server_negotiation.cc:407] Connection header received
0811 05:10:24.388181 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:10:24.388183 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:10:24.388208 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:10:24.388298 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:10:24.389038 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:24.390161 (+ 1123us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:24.390975 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:24.391397 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:24.391483 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:24.394430 (+ 2947us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:10:24.394439 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:10:24.394440 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:10:24.394447 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:10:24.396218 (+ 1771us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:10:24.396642 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:10:24.396646 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:10:24.396646 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:10:24.396785 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:10:24.397012 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:10:24.397013 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:10:24.397013 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:10:24.397204 (+ 191us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:10:24.397414 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0811 05:10:24.397466 (+ 52us) server_negotiation.cc:299] Negotiation successful
0811 05:10:24.397550 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":181,"thread_start_us":125,"threads_started":1}
I20260811 05:10:24.401024 16564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:24.393366 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.253:40975 (local address 127.0.0.1:46074)
0811 05:10:24.393851 (+ 485us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:24.393867 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 05:10:24.393966 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:10:24.394098 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:10:24.394099 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:10:24.394240 (+ 141us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:10:24.394289 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:10:24.394290 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:10:24.395087 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:10:24.395088 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:10:24.395758 (+ 670us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:10:24.395761 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:10:24.396148 (+ 387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:10:24.396149 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:10:24.396224 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:24.396636 (+ 412us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:10:24.396641 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:10:24.397927 (+ 1286us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:10:24.399887 (+ 1960us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:10:24.399888 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:10:24.399889 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:10:24.400078 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:10:24.400307 (+ 229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:10:24.400308 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:10:24.400309 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:10:24.400372 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:10:24.400648 (+ 276us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:10:24.400649 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:10:24.400705 (+ 56us) client_negotiation.cc:769] Sending connection context
0811 05:10:24.400812 (+ 107us) client_negotiation.cc:240] Negotiation successful
0811 05:10:24.400918 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":465}
I20260811 05:10:24.401024 16446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:24.393459 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46074 (local address 127.26.191.253:40975)
0811 05:10:24.393506 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 05:10:24.393509 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:10:24.393954 (+ 445us) server_negotiation.cc:407] Connection header received
0811 05:10:24.394024 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:10:24.394025 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:10:24.394037 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:10:24.394094 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:10:24.394365 (+ 271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:24.394981 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:24.395874 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:24.396076 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:24.396153 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:24.398044 (+ 1891us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:10:24.398046 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:10:24.398047 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:10:24.398056 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:10:24.399773 (+ 1717us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:10:24.400158 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:10:24.400160 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:10:24.400161 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:10:24.400236 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:10:24.400447 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:10:24.400448 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:10:24.400448 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:10:24.400575 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:10:24.400656 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 05:10:24.400839 (+ 183us) server_negotiation.cc:299] Negotiation successful
0811 05:10:24.400920 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 05:10:24.401546 16560 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.191.252" port: 37203 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 05:10:24 dist-test-slave-x5fp krb5kdc[16167](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425023, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
Aug 11 05:10:24 dist-test-slave-x5fp krb5kdc[16167](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425024, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.252@KRBTEST.COM for kudu/127.26.191.252@KRBTEST.COM
I20260811 05:10:24.406730 16305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:24.398622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43622 (local address 127.26.191.254:33881)
0811 05:10:24.398684 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 05:10:24.398685 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 05:10:24.398693 (+ 8us) server_negotiation.cc:407] Connection header received
0811 05:10:24.398715 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:10:24.398715 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:10:24.398725 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:10:24.398792 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:10:24.399287 (+ 495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:24.399748 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:24.400421 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:24.400638 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:24.400744 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:24.403187 (+ 2443us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:10:24.403188 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:10:24.403188 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:10:24.403195 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:10:24.405173 (+ 1978us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:10:24.405658 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:10:24.405659 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:10:24.405659 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:10:24.405716 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:10:24.405966 (+ 250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:10:24.405968 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:10:24.405968 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:10:24.406133 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:10:24.406341 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0811 05:10:24.406384 (+ 43us) server_negotiation.cc:299] Negotiation successful
0811 05:10:24.406606 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 05:10:24.409333 16566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:24.401900 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51278 (local address 127.26.191.252:37203)
0811 05:10:24.401938 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 05:10:24.401941 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:10:24.401958 (+ 17us) server_negotiation.cc:407] Connection header received
0811 05:10:24.401978 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:10:24.401979 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:10:24.401989 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:10:24.402050 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:10:24.402306 (+ 256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:24.402863 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:24.403705 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:24.404087 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:24.404152 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:24.406365 (+ 2213us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:10:24.406366 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:10:24.406366 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:10:24.406373 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:10:24.408158 (+ 1785us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:10:24.408481 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:10:24.408482 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:10:24.408483 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:10:24.408549 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:10:24.408765 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:10:24.408765 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:10:24.408766 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:10:24.408908 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:10:24.408963 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 05:10:24.409125 (+ 162us) server_negotiation.cc:299] Negotiation successful
0811 05:10:24.409251 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":57,"server-negotiator.queue_time_us":22}
I20260811 05:10:24.409324 16564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:24.401830 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.252:37203 (local address 127.0.0.1:51278)
0811 05:10:24.401880 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:24.401891 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 05:10:24.401932 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:10:24.402050 (+ 118us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:10:24.402051 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:10:24.402200 (+ 149us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:10:24.402229 (+ 29us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:10:24.402230 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:10:24.402970 (+ 740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:10:24.402971 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:10:24.403602 (+ 631us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:10:24.403604 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:10:24.404188 (+ 584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:10:24.404189 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:10:24.404263 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:24.404753 (+ 490us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:10:24.404759 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:10:24.406273 (+ 1514us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:10:24.408239 (+ 1966us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:10:24.408239 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:10:24.408240 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:10:24.408413 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:10:24.408618 (+ 205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:10:24.408619 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:10:24.408619 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:10:24.408676 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:10:24.408974 (+ 298us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:10:24.408975 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:10:24.409021 (+ 46us) client_negotiation.cc:769] Sending connection context
0811 05:10:24.409098 (+ 77us) client_negotiation.cc:240] Negotiation successful
0811 05:10:24.409204 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260811 05:10:24.411036 16560 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4f8e2249bb0a4630a1fe728dd093a383: Bootstrap starting.
Aug 11 05:10:24 dist-test-slave-x5fp krb5kdc[16167](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425023, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.191.253@KRBTEST.COM
I20260811 05:10:24.412019 16560 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4f8e2249bb0a4630a1fe728dd093a383: Neither blocks nor log segments found. Creating new log.
I20260811 05:10:24.412369 16560 log.cc:824] T 00000000000000000000000000000000 P 4f8e2249bb0a4630a1fe728dd093a383: Log is configured to *not* fsync() on all Append() calls
I20260811 05:10:24.413239 16560 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4f8e2249bb0a4630a1fe728dd093a383: No bootstrap required, opened a new log
I20260811 05:10:24.415409 16446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:24.407487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46086 (local address 127.26.191.253:40975)
0811 05:10:24.407529 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 05:10:24.407531 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:10:24.407541 (+ 10us) server_negotiation.cc:407] Connection header received
0811 05:10:24.407567 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:10:24.407568 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:10:24.407580 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:10:24.407650 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:10:24.408106 (+ 456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:24.408804 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:24.409784 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:24.410083 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:24.410121 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:24.412463 (+ 2342us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:10:24.412465 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:10:24.412465 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:10:24.412474 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:10:24.414201 (+ 1727us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:10:24.414536 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:10:24.414537 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:10:24.414538 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:10:24.414608 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:10:24.414802 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:10:24.414803 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:10:24.414803 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:10:24.414959 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:10:24.415139 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0811 05:10:24.415218 (+ 79us) server_negotiation.cc:299] Negotiation successful
0811 05:10:24.415308 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 05:10:24.415591 16560 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4f8e2249bb0a4630a1fe728dd093a383 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f8af509c9b2495ca39d42b9a9f14da1" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 33881 } } peers { permanent_uuid: "7d876568aeb14bc28b7078663625953a" member_type: VOTER last_known_addr { host: "127.26.191.253" port: 40975 } } peers { permanent_uuid: "4f8e2249bb0a4630a1fe728dd093a383" member_type: VOTER last_known_addr { host: "127.26.191.252" port: 37203 } }
I20260811 05:10:24.415777 16560 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4f8e2249bb0a4630a1fe728dd093a383 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:10:24.415833 16560 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4f8e2249bb0a4630a1fe728dd093a383 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f8e2249bb0a4630a1fe728dd093a383, State: Initialized, Role: FOLLOWER
I20260811 05:10:24.415977 16560 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4f8e2249bb0a4630a1fe728dd093a383 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f8af509c9b2495ca39d42b9a9f14da1" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 33881 } } peers { permanent_uuid: "7d876568aeb14bc28b7078663625953a" member_type: VOTER last_known_addr { host: "127.26.191.253" port: 40975 } } peers { permanent_uuid: "4f8e2249bb0a4630a1fe728dd093a383" member_type: VOTER last_known_addr { host: "127.26.191.252" port: 37203 } }
I20260811 05:10:24.416265 16568 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4f8e2249bb0a4630a1fe728dd093a383 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f8af509c9b2495ca39d42b9a9f14da1" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 33881 } } peers { permanent_uuid: "7d876568aeb14bc28b7078663625953a" member_type: VOTER last_known_addr { host: "127.26.191.253" port: 40975 } } peers { permanent_uuid: "4f8e2249bb0a4630a1fe728dd093a383" member_type: VOTER last_known_addr { host: "127.26.191.252" port: 37203 } } }
I20260811 05:10:24.416337 16560 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4f8e2249bb0a4630a1fe728dd093a383 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:10:24.416348 16568 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4f8e2249bb0a4630a1fe728dd093a383 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 05:10:24.417146 27391 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260811 05:10:24.418617 16584 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 4f8e2249bb0a4630a1fe728dd093a383: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 05:10:24.418756 16584 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 05:10:24.418706 16449 master_runner.cc:186] Error getting master registration for 127.26.191.254:33881: OK, instance_id { permanent_uuid: "0f8af509c9b2495ca39d42b9a9f14da1" instance_seqno: 1786425024025048 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 05:10:24.421584 16449 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 05:10:24.427876 16566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:24.418974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51290 (local address 127.26.191.252:37203)
0811 05:10:24.419030 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 05:10:24.419033 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:10:24.419102 (+ 69us) server_negotiation.cc:407] Connection header received
0811 05:10:24.419187 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:10:24.419188 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:10:24.419199 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:10:24.419267 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:10:24.420026 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:24.421803 (+ 1777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:24.422858 (+ 1055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:24.423154 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:24.423192 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:24.424668 (+ 1476us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:10:24.424669 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:10:24.424670 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:10:24.424677 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:10:24.426420 (+ 1743us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:10:24.426840 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:10:24.426841 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:10:24.426842 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:10:24.426906 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:10:24.427136 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:10:24.427137 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:10:24.427138 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:10:24.427338 (+ 200us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:10:24.427443 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0811 05:10:24.427654 (+ 211us) server_negotiation.cc:299] Negotiation successful
0811 05:10:24.427740 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 05:10:24.429291 16446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:24.419114 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46098 (local address 127.26.191.253:40975)
0811 05:10:24.419183 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 05:10:24.419185 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:10:24.421801 (+ 2616us) server_negotiation.cc:407] Connection header received
0811 05:10:24.421833 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:10:24.421834 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:10:24.421848 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:10:24.421904 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:10:24.422618 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:24.423309 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:24.424320 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:24.424635 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:24.424675 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:24.426294 (+ 1619us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:10:24.426296 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:10:24.426296 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:10:24.426304 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:10:24.427967 (+ 1663us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:10:24.428361 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:10:24.428363 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:10:24.428363 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:10:24.428426 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:10:24.428618 (+ 192us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:10:24.428619 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:10:24.428619 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:10:24.428789 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:10:24.428887 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0811 05:10:24.429080 (+ 193us) server_negotiation.cc:299] Negotiation successful
0811 05:10:24.429165 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 05:10:24.429800 16305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:24.419069 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43632 (local address 127.26.191.254:33881)
0811 05:10:24.419154 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0811 05:10:24.419156 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:10:24.419275 (+ 119us) server_negotiation.cc:407] Connection header received
0811 05:10:24.419362 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:10:24.419363 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:10:24.419376 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:10:24.419433 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:10:24.420326 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:24.421072 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:24.422150 (+ 1078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:24.422426 (+ 276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:24.422472 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:24.424477 (+ 2005us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:10:24.424479 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:10:24.424479 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:10:24.424486 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:10:24.427463 (+ 2977us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:10:24.427884 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:10:24.427885 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:10:24.427885 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:10:24.427959 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:10:24.428692 (+ 733us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:10:24.428693 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:10:24.428693 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:10:24.428888 (+ 195us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:10:24.428977 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 05:10:24.429661 (+ 684us) server_negotiation.cc:299] Negotiation successful
0811 05:10:24.429733 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260811 05:10:24.444490 16437 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.191.252" port: 37203 } attempt: 3
Aug 11 05:10:24 dist-test-slave-x5fp krb5kdc[16167](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425024, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.253@KRBTEST.COM for kudu/127.26.191.252@KRBTEST.COM
I20260811 05:10:24.452265 16566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:24.444952 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51296 (local address 127.26.191.252:37203)
0811 05:10:24.445021 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 05:10:24.445023 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:10:24.445032 (+ 9us) server_negotiation.cc:407] Connection header received
0811 05:10:24.445059 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:10:24.445060 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:10:24.445070 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:10:24.445148 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:10:24.445459 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:24.445949 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:24.446893 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:24.447084 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:24.447155 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:24.449361 (+ 2206us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:10:24.449363 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:10:24.449364 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:10:24.449374 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:10:24.450854 (+ 1480us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:10:24.451367 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:10:24.451368 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:10:24.451369 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:10:24.451439 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:10:24.451652 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:10:24.451654 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:10:24.451654 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:10:24.451821 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:10:24.451902 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 05:10:24.452079 (+ 177us) server_negotiation.cc:299] Negotiation successful
0811 05:10:24.452161 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 05:10:24.452265 16444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:24.444872 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.252:37203 (local address 127.0.0.1:51296)
0811 05:10:24.444928 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:24.444942 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 05:10:24.445004 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:10:24.445152 (+ 148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:10:24.445153 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:10:24.445331 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:10:24.445379 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:10:24.445381 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:10:24.446039 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:10:24.446040 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:10:24.446806 (+ 766us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:10:24.446809 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:10:24.447152 (+ 343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:10:24.447153 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:10:24.447209 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:24.447736 (+ 527us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:10:24.447741 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:10:24.449245 (+ 1504us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:10:24.450984 (+ 1739us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:10:24.450985 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:10:24.450986 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:10:24.451257 (+ 271us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:10:24.451510 (+ 253us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:10:24.451511 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:10:24.451511 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:10:24.451578 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:10:24.451905 (+ 327us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:10:24.451907 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:10:24.451961 (+ 54us) client_negotiation.cc:769] Sending connection context
0811 05:10:24.452034 (+ 73us) client_negotiation.cc:240] Negotiation successful
0811 05:10:24.452154 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260811 05:10:24.454195 16437 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7d876568aeb14bc28b7078663625953a: Bootstrap starting.
I20260811 05:10:24.455027 16437 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7d876568aeb14bc28b7078663625953a: Neither blocks nor log segments found. Creating new log.
I20260811 05:10:24.455360 16437 log.cc:824] T 00000000000000000000000000000000 P 7d876568aeb14bc28b7078663625953a: Log is configured to *not* fsync() on all Append() calls
I20260811 05:10:24.456353 16437 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7d876568aeb14bc28b7078663625953a: No bootstrap required, opened a new log
I20260811 05:10:24.458483 16437 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7d876568aeb14bc28b7078663625953a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f8af509c9b2495ca39d42b9a9f14da1" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 33881 } } peers { permanent_uuid: "7d876568aeb14bc28b7078663625953a" member_type: VOTER last_known_addr { host: "127.26.191.253" port: 40975 } } peers { permanent_uuid: "4f8e2249bb0a4630a1fe728dd093a383" member_type: VOTER last_known_addr { host: "127.26.191.252" port: 37203 } }
I20260811 05:10:24.458642 16437 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7d876568aeb14bc28b7078663625953a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:10:24.458679 16437 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7d876568aeb14bc28b7078663625953a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d876568aeb14bc28b7078663625953a, State: Initialized, Role: FOLLOWER
I20260811 05:10:24.458811 16437 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7d876568aeb14bc28b7078663625953a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f8af509c9b2495ca39d42b9a9f14da1" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 33881 } } peers { permanent_uuid: "7d876568aeb14bc28b7078663625953a" member_type: VOTER last_known_addr { host: "127.26.191.253" port: 40975 } } peers { permanent_uuid: "4f8e2249bb0a4630a1fe728dd093a383" member_type: VOTER last_known_addr { host: "127.26.191.252" port: 37203 } }
I20260811 05:10:24.459165 16437 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7d876568aeb14bc28b7078663625953a [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:10:24.459133 16599 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7d876568aeb14bc28b7078663625953a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f8af509c9b2495ca39d42b9a9f14da1" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 33881 } } peers { permanent_uuid: "7d876568aeb14bc28b7078663625953a" member_type: VOTER last_known_addr { host: "127.26.191.253" port: 40975 } } peers { permanent_uuid: "4f8e2249bb0a4630a1fe728dd093a383" member_type: VOTER last_known_addr { host: "127.26.191.252" port: 37203 } } }
I20260811 05:10:24.459283 16599 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7d876568aeb14bc28b7078663625953a [sys.catalog]: This master's current role is: FOLLOWER
W20260811 05:10:24.461357 16617 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 7d876568aeb14bc28b7078663625953a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 05:10:24.461443 16617 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 05:10:24.461781 16311 master_runner.cc:186] Error getting master registration for 127.26.191.254:33881: OK, instance_id { permanent_uuid: "0f8af509c9b2495ca39d42b9a9f14da1" instance_seqno: 1786425024025048 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 05:10:24.464203 16311 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 05:10:24.474860 16299 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.191.252" port: 37203 } attempt: 3
Aug 11 05:10:24 dist-test-slave-x5fp krb5kdc[16167](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425023, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.254@KRBTEST.COM for kudu/127.26.191.252@KRBTEST.COM
I20260811 05:10:24.482115 16566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:24.475275 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51306 (local address 127.26.191.252:37203)
0811 05:10:24.475348 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0811 05:10:24.475351 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:10:24.475361 (+ 10us) server_negotiation.cc:407] Connection header received
0811 05:10:24.475418 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:10:24.475419 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:10:24.475429 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:10:24.475496 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:10:24.475847 (+ 351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:24.476343 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:24.477124 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:24.477317 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:24.477418 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:24.479415 (+ 1997us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:10:24.479417 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:10:24.479418 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:10:24.479425 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:10:24.480912 (+ 1487us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:10:24.481280 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:10:24.481281 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:10:24.481282 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:10:24.481344 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:10:24.481541 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:10:24.481542 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:10:24.481543 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:10:24.481703 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:10:24.481773 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 05:10:24.481940 (+ 167us) server_negotiation.cc:299] Negotiation successful
0811 05:10:24.482019 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 05:10:24.482115 16307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:24.475233 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.252:37203 (local address 127.0.0.1:51306)
0811 05:10:24.475291 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:24.475304 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 05:10:24.475351 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:10:24.475522 (+ 171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:10:24.475524 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:10:24.475709 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:10:24.475758 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:10:24.475760 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:10:24.476439 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:10:24.476444 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:10:24.477012 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:10:24.477014 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:10:24.477405 (+ 391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:10:24.477407 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:10:24.477465 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:24.477980 (+ 515us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:10:24.477986 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:10:24.479325 (+ 1339us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:10:24.481010 (+ 1685us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:10:24.481012 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:10:24.481012 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:10:24.481198 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:10:24.481415 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:10:24.481416 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:10:24.481416 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:10:24.481479 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:10:24.481776 (+ 297us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:10:24.481777 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:10:24.481827 (+ 50us) client_negotiation.cc:769] Sending connection context
0811 05:10:24.481901 (+ 74us) client_negotiation.cc:240] Negotiation successful
0811 05:10:24.482008 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36}
I20260811 05:10:24.484201 16299 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0f8af509c9b2495ca39d42b9a9f14da1: Bootstrap starting.
I20260811 05:10:24.484954 16299 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0f8af509c9b2495ca39d42b9a9f14da1: Neither blocks nor log segments found. Creating new log.
I20260811 05:10:24.485280 16299 log.cc:824] T 00000000000000000000000000000000 P 0f8af509c9b2495ca39d42b9a9f14da1: Log is configured to *not* fsync() on all Append() calls
I20260811 05:10:24.486060 16299 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0f8af509c9b2495ca39d42b9a9f14da1: No bootstrap required, opened a new log
I20260811 05:10:24.487517 16299 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0f8af509c9b2495ca39d42b9a9f14da1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f8af509c9b2495ca39d42b9a9f14da1" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 33881 } } peers { permanent_uuid: "7d876568aeb14bc28b7078663625953a" member_type: VOTER last_known_addr { host: "127.26.191.253" port: 40975 } } peers { permanent_uuid: "4f8e2249bb0a4630a1fe728dd093a383" member_type: VOTER last_known_addr { host: "127.26.191.252" port: 37203 } }
I20260811 05:10:24.487661 16299 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0f8af509c9b2495ca39d42b9a9f14da1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:10:24.487707 16299 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0f8af509c9b2495ca39d42b9a9f14da1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f8af509c9b2495ca39d42b9a9f14da1, State: Initialized, Role: FOLLOWER
I20260811 05:10:24.487867 16299 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0f8af509c9b2495ca39d42b9a9f14da1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f8af509c9b2495ca39d42b9a9f14da1" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 33881 } } peers { permanent_uuid: "7d876568aeb14bc28b7078663625953a" member_type: VOTER last_known_addr { host: "127.26.191.253" port: 40975 } } peers { permanent_uuid: "4f8e2249bb0a4630a1fe728dd093a383" member_type: VOTER last_known_addr { host: "127.26.191.252" port: 37203 } }
I20260811 05:10:24.488176 16621 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f8af509c9b2495ca39d42b9a9f14da1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f8af509c9b2495ca39d42b9a9f14da1" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 33881 } } peers { permanent_uuid: "7d876568aeb14bc28b7078663625953a" member_type: VOTER last_known_addr { host: "127.26.191.253" port: 40975 } } peers { permanent_uuid: "4f8e2249bb0a4630a1fe728dd093a383" member_type: VOTER last_known_addr { host: "127.26.191.252" port: 37203 } } }
I20260811 05:10:24.488246 16299 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0f8af509c9b2495ca39d42b9a9f14da1 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:10:24.488332 16621 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f8af509c9b2495ca39d42b9a9f14da1 [sys.catalog]: This master's current role is: FOLLOWER
W20260811 05:10:24.490221 16636 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 0f8af509c9b2495ca39d42b9a9f14da1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 05:10:24.490343 16636 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 05:10:24.493055 16184 master_runner.cc:263] No leader master found from master 0f8af509c9b2495ca39d42b9a9f14da1
I20260811 05:10:24.493117 16184 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260811 05:10:24.523105 16215 tablet.cc:2369] T 00000000000000000000000000000000 P 0f8af509c9b2495ca39d42b9a9f14da1: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 05:10:24.623584 16485 tablet.cc:2369] T 00000000000000000000000000000000 P 4f8e2249bb0a4630a1fe728dd093a383: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 05:10:24.703634 16357 tablet.cc:2369] T 00000000000000000000000000000000 P 7d876568aeb14bc28b7078663625953a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 05:10:24.773603 16568 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4f8e2249bb0a4630a1fe728dd093a383 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 05:10:24.773768 16568 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4f8e2249bb0a4630a1fe728dd093a383 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f8af509c9b2495ca39d42b9a9f14da1" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 33881 } } peers { permanent_uuid: "7d876568aeb14bc28b7078663625953a" member_type: VOTER last_known_addr { host: "127.26.191.253" port: 40975 } } peers { permanent_uuid: "4f8e2249bb0a4630a1fe728dd093a383" member_type: VOTER last_known_addr { host: "127.26.191.252" port: 37203 } }
I20260811 05:10:24.774088 16568 leader_election.cc:288] T 00000000000000000000000000000000 P 4f8e2249bb0a4630a1fe728dd093a383 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f8af509c9b2495ca39d42b9a9f14da1 (127.26.191.254:33881), 7d876568aeb14bc28b7078663625953a (127.26.191.253:40975)
I20260811 05:10:24.774583 16252 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4f8e2249bb0a4630a1fe728dd093a383" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f8af509c9b2495ca39d42b9a9f14da1" is_pre_election: true
I20260811 05:10:24.774583 16390 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4f8e2249bb0a4630a1fe728dd093a383" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d876568aeb14bc28b7078663625953a" is_pre_election: true
I20260811 05:10:24.774784 16390 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 7d876568aeb14bc28b7078663625953a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f8e2249bb0a4630a1fe728dd093a383 in term 0.
I20260811 05:10:24.774806 16252 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 0f8af509c9b2495ca39d42b9a9f14da1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f8e2249bb0a4630a1fe728dd093a383 in term 0.
I20260811 05:10:24.775027 16478 leader_election.cc:302] T 00000000000000000000000000000000 P 4f8e2249bb0a4630a1fe728dd093a383 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f8e2249bb0a4630a1fe728dd093a383, 7d876568aeb14bc28b7078663625953a; no voters:
I20260811 05:10:24.775192 16568 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4f8e2249bb0a4630a1fe728dd093a383 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 05:10:24.775281 16568 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4f8e2249bb0a4630a1fe728dd093a383 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 05:10:24.775334 16568 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4f8e2249bb0a4630a1fe728dd093a383 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:10:24.776330 16568 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4f8e2249bb0a4630a1fe728dd093a383 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f8af509c9b2495ca39d42b9a9f14da1" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 33881 } } peers { permanent_uuid: "7d876568aeb14bc28b7078663625953a" member_type: VOTER last_known_addr { host: "127.26.191.253" port: 40975 } } peers { permanent_uuid: "4f8e2249bb0a4630a1fe728dd093a383" member_type: VOTER last_known_addr { host: "127.26.191.252" port: 37203 } }
I20260811 05:10:24.776505 16568 leader_election.cc:288] T 00000000000000000000000000000000 P 4f8e2249bb0a4630a1fe728dd093a383 [CANDIDATE]: Term 1 election: Requested vote from peers 0f8af509c9b2495ca39d42b9a9f14da1 (127.26.191.254:33881), 7d876568aeb14bc28b7078663625953a (127.26.191.253:40975)
I20260811 05:10:24.776667 16390 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4f8e2249bb0a4630a1fe728dd093a383" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d876568aeb14bc28b7078663625953a"
I20260811 05:10:24.776687 16252 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4f8e2249bb0a4630a1fe728dd093a383" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f8af509c9b2495ca39d42b9a9f14da1"
I20260811 05:10:24.776816 16252 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0f8af509c9b2495ca39d42b9a9f14da1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:10:24.776816 16390 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7d876568aeb14bc28b7078663625953a [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:10:24.777566 16390 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 7d876568aeb14bc28b7078663625953a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f8e2249bb0a4630a1fe728dd093a383 in term 1.
I20260811 05:10:24.777702 16252 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 0f8af509c9b2495ca39d42b9a9f14da1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f8e2249bb0a4630a1fe728dd093a383 in term 1.
I20260811 05:10:24.777743 16478 leader_election.cc:302] T 00000000000000000000000000000000 P 4f8e2249bb0a4630a1fe728dd093a383 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f8e2249bb0a4630a1fe728dd093a383, 7d876568aeb14bc28b7078663625953a; no voters:
I20260811 05:10:24.777843 16568 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4f8e2249bb0a4630a1fe728dd093a383 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:10:24.777977 16568 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4f8e2249bb0a4630a1fe728dd093a383 [term 1 LEADER]: Becoming Leader. State: Replica: 4f8e2249bb0a4630a1fe728dd093a383, State: Running, Role: LEADER
I20260811 05:10:24.778086 16568 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4f8e2249bb0a4630a1fe728dd093a383 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f8af509c9b2495ca39d42b9a9f14da1" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 33881 } } peers { permanent_uuid: "7d876568aeb14bc28b7078663625953a" member_type: VOTER last_known_addr { host: "127.26.191.253" port: 40975 } } peers { permanent_uuid: "4f8e2249bb0a4630a1fe728dd093a383" member_type: VOTER last_known_addr { host: "127.26.191.252" port: 37203 } }
I20260811 05:10:24.778535 16638 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4f8e2249bb0a4630a1fe728dd093a383 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4f8e2249bb0a4630a1fe728dd093a383. Latest consensus state: current_term: 1 leader_uuid: "4f8e2249bb0a4630a1fe728dd093a383" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f8af509c9b2495ca39d42b9a9f14da1" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 33881 } } peers { permanent_uuid: "7d876568aeb14bc28b7078663625953a" member_type: VOTER last_known_addr { host: "127.26.191.253" port: 40975 } } peers { permanent_uuid: "4f8e2249bb0a4630a1fe728dd093a383" member_type: VOTER last_known_addr { host: "127.26.191.252" port: 37203 } } }
I20260811 05:10:24.778640 16638 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4f8e2249bb0a4630a1fe728dd093a383 [sys.catalog]: This master's current role is: LEADER
I20260811 05:10:24.778846 16640 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:10:24.779054 16640 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:10:24.780486 16252 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 0f8af509c9b2495ca39d42b9a9f14da1 [term 1 FOLLOWER]: Refusing update from remote peer 4f8e2249bb0a4630a1fe728dd093a383: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:10:24.780491 16390 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 7d876568aeb14bc28b7078663625953a [term 1 FOLLOWER]: Refusing update from remote peer 4f8e2249bb0a4630a1fe728dd093a383: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:10:24.780834 16568 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 4f8e2249bb0a4630a1fe728dd093a383 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f8af509c9b2495ca39d42b9a9f14da1" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:10:24.780941 16638 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 4f8e2249bb0a4630a1fe728dd093a383 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d876568aeb14bc28b7078663625953a" member_type: VOTER last_known_addr { host: "127.26.191.253" port: 40975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:10:24.782198 16599 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7d876568aeb14bc28b7078663625953a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4f8e2249bb0a4630a1fe728dd093a383. Latest consensus state: current_term: 1 leader_uuid: "4f8e2249bb0a4630a1fe728dd093a383" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f8af509c9b2495ca39d42b9a9f14da1" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 33881 } } peers { permanent_uuid: "7d876568aeb14bc28b7078663625953a" member_type: VOTER last_known_addr { host: "127.26.191.253" port: 40975 } } peers { permanent_uuid: "4f8e2249bb0a4630a1fe728dd093a383" member_type: VOTER last_known_addr { host: "127.26.191.252" port: 37203 } } }
I20260811 05:10:24.782308 16599 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7d876568aeb14bc28b7078663625953a [sys.catalog]: This master's current role is: FOLLOWER
I20260811 05:10:24.782289 16621 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f8af509c9b2495ca39d42b9a9f14da1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4f8e2249bb0a4630a1fe728dd093a383. Latest consensus state: current_term: 1 leader_uuid: "4f8e2249bb0a4630a1fe728dd093a383" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f8af509c9b2495ca39d42b9a9f14da1" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 33881 } } peers { permanent_uuid: "7d876568aeb14bc28b7078663625953a" member_type: VOTER last_known_addr { host: "127.26.191.253" port: 40975 } } peers { permanent_uuid: "4f8e2249bb0a4630a1fe728dd093a383" member_type: VOTER last_known_addr { host: "127.26.191.252" port: 37203 } } }
I20260811 05:10:24.782392 16621 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f8af509c9b2495ca39d42b9a9f14da1 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 05:10:24.783226 16568 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4f8e2249bb0a4630a1fe728dd093a383 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "4f8e2249bb0a4630a1fe728dd093a383" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f8af509c9b2495ca39d42b9a9f14da1" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 33881 } } peers { permanent_uuid: "7d876568aeb14bc28b7078663625953a" member_type: VOTER last_known_addr { host: "127.26.191.253" port: 40975 } } peers { permanent_uuid: "4f8e2249bb0a4630a1fe728dd093a383" member_type: VOTER last_known_addr { host: "127.26.191.252" port: 37203 } } }
I20260811 05:10:24.783340 16568 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4f8e2249bb0a4630a1fe728dd093a383 [sys.catalog]: This master's current role is: LEADER
I20260811 05:10:24.783383 16568 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4f8e2249bb0a4630a1fe728dd093a383 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "4f8e2249bb0a4630a1fe728dd093a383" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f8af509c9b2495ca39d42b9a9f14da1" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 33881 } } peers { permanent_uuid: "7d876568aeb14bc28b7078663625953a" member_type: VOTER last_known_addr { host: "127.26.191.253" port: 40975 } } peers { permanent_uuid: "4f8e2249bb0a4630a1fe728dd093a383" member_type: VOTER last_known_addr { host: "127.26.191.252" port: 37203 } } }
I20260811 05:10:24.783428 16568 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4f8e2249bb0a4630a1fe728dd093a383 [sys.catalog]: This master's current role is: LEADER
I20260811 05:10:24.783507 16599 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7d876568aeb14bc28b7078663625953a [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "4f8e2249bb0a4630a1fe728dd093a383" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f8af509c9b2495ca39d42b9a9f14da1" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 33881 } } peers { permanent_uuid: "7d876568aeb14bc28b7078663625953a" member_type: VOTER last_known_addr { host: "127.26.191.253" port: 40975 } } peers { permanent_uuid: "4f8e2249bb0a4630a1fe728dd093a383" member_type: VOTER last_known_addr { host: "127.26.191.252" port: 37203 } } }
I20260811 05:10:24.783605 16599 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7d876568aeb14bc28b7078663625953a [sys.catalog]: This master's current role is: FOLLOWER
I20260811 05:10:24.783604 16640 catalog_manager.cc:1347] Generated new cluster ID: a700c8d9960e4987829ca6f3536a58b4
I20260811 05:10:24.783646 16640 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:10:24.783619 16621 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f8af509c9b2495ca39d42b9a9f14da1 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "4f8e2249bb0a4630a1fe728dd093a383" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f8af509c9b2495ca39d42b9a9f14da1" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 33881 } } peers { permanent_uuid: "7d876568aeb14bc28b7078663625953a" member_type: VOTER last_known_addr { host: "127.26.191.253" port: 40975 } } peers { permanent_uuid: "4f8e2249bb0a4630a1fe728dd093a383" member_type: VOTER last_known_addr { host: "127.26.191.252" port: 37203 } } }
I20260811 05:10:24.783692 16621 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f8af509c9b2495ca39d42b9a9f14da1 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 05:10:24.783875 16642 mvcc.cc:205] Tried to move back new op lower bound from 7317196901498368000 to 7317196901491646464. Current Snapshot: MvccSnapshot[applied={T|T < 7317196901498368000}]
I20260811 05:10:24.783980 16643 mvcc.cc:205] Tried to move back new op lower bound from 7317196901498368000 to 7317196901491646464. Current Snapshot: MvccSnapshot[applied={T|T < 7317196901498368000 or (T in {7317196901498368000})}]
I20260811 05:10:24.797469 16640 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:10:24.798226 16640 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:10:24.804396 16640 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4f8e2249bb0a4630a1fe728dd093a383: Generated new TSK 0
I20260811 05:10:24.804642 16640 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 05:10:25.462020 16617 catalog_manager.cc:1259] Loaded cluster ID: a700c8d9960e4987829ca6f3536a58b4
I20260811 05:10:25.462137 16617 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 7d876568aeb14bc28b7078663625953a: loading cluster ID for follower catalog manager: success
I20260811 05:10:25.463018 16617 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 7d876568aeb14bc28b7078663625953a: acquiring CA information for follower catalog manager: success
I20260811 05:10:25.463303 16617 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 7d876568aeb14bc28b7078663625953a: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 05:10:25.490862 16636 catalog_manager.cc:1259] Loaded cluster ID: a700c8d9960e4987829ca6f3536a58b4
I20260811 05:10:25.490940 16636 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 0f8af509c9b2495ca39d42b9a9f14da1: loading cluster ID for follower catalog manager: success
I20260811 05:10:25.491734 16636 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 0f8af509c9b2495ca39d42b9a9f14da1: acquiring CA information for follower catalog manager: success
I20260811 05:10:25.492051 16636 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 0f8af509c9b2495ca39d42b9a9f14da1: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 05:10:25.876827 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 16184
I20260811 05:10:25.893057 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 16311
I20260811 05:10:25.904965 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 16449
2026-08-11T05:10:25Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (3497 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786424853995437-27391-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 05:10:25 dist-test-slave-x5fp krb5kdc[16664](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 05:10:25 dist-test-slave-x5fp krb5kdc[16664](info): set up 2 sockets
Aug 11 05:10:25 dist-test-slave-x5fp krb5kdc[16664](info): commencing operation
krb5kdc: starting...
W20260811 05:10:27.197749 27391 mini_kdc.cc:121] Time spent starting KDC: real 1.262s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786424853995437-27391-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786424853995437-27391-0/krb5kdc/test-user.keytab.
Aug 11 05:10:27 dist-test-slave-x5fp krb5kdc[16664](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425027, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T05:10:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:10:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.191.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.191.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.191.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab.
Entry for principal kudu/127.26.191.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab.
I20260811 05:10:27.329017 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786424853995437-27391-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786424853995437-27391-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786424853995437-27391-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.254:39617
--webserver_interface=127.26.191.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab
--principal=kudu/127.26.191.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:40395
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.191.254:39617
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:10:27.413797 16684 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:10:27.414054 16684 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:10:27.414098 16684 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:10:27.415340 16684 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:10:27.415408 16684 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:10:27.415433 16684 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:10:27.415455 16684 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:10:27.415483 16684 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:10:27.417032 16684 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:40395
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786424853995437-27391-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786424853995437-27391-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.191.254:39617
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab
--principal=kudu/127.26.191.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.254:39617
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.191.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16684
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786424853995437-27391-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:10:27.417325 16684 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:10:27.417590 16684 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:10:27.422462 16693 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:10:27.422477 16695 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:10:27.422446 16698 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:10:27.422966 16684 server_base.cc:1034] running on GCE node
I20260811 05:10:27.423290 16684 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:10:27.423673 16684 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:10:27.424850 16684 hybrid_clock.cc:648] HybridClock initialized: now 1786425027424822 us; error 41 us; skew 500 ppm
Aug 11 05:10:27 dist-test-slave-x5fp krb5kdc[16664](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425027, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:10:27.427582 16684 init.cc:377] Logged in from keytab as kudu/127.26.191.254@KRBTEST.COM (short username kudu)
I20260811 05:10:27.428090 16684 webserver.cc:460] Webserver started at http://127.26.191.254:46663/ using document root <none> and password file <none>
I20260811 05:10:27.428339 16684 fs_manager.cc:359] Metadata directory not provided
I20260811 05:10:27.428411 16684 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:10:27.428574 16684 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:10:27.429744 16684 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786424853995437-27391-0/minicluster-data/master-0/data/instance:
uuid: "c13871c7dabf40e08845cfcdc4c0f3fe"
format_stamp: "Formatted at 2026-08-11 05:10:27 on dist-test-slave-x5fp"
server_key: "370c2b3f45efde85f64afc19b570f54a"
server_key_iv: "bcf1e30d4519982dc95a8df91fe182a2"
server_key_version: "encryptionkey@0"
I20260811 05:10:27.430140 16684 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786424853995437-27391-0/minicluster-data/master-0/wal/instance:
uuid: "c13871c7dabf40e08845cfcdc4c0f3fe"
format_stamp: "Formatted at 2026-08-11 05:10:27 on dist-test-slave-x5fp"
server_key: "370c2b3f45efde85f64afc19b570f54a"
server_key_iv: "bcf1e30d4519982dc95a8df91fe182a2"
server_key_version: "encryptionkey@0"
I20260811 05:10:27.431576 16684 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 05:10:27.432389 16712 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:10:27.432600 16684 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:10:27.432751 16684 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786424853995437-27391-0/minicluster-data/master-0/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786424853995437-27391-0/minicluster-data/master-0/wal
uuid: "c13871c7dabf40e08845cfcdc4c0f3fe"
format_stamp: "Formatted at 2026-08-11 05:10:27 on dist-test-slave-x5fp"
server_key: "370c2b3f45efde85f64afc19b570f54a"
server_key_iv: "bcf1e30d4519982dc95a8df91fe182a2"
server_key_version: "encryptionkey@0"
I20260811 05:10:27.432881 16684 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786424853995437-27391-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786424853995437-27391-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786424853995437-27391-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:10:27.441792 16684 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:10:27.444108 16684 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:10:27.444276 16684 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:10:27.448591 16684 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.254:39617
I20260811 05:10:27.448630 16798 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.254:39617 every 8 connection(s)
I20260811 05:10:27.449004 16684 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
I20260811 05:10:27.449939 16799 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:10:27.452248 16799 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c13871c7dabf40e08845cfcdc4c0f3fe: Bootstrap starting.
I20260811 05:10:27.452905 16799 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c13871c7dabf40e08845cfcdc4c0f3fe: Neither blocks nor log segments found. Creating new log.
I20260811 05:10:27.453161 16799 log.cc:824] T 00000000000000000000000000000000 P c13871c7dabf40e08845cfcdc4c0f3fe: Log is configured to *not* fsync() on all Append() calls
I20260811 05:10:27.453861 16799 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c13871c7dabf40e08845cfcdc4c0f3fe: No bootstrap required, opened a new log
I20260811 05:10:27.455063 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 16684
I20260811 05:10:27.455209 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786424853995437-27391-0/minicluster-data/master-0/wal/instance
I20260811 05:10:27.455446 27391 external_mini_cluster.cc:1428] Setting key 1d2601156fc5f4afdc60d6339f5adf60
I20260811 05:10:27.455569 16799 raft_consensus.cc:348] T 00000000000000000000000000000000 P c13871c7dabf40e08845cfcdc4c0f3fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c13871c7dabf40e08845cfcdc4c0f3fe" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 39617 } }
I20260811 05:10:27.455735 16799 raft_consensus.cc:374] T 00000000000000000000000000000000 P c13871c7dabf40e08845cfcdc4c0f3fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:10:27.455785 16799 raft_consensus.cc:729] T 00000000000000000000000000000000 P c13871c7dabf40e08845cfcdc4c0f3fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c13871c7dabf40e08845cfcdc4c0f3fe, State: Initialized, Role: FOLLOWER
I20260811 05:10:27.455971 16799 consensus_queue.cc:260] T 00000000000000000000000000000000 P c13871c7dabf40e08845cfcdc4c0f3fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c13871c7dabf40e08845cfcdc4c0f3fe" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 39617 } }
I20260811 05:10:27.456066 16799 raft_consensus.cc:388] T 00000000000000000000000000000000 P c13871c7dabf40e08845cfcdc4c0f3fe [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:10:27.456105 16799 raft_consensus.cc:482] T 00000000000000000000000000000000 P c13871c7dabf40e08845cfcdc4c0f3fe [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:10:27.456200 16799 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c13871c7dabf40e08845cfcdc4c0f3fe [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:10:27.457477 16799 raft_consensus.cc:504] T 00000000000000000000000000000000 P c13871c7dabf40e08845cfcdc4c0f3fe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c13871c7dabf40e08845cfcdc4c0f3fe" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 39617 } }
I20260811 05:10:27.457603 16799 leader_election.cc:302] T 00000000000000000000000000000000 P c13871c7dabf40e08845cfcdc4c0f3fe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c13871c7dabf40e08845cfcdc4c0f3fe; no voters:
I20260811 05:10:27.457774 16799 leader_election.cc:288] T 00000000000000000000000000000000 P c13871c7dabf40e08845cfcdc4c0f3fe [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 05:10:27.457844 16805 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c13871c7dabf40e08845cfcdc4c0f3fe [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:10:27.458016 16805 raft_consensus.cc:686] T 00000000000000000000000000000000 P c13871c7dabf40e08845cfcdc4c0f3fe [term 1 LEADER]: Becoming Leader. State: Replica: c13871c7dabf40e08845cfcdc4c0f3fe, State: Running, Role: LEADER
I20260811 05:10:27.458057 16799 sys_catalog.cc:564] T 00000000000000000000000000000000 P c13871c7dabf40e08845cfcdc4c0f3fe [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:10:27.458145 16805 consensus_queue.cc:237] T 00000000000000000000000000000000 P c13871c7dabf40e08845cfcdc4c0f3fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c13871c7dabf40e08845cfcdc4c0f3fe" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 39617 } }
I20260811 05:10:27.458580 16805 sys_catalog.cc:455] T 00000000000000000000000000000000 P c13871c7dabf40e08845cfcdc4c0f3fe [sys.catalog]: SysCatalogTable state changed. Reason: New leader c13871c7dabf40e08845cfcdc4c0f3fe. Latest consensus state: current_term: 1 leader_uuid: "c13871c7dabf40e08845cfcdc4c0f3fe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c13871c7dabf40e08845cfcdc4c0f3fe" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 39617 } } }
I20260811 05:10:27.458618 16806 sys_catalog.cc:455] T 00000000000000000000000000000000 P c13871c7dabf40e08845cfcdc4c0f3fe [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c13871c7dabf40e08845cfcdc4c0f3fe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c13871c7dabf40e08845cfcdc4c0f3fe" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 39617 } } }
I20260811 05:10:27.458726 16806 sys_catalog.cc:458] T 00000000000000000000000000000000 P c13871c7dabf40e08845cfcdc4c0f3fe [sys.catalog]: This master's current role is: LEADER
I20260811 05:10:27.458702 16805 sys_catalog.cc:458] T 00000000000000000000000000000000 P c13871c7dabf40e08845cfcdc4c0f3fe [sys.catalog]: This master's current role is: LEADER
I20260811 05:10:27.459508 16819 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:10:27.460021 16819 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:10:27.462003 16819 catalog_manager.cc:1347] Generated new cluster ID: c4d9b2b379164beab422a92ec64e0d8e
I20260811 05:10:27.462065 16819 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 05:10:27 dist-test-slave-x5fp krb5kdc[16664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425027, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
I20260811 05:10:27.467828 16804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:27.456049 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52022 (local address 127.26.191.254:39617)
0811 05:10:27.456304 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0811 05:10:27.456315 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 05:10:27.456360 (+ 45us) server_negotiation.cc:407] Connection header received
0811 05:10:27.456519 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:10:27.456525 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:10:27.456584 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:10:27.456776 (+ 192us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:10:27.457653 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:27.459033 (+ 1380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:27.460084 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:27.460697 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:27.460835 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:27.463765 (+ 2930us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:10:27.463770 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:10:27.463770 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:10:27.463782 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:10:27.465866 (+ 2084us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:10:27.466256 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:10:27.466259 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:10:27.466259 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:10:27.466384 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:10:27.466564 (+ 180us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:10:27.466565 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:10:27.466565 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:10:27.466873 (+ 308us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:10:27.467021 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0811 05:10:27.467444 (+ 423us) server_negotiation.cc:299] Negotiation successful
0811 05:10:27.467587 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":101,"threads_started":1}
I20260811 05:10:27.468803 27391 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 05:10:27.479575 16819 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:10:27.480350 16819 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:10:27.491964 16819 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c13871c7dabf40e08845cfcdc4c0f3fe: Generated new TSK 0
I20260811 05:10:27.492208 16819 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 05:10:27.523394 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 16684
2026-08-11T05:10:27Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1618 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 05:10:27 dist-test-slave-x5fp krb5kdc[16839](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 05:10:27 dist-test-slave-x5fp krb5kdc[16839](info): set up 2 sockets
Aug 11 05:10:27 dist-test-slave-x5fp krb5kdc[16839](info): commencing operation
krb5kdc: starting...
W20260811 05:10:28.801146 27391 mini_kdc.cc:121] Time spent starting KDC: real 1.247s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/krb5kdc/test-user.keytab.
Aug 11 05:10:28 dist-test-slave-x5fp krb5kdc[16839](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425028, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T05:10:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:10:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.191.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.191.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.191.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab.
Entry for principal kudu/127.26.191.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab.
I20260811 05:10:28.932026 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.254:43163
--webserver_interface=127.26.191.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab
--principal=kudu/127.26.191.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:33749
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.191.254:43163
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:10:29.016248 16861 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:10:29.016498 16861 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:10:29.016536 16861 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:10:29.017758 16861 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:10:29.017824 16861 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:10:29.017849 16861 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:10:29.017869 16861 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:10:29.017899 16861 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:10:29.019375 16861 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:33749
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.191.254:43163
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab
--principal=kudu/127.26.191.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.254:43163
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.191.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16861
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:10:29.019654 16861 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:10:29.019886 16861 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:10:29.025120 16868 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:10:29.025158 16871 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:10:29.025457 16861 server_base.cc:1034] running on GCE node
W20260811 05:10:29.025525 16867 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:10:29.025828 16861 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:10:29.026137 16861 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:10:29.027276 16861 hybrid_clock.cc:648] HybridClock initialized: now 1786425029027264 us; error 33 us; skew 500 ppm
Aug 11 05:10:29 dist-test-slave-x5fp krb5kdc[16839](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425029, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:10:29.029996 16861 init.cc:377] Logged in from keytab as kudu/127.26.191.254@KRBTEST.COM (short username kudu)
I20260811 05:10:29.030433 16861 webserver.cc:460] Webserver started at http://127.26.191.254:34063/ using document root <none> and password file <none>
I20260811 05:10:29.030663 16861 fs_manager.cc:359] Metadata directory not provided
I20260811 05:10:29.030709 16861 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:10:29.030879 16861 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:10:29.031965 16861 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/master-0/data/instance:
uuid: "ba2c2f0becd44f9b9bd520495c4cac41"
format_stamp: "Formatted at 2026-08-11 05:10:29 on dist-test-slave-x5fp"
server_key: "04f58b49b582c5e55456094e5efd2200"
server_key_iv: "7fde29bab3f127054d556d3900a6962e"
server_key_version: "encryptionkey@0"
I20260811 05:10:29.032330 16861 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/master-0/wal/instance:
uuid: "ba2c2f0becd44f9b9bd520495c4cac41"
format_stamp: "Formatted at 2026-08-11 05:10:29 on dist-test-slave-x5fp"
server_key: "04f58b49b582c5e55456094e5efd2200"
server_key_iv: "7fde29bab3f127054d556d3900a6962e"
server_key_version: "encryptionkey@0"
I20260811 05:10:29.033855 16861 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 05:10:29.034648 16886 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:10:29.034881 16861 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:10:29.034993 16861 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/master-0/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/master-0/wal
uuid: "ba2c2f0becd44f9b9bd520495c4cac41"
format_stamp: "Formatted at 2026-08-11 05:10:29 on dist-test-slave-x5fp"
server_key: "04f58b49b582c5e55456094e5efd2200"
server_key_iv: "7fde29bab3f127054d556d3900a6962e"
server_key_version: "encryptionkey@0"
I20260811 05:10:29.035068 16861 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:10:29.049930 16861 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:10:29.052270 16861 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:10:29.052441 16861 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:10:29.056629 16861 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.254:43163
I20260811 05:10:29.056670 16968 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.254:43163 every 8 connection(s)
I20260811 05:10:29.057089 16861 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
I20260811 05:10:29.057497 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 16861
I20260811 05:10:29.057612 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/master-0/wal/instance
I20260811 05:10:29.057821 27391 external_mini_cluster.cc:1428] Setting key 2edfa1639fa8efcf7e7c236474d7082a
I20260811 05:10:29.058353 16971 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:10:29.061723 16971 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ba2c2f0becd44f9b9bd520495c4cac41: Bootstrap starting.
I20260811 05:10:29.062433 16971 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ba2c2f0becd44f9b9bd520495c4cac41: Neither blocks nor log segments found. Creating new log.
I20260811 05:10:29.062740 16971 log.cc:824] T 00000000000000000000000000000000 P ba2c2f0becd44f9b9bd520495c4cac41: Log is configured to *not* fsync() on all Append() calls
I20260811 05:10:29.063576 16971 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ba2c2f0becd44f9b9bd520495c4cac41: No bootstrap required, opened a new log
Aug 11 05:10:29 dist-test-slave-x5fp krb5kdc[16839](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425028, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
I20260811 05:10:29.065815 16971 raft_consensus.cc:348] T 00000000000000000000000000000000 P ba2c2f0becd44f9b9bd520495c4cac41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba2c2f0becd44f9b9bd520495c4cac41" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 43163 } }
I20260811 05:10:29.066026 16971 raft_consensus.cc:374] T 00000000000000000000000000000000 P ba2c2f0becd44f9b9bd520495c4cac41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:10:29.066084 16971 raft_consensus.cc:729] T 00000000000000000000000000000000 P ba2c2f0becd44f9b9bd520495c4cac41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba2c2f0becd44f9b9bd520495c4cac41, State: Initialized, Role: FOLLOWER
I20260811 05:10:29.066258 16971 consensus_queue.cc:260] T 00000000000000000000000000000000 P ba2c2f0becd44f9b9bd520495c4cac41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba2c2f0becd44f9b9bd520495c4cac41" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 43163 } }
I20260811 05:10:29.066336 16971 raft_consensus.cc:388] T 00000000000000000000000000000000 P ba2c2f0becd44f9b9bd520495c4cac41 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:10:29.066360 16971 raft_consensus.cc:482] T 00000000000000000000000000000000 P ba2c2f0becd44f9b9bd520495c4cac41 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:10:29.066423 16971 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ba2c2f0becd44f9b9bd520495c4cac41 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:10:29.067060 16971 raft_consensus.cc:504] T 00000000000000000000000000000000 P ba2c2f0becd44f9b9bd520495c4cac41 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba2c2f0becd44f9b9bd520495c4cac41" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 43163 } }
I20260811 05:10:29.067159 16971 leader_election.cc:302] T 00000000000000000000000000000000 P ba2c2f0becd44f9b9bd520495c4cac41 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ba2c2f0becd44f9b9bd520495c4cac41; no voters:
I20260811 05:10:29.067368 16971 leader_election.cc:288] T 00000000000000000000000000000000 P ba2c2f0becd44f9b9bd520495c4cac41 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 05:10:29.067440 16977 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ba2c2f0becd44f9b9bd520495c4cac41 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:10:29.067636 16971 sys_catalog.cc:564] T 00000000000000000000000000000000 P ba2c2f0becd44f9b9bd520495c4cac41 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:10:29.067675 16977 raft_consensus.cc:686] T 00000000000000000000000000000000 P ba2c2f0becd44f9b9bd520495c4cac41 [term 1 LEADER]: Becoming Leader. State: Replica: ba2c2f0becd44f9b9bd520495c4cac41, State: Running, Role: LEADER
I20260811 05:10:29.067857 16977 consensus_queue.cc:237] T 00000000000000000000000000000000 P ba2c2f0becd44f9b9bd520495c4cac41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba2c2f0becd44f9b9bd520495c4cac41" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 43163 } }
I20260811 05:10:29.068312 16978 sys_catalog.cc:455] T 00000000000000000000000000000000 P ba2c2f0becd44f9b9bd520495c4cac41 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ba2c2f0becd44f9b9bd520495c4cac41" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba2c2f0becd44f9b9bd520495c4cac41" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 43163 } } }
I20260811 05:10:29.068418 16978 sys_catalog.cc:458] T 00000000000000000000000000000000 P ba2c2f0becd44f9b9bd520495c4cac41 [sys.catalog]: This master's current role is: LEADER
I20260811 05:10:29.068583 16980 sys_catalog.cc:455] T 00000000000000000000000000000000 P ba2c2f0becd44f9b9bd520495c4cac41 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ba2c2f0becd44f9b9bd520495c4cac41. Latest consensus state: current_term: 1 leader_uuid: "ba2c2f0becd44f9b9bd520495c4cac41" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba2c2f0becd44f9b9bd520495c4cac41" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 43163 } } }
I20260811 05:10:29.068634 16980 sys_catalog.cc:458] T 00000000000000000000000000000000 P ba2c2f0becd44f9b9bd520495c4cac41 [sys.catalog]: This master's current role is: LEADER
I20260811 05:10:29.068660 16993 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:10:29.069222 16993 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:10:29.069960 16975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:29.058386 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51668 (local address 127.26.191.254:43163)
0811 05:10:29.058568 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0811 05:10:29.058577 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 05:10:29.058610 (+ 33us) server_negotiation.cc:407] Connection header received
0811 05:10:29.059154 (+ 544us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:10:29.059164 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:10:29.059228 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:10:29.059385 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:10:29.059958 (+ 573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:29.061382 (+ 1424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:29.062183 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:29.062813 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:29.062956 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:29.065621 (+ 2665us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:10:29.065625 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:10:29.065625 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:10:29.065636 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:10:29.067743 (+ 2107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:10:29.068196 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:10:29.068199 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:10:29.068200 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:10:29.068321 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:10:29.068566 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:10:29.068567 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:10:29.068567 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:10:29.068900 (+ 333us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:10:29.069529 (+ 629us) server_negotiation.cc:1035] Waiting for connection context
0811 05:10:29.069602 (+ 73us) server_negotiation.cc:299] Negotiation successful
0811 05:10:29.069740 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":95,"threads_started":1}
I20260811 05:10:29.071334 16993 catalog_manager.cc:1347] Generated new cluster ID: de5f0fec5a204d9fb159c5c5bb6f39a7
I20260811 05:10:29.071381 16993 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:10:29.085376 16993 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:10:29.086187 16993 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:10:29.094245 16993 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ba2c2f0becd44f9b9bd520495c4cac41: Generated new TSK 0
I20260811 05:10:29.094473 16993 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.191.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.191.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.191.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.193.keytab.
Entry for principal kudu/127.26.191.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.193.keytab.
I20260811 05:10:29.132047 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.191.193:0
--local_ip_for_outbound_sockets=127.26.191.193
--webserver_interface=127.26.191.193
--webserver_port=0
--tserver_master_addrs=127.26.191.254:43163
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.193.keytab
--principal=kudu/127.26.191.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:33749
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:10:29.221695 17015 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:10:29.221916 17015 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:10:29.221941 17015 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:10:29.223117 17015 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:10:29.223153 17015 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:10:29.223179 17015 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.191.193
I20260811 05:10:29.224633 17015 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:33749
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.193.keytab
--principal=kudu/127.26.191.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.191.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.191.193
--webserver_port=0
--tserver_master_addrs=127.26.191.254:43163
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17015
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.191.193
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:10:29.224907 17015 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:10:29.225113 17015 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:10:29.230609 17020 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:10:29.230659 17021 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:10:29.230616 17023 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:10:29.230962 17015 server_base.cc:1034] running on GCE node
I20260811 05:10:29.231176 17015 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:10:29.231455 17015 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:10:29.232823 17015 hybrid_clock.cc:648] HybridClock initialized: now 1786425029232788 us; error 46 us; skew 500 ppm
Aug 11 05:10:29 dist-test-slave-x5fp krb5kdc[16839](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425029, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:10:29.235865 17015 init.cc:377] Logged in from keytab as kudu/127.26.191.193@KRBTEST.COM (short username kudu)
I20260811 05:10:29.236398 17015 webserver.cc:460] Webserver started at http://127.26.191.193:44305/ using document root <none> and password file <none>
I20260811 05:10:29.236644 17015 fs_manager.cc:359] Metadata directory not provided
I20260811 05:10:29.236690 17015 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:10:29.236881 17015 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:10:29.238185 17015 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-0/data/instance:
uuid: "eef4d191e08f406ab76a3b3d722cbdca"
format_stamp: "Formatted at 2026-08-11 05:10:29 on dist-test-slave-x5fp"
server_key: "805efe0fd7a3a4f93c06af8ccaa17225"
server_key_iv: "77b8c060e62f2548ca1c573b3328f660"
server_key_version: "encryptionkey@0"
I20260811 05:10:29.238564 17015 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-0/wal/instance:
uuid: "eef4d191e08f406ab76a3b3d722cbdca"
format_stamp: "Formatted at 2026-08-11 05:10:29 on dist-test-slave-x5fp"
server_key: "805efe0fd7a3a4f93c06af8ccaa17225"
server_key_iv: "77b8c060e62f2548ca1c573b3328f660"
server_key_version: "encryptionkey@0"
I20260811 05:10:29.240140 17015 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 05:10:29.241111 17037 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:10:29.241330 17015 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:10:29.241487 17015 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-0/wal
uuid: "eef4d191e08f406ab76a3b3d722cbdca"
format_stamp: "Formatted at 2026-08-11 05:10:29 on dist-test-slave-x5fp"
server_key: "805efe0fd7a3a4f93c06af8ccaa17225"
server_key_iv: "77b8c060e62f2548ca1c573b3328f660"
server_key_version: "encryptionkey@0"
I20260811 05:10:29.241573 17015 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:10:29.254415 17015 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:10:29.256709 17015 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:10:29.256927 17015 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:10:29.257210 17015 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:10:29.257608 17015 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:10:29.257668 17015 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:10:29.257717 17015 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:10:29.257754 17015 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:10:29.264649 17015 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.193:35057
I20260811 05:10:29.264704 17234 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.193:35057 every 8 connection(s)
I20260811 05:10:29.265094 17015 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-0/data/info.pb
I20260811 05:10:29.268481 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 17015
I20260811 05:10:29.268620 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-0/wal/instance
I20260811 05:10:29.268929 27391 external_mini_cluster.cc:1428] Setting key aa74d425fd898ed3162c85a6e08b580f
Aug 11 05:10:29 dist-test-slave-x5fp krb5kdc[16839](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425029, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.193@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
I20260811 05:10:29.275679 16975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:29.265995 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.193:50457 (local address 127.26.191.254:43163)
0811 05:10:29.266058 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 05:10:29.266086 (+ 28us) server_negotiation.cc:399] Waiting for connection header
0811 05:10:29.266292 (+ 206us) server_negotiation.cc:407] Connection header received
0811 05:10:29.266863 (+ 571us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:10:29.266865 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:10:29.266878 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:10:29.266922 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:10:29.268031 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:29.268757 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:29.269935 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:29.270155 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:29.270241 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:29.272819 (+ 2578us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:10:29.272821 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:10:29.272821 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:10:29.272829 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:10:29.274237 (+ 1408us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:10:29.274654 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:10:29.274656 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:10:29.274656 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:10:29.274720 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:10:29.274989 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:10:29.274990 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:10:29.274990 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:10:29.275115 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:10:29.275187 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 05:10:29.275488 (+ 301us) server_negotiation.cc:299] Negotiation successful
0811 05:10:29.275581 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 05:10:29.275895 17239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:29.265939 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:43163 (local address 127.26.191.193:50457)
0811 05:10:29.266164 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:29.266205 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 05:10:29.266744 (+ 539us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:10:29.267020 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:10:29.267024 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:10:29.267700 (+ 676us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:10:29.267925 (+ 225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:10:29.267932 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:10:29.268868 (+ 936us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:10:29.268869 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:10:29.269832 (+ 963us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:10:29.269835 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:10:29.270256 (+ 421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:10:29.270257 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:10:29.270389 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:29.271007 (+ 618us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:10:29.271016 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:10:29.272655 (+ 1639us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:10:29.274322 (+ 1667us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:10:29.274330 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:10:29.274333 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:10:29.274574 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:10:29.274786 (+ 212us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:10:29.274787 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:10:29.274787 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:10:29.274913 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:10:29.275187 (+ 274us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:10:29.275196 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:10:29.275348 (+ 152us) client_negotiation.cc:769] Sending connection context
0811 05:10:29.275454 (+ 106us) client_negotiation.cc:240] Negotiation successful
0811 05:10:29.275632 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":107,"threads_started":1}
I20260811 05:10:29.276437 17235 heartbeater.cc:347] Connected to a master server at 127.26.191.254:43163
I20260811 05:10:29.276557 17235 heartbeater.cc:464] Registering TS with master...
I20260811 05:10:29.276795 17235 heartbeater.cc:511] Master 127.26.191.254:43163 requested a full tablet report, sending...
I20260811 05:10:29.277431 16911 ts_manager.cc:194] Registered new tserver with Master: eef4d191e08f406ab76a3b3d722cbdca (127.26.191.193:35057)
I20260811 05:10:29.278071 16911 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.191.193@KRBTEST.COM'} at 127.26.191.193:50457
WARNING: no policy specified for kudu/127.26.191.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.191.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.191.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.194.keytab.
Entry for principal kudu/127.26.191.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.194.keytab.
I20260811 05:10:29.300002 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.191.194:0
--local_ip_for_outbound_sockets=127.26.191.194
--webserver_interface=127.26.191.194
--webserver_port=0
--tserver_master_addrs=127.26.191.254:43163
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.194.keytab
--principal=kudu/127.26.191.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:33749
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:10:29.388041 17247 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:10:29.388253 17247 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:10:29.388278 17247 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:10:29.389457 17247 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:10:29.389501 17247 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:10:29.389528 17247 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.191.194
I20260811 05:10:29.391005 17247 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:33749
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.194.keytab
--principal=kudu/127.26.191.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.191.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.191.194
--webserver_port=0
--tserver_master_addrs=127.26.191.254:43163
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17247
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.191.194
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:10:29.391259 17247 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:10:29.391510 17247 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:10:29.397217 17255 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:10:29.397207 17258 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:10:29.397207 17254 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:10:29.397609 17247 server_base.cc:1034] running on GCE node
I20260811 05:10:29.397874 17247 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:10:29.398135 17247 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:10:29.399304 17247 hybrid_clock.cc:648] HybridClock initialized: now 1786425029399273 us; error 30 us; skew 500 ppm
Aug 11 05:10:29 dist-test-slave-x5fp krb5kdc[16839](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425029, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:10:29.402104 17247 init.cc:377] Logged in from keytab as kudu/127.26.191.194@KRBTEST.COM (short username kudu)
I20260811 05:10:29.402684 17247 webserver.cc:460] Webserver started at http://127.26.191.194:43125/ using document root <none> and password file <none>
I20260811 05:10:29.402959 17247 fs_manager.cc:359] Metadata directory not provided
I20260811 05:10:29.403034 17247 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:10:29.403191 17247 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:10:29.404435 17247 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-1/data/instance:
uuid: "5641a5f8c562460583a125fdbcd4bafc"
format_stamp: "Formatted at 2026-08-11 05:10:29 on dist-test-slave-x5fp"
server_key: "fb40a64055cfa20f1d51158c9c9b6974"
server_key_iv: "9a834454292b2c0b770554fc5faefd77"
server_key_version: "encryptionkey@0"
I20260811 05:10:29.404934 17247 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-1/wal/instance:
uuid: "5641a5f8c562460583a125fdbcd4bafc"
format_stamp: "Formatted at 2026-08-11 05:10:29 on dist-test-slave-x5fp"
server_key: "fb40a64055cfa20f1d51158c9c9b6974"
server_key_iv: "9a834454292b2c0b770554fc5faefd77"
server_key_version: "encryptionkey@0"
I20260811 05:10:29.406461 17247 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260811 05:10:29.407274 17267 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:10:29.407476 17247 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:10:29.407577 17247 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-1/wal
uuid: "5641a5f8c562460583a125fdbcd4bafc"
format_stamp: "Formatted at 2026-08-11 05:10:29 on dist-test-slave-x5fp"
server_key: "fb40a64055cfa20f1d51158c9c9b6974"
server_key_iv: "9a834454292b2c0b770554fc5faefd77"
server_key_version: "encryptionkey@0"
I20260811 05:10:29.407653 17247 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:10:29.424647 17247 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:10:29.427094 17247 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:10:29.427258 17247 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:10:29.427521 17247 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:10:29.427855 17247 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:10:29.427907 17247 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:10:29.427950 17247 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:10:29.427979 17247 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:10:29.434096 17247 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.194:33341
I20260811 05:10:29.434165 17454 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.194:33341 every 8 connection(s)
I20260811 05:10:29.434494 17247 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-1/data/info.pb
I20260811 05:10:29.436930 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 17247
I20260811 05:10:29.437039 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-1/wal/instance
I20260811 05:10:29.437278 27391 external_mini_cluster.cc:1428] Setting key d16a8c6a7fe58825377b3fa6b6b1435e
Aug 11 05:10:29 dist-test-slave-x5fp krb5kdc[16839](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425029, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.194@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
I20260811 05:10:29.445178 16975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:29.435242 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.194:44793 (local address 127.26.191.254:43163)
0811 05:10:29.435296 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 05:10:29.435298 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:10:29.435548 (+ 250us) server_negotiation.cc:407] Connection header received
0811 05:10:29.436040 (+ 492us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:10:29.436042 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:10:29.436054 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:10:29.436122 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:10:29.437440 (+ 1318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:29.438083 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:29.439596 (+ 1513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:29.439786 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:29.439893 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:29.442177 (+ 2284us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:10:29.442178 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:10:29.442179 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:10:29.442186 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:10:29.443664 (+ 1478us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:10:29.444090 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:10:29.444091 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:10:29.444092 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:10:29.444155 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:10:29.444429 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:10:29.444430 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:10:29.444430 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:10:29.444582 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:10:29.444658 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 05:10:29.444994 (+ 336us) server_negotiation.cc:299] Negotiation successful
0811 05:10:29.445086 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 05:10:29.445369 17457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:29.435214 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:43163 (local address 127.26.191.194:44793)
0811 05:10:29.435385 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:29.435430 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 05:10:29.435931 (+ 501us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:10:29.436199 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:10:29.436203 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:10:29.436963 (+ 760us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:10:29.437288 (+ 325us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:10:29.437295 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:10:29.438177 (+ 882us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:10:29.438178 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:10:29.439511 (+ 1333us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:10:29.439515 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:10:29.439912 (+ 397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:10:29.439914 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:10:29.440054 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:29.440606 (+ 552us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:10:29.440615 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:10:29.442077 (+ 1462us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:10:29.443760 (+ 1683us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:10:29.443768 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:10:29.443770 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:10:29.444012 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:10:29.444227 (+ 215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:10:29.444228 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:10:29.444228 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:10:29.444335 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:10:29.444648 (+ 313us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:10:29.444656 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:10:29.444842 (+ 186us) client_negotiation.cc:769] Sending connection context
0811 05:10:29.444955 (+ 113us) client_negotiation.cc:240] Negotiation successful
0811 05:10:29.445121 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":100,"threads_started":1}
I20260811 05:10:29.446058 17455 heartbeater.cc:347] Connected to a master server at 127.26.191.254:43163
I20260811 05:10:29.446170 17455 heartbeater.cc:464] Registering TS with master...
I20260811 05:10:29.446352 17455 heartbeater.cc:511] Master 127.26.191.254:43163 requested a full tablet report, sending...
I20260811 05:10:29.446764 16911 ts_manager.cc:194] Registered new tserver with Master: 5641a5f8c562460583a125fdbcd4bafc (127.26.191.194:33341)
WARNING: no policy specified for kudu/127.26.191.195@KRBTEST.COM; defaulting to no policy
I20260811 05:10:29.447307 16911 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.191.194@KRBTEST.COM'} at 127.26.191.194:44793
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.191.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.191.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.195.keytab.
Entry for principal kudu/127.26.191.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.195.keytab.
I20260811 05:10:29.467919 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.191.195:0
--local_ip_for_outbound_sockets=127.26.191.195
--webserver_interface=127.26.191.195
--webserver_port=0
--tserver_master_addrs=127.26.191.254:43163
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.195.keytab
--principal=kudu/127.26.191.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:33749
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:10:29.558015 17461 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:10:29.558230 17461 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:10:29.558254 17461 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:10:29.559418 17461 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:10:29.559464 17461 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:10:29.559490 17461 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.191.195
I20260811 05:10:29.561029 17461 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:33749
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.195.keytab
--principal=kudu/127.26.191.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.191.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.191.195
--webserver_port=0
--tserver_master_addrs=127.26.191.254:43163
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17461
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.191.195
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:10:29.561295 17461 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:10:29.561528 17461 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:10:29.566968 17471 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:10:29.566948 17461 server_base.cc:1034] running on GCE node
W20260811 05:10:29.566936 17468 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:10:29.566941 17466 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:10:29.567401 17461 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:10:29.567654 17461 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:10:29.568830 17461 hybrid_clock.cc:648] HybridClock initialized: now 1786425029568830 us; error 43 us; skew 500 ppm
Aug 11 05:10:29 dist-test-slave-x5fp krb5kdc[16839](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425029, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:10:29.571549 17461 init.cc:377] Logged in from keytab as kudu/127.26.191.195@KRBTEST.COM (short username kudu)
I20260811 05:10:29.571949 17461 webserver.cc:460] Webserver started at http://127.26.191.195:37913/ using document root <none> and password file <none>
I20260811 05:10:29.572199 17461 fs_manager.cc:359] Metadata directory not provided
I20260811 05:10:29.572249 17461 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:10:29.572396 17461 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:10:29.573557 17461 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-2/data/instance:
uuid: "91cfea43aaac41249f8bffa4ae0c3366"
format_stamp: "Formatted at 2026-08-11 05:10:29 on dist-test-slave-x5fp"
server_key: "c05ffd01b9e8756ffe08bfda2dc837b0"
server_key_iv: "fcffb631b27a7aa591a1bfeeb6201c94"
server_key_version: "encryptionkey@0"
I20260811 05:10:29.573940 17461 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-2/wal/instance:
uuid: "91cfea43aaac41249f8bffa4ae0c3366"
format_stamp: "Formatted at 2026-08-11 05:10:29 on dist-test-slave-x5fp"
server_key: "c05ffd01b9e8756ffe08bfda2dc837b0"
server_key_iv: "fcffb631b27a7aa591a1bfeeb6201c94"
server_key_version: "encryptionkey@0"
I20260811 05:10:29.575366 17461 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 05:10:29.576241 17480 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:10:29.576473 17461 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 05:10:29.576599 17461 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-2/wal
uuid: "91cfea43aaac41249f8bffa4ae0c3366"
format_stamp: "Formatted at 2026-08-11 05:10:29 on dist-test-slave-x5fp"
server_key: "c05ffd01b9e8756ffe08bfda2dc837b0"
server_key_iv: "fcffb631b27a7aa591a1bfeeb6201c94"
server_key_version: "encryptionkey@0"
I20260811 05:10:29.576673 17461 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:10:29.587414 17461 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:10:29.589625 17461 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:10:29.589773 17461 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:10:29.590055 17461 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:10:29.590389 17461 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:10:29.590442 17461 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:10:29.590478 17461 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:10:29.590504 17461 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:10:29.597448 17461 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.195:34413
I20260811 05:10:29.597528 17667 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.195:34413 every 8 connection(s)
I20260811 05:10:29.597896 17461 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-2/data/info.pb
I20260811 05:10:29.604367 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 17461
I20260811 05:10:29.604477 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-2/wal/instance
I20260811 05:10:29.604694 27391 external_mini_cluster.cc:1428] Setting key ea75d72b93c25f45d42295f007e21d9a
Aug 11 05:10:29 dist-test-slave-x5fp krb5kdc[16839](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425029, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.195@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
I20260811 05:10:29.608882 16975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:29.598805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.195:50911 (local address 127.26.191.254:43163)
0811 05:10:29.598876 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0811 05:10:29.598878 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:10:29.599083 (+ 205us) server_negotiation.cc:407] Connection header received
0811 05:10:29.599612 (+ 529us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:10:29.599613 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:10:29.599625 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:10:29.599853 (+ 228us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:10:29.600977 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:29.601505 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:29.602609 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:29.602860 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:29.602983 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:29.605739 (+ 2756us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:10:29.605740 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:10:29.605740 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:10:29.605748 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:10:29.607342 (+ 1594us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:10:29.607812 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:10:29.607813 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:10:29.607814 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:10:29.607890 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:10:29.608186 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:10:29.608187 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:10:29.608187 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:10:29.608318 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:10:29.608379 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 05:10:29.608651 (+ 272us) server_negotiation.cc:299] Negotiation successful
0811 05:10:29.608804 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 05:10:29.609123 17670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:29.598719 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:43163 (local address 127.26.191.195:50911)
0811 05:10:29.598902 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:29.598964 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0811 05:10:29.599519 (+ 555us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:10:29.599922 (+ 403us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:10:29.599925 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:10:29.600592 (+ 667us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:10:29.600883 (+ 291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:10:29.600890 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:10:29.601591 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:10:29.601592 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:10:29.602512 (+ 920us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:10:29.602514 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:10:29.602994 (+ 480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:10:29.602994 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:10:29.603116 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:29.603653 (+ 537us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:10:29.603662 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:10:29.605598 (+ 1936us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:10:29.607428 (+ 1830us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:10:29.607435 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:10:29.607437 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:10:29.607705 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:10:29.607978 (+ 273us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:10:29.607979 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:10:29.607979 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:10:29.608099 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:10:29.608389 (+ 290us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:10:29.608395 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:10:29.608528 (+ 133us) client_negotiation.cc:769] Sending connection context
0811 05:10:29.608626 (+ 98us) client_negotiation.cc:240] Negotiation successful
0811 05:10:29.608868 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":139,"threads_started":1}
I20260811 05:10:29.609568 17668 heartbeater.cc:347] Connected to a master server at 127.26.191.254:43163
I20260811 05:10:29.609684 17668 heartbeater.cc:464] Registering TS with master...
I20260811 05:10:29.609882 17668 heartbeater.cc:511] Master 127.26.191.254:43163 requested a full tablet report, sending...
I20260811 05:10:29.610275 16911 ts_manager.cc:194] Registered new tserver with Master: 91cfea43aaac41249f8bffa4ae0c3366 (127.26.191.195:34413)
I20260811 05:10:29.610754 16911 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.191.195@KRBTEST.COM'} at 127.26.191.195:50911
I20260811 05:10:29.617112 27391 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 05:10:29.625427 16975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:29.618671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51682 (local address 127.26.191.254:43163)
0811 05:10:29.618756 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0811 05:10:29.618758 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:10:29.618872 (+ 114us) server_negotiation.cc:407] Connection header received
0811 05:10:29.618940 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:10:29.618940 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:10:29.618950 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:10:29.618992 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:10:29.619648 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:29.620145 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:29.621046 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:29.621236 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:29.621298 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:29.622614 (+ 1316us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:10:29.622615 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:10:29.622615 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:10:29.622622 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:10:29.624129 (+ 1507us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:10:29.624521 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:10:29.624522 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:10:29.624523 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:10:29.624594 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:10:29.624904 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:10:29.624906 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:10:29.624906 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:10:29.625083 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:10:29.625168 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0811 05:10:29.625264 (+ 96us) server_negotiation.cc:299] Negotiation successful
0811 05:10:29.625329 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 05:10:29.627317 16911 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51682:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 05:10:29.629091 16911 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 05:10:29.637383 17689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:29.631786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.194:33341 (local address 127.0.0.1:33788)
0811 05:10:29.632152 (+ 366us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:29.632210 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0811 05:10:29.632299 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:10:29.632800 (+ 501us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:10:29.632804 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:10:29.632806 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:10:29.632893 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:10:29.632896 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:10:29.634402 (+ 1506us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:10:29.634403 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:10:29.635987 (+ 1584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:10:29.635990 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:10:29.637027 (+ 1037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:10:29.637034 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:10:29.637127 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:29.637143 (+ 16us) client_negotiation.cc:769] Sending connection context
0811 05:10:29.637222 (+ 79us) client_negotiation.cc:240] Negotiation successful
0811 05:10:29.637284 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":334,"mutex_wait_us":35,"thread_start_us":89,"threads_started":1}
I20260811 05:10:29.637516 17690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:29.631876 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.195:34413 (local address 127.0.0.1:59888)
0811 05:10:29.632261 (+ 385us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:29.632276 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 05:10:29.632381 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:10:29.632809 (+ 428us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:10:29.632810 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:10:29.632812 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:10:29.632895 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:10:29.632897 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:10:29.634310 (+ 1413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:10:29.634312 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:10:29.635987 (+ 1675us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:10:29.635990 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:10:29.637142 (+ 1152us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:10:29.637144 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:10:29.637234 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:29.637240 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 05:10:29.637300 (+ 60us) client_negotiation.cc:240] Negotiation successful
0811 05:10:29.637351 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":361,"mutex_wait_us":135,"thread_start_us":110,"threads_started":1}
I20260811 05:10:29.637605 17695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:29.631989 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59888 (local address 127.26.191.195:34413)
0811 05:10:29.632203 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0811 05:10:29.632207 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:10:29.632346 (+ 139us) server_negotiation.cc:407] Connection header received
0811 05:10:29.632514 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:10:29.632518 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:10:29.632535 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:10:29.632597 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:10:29.632991 (+ 394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:29.634190 (+ 1199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:29.636108 (+ 1918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:29.636792 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:29.636884 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:29.636948 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 05:10:29.637429 (+ 481us) server_negotiation.cc:299] Negotiation successful
0811 05:10:29.637500 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":186,"thread_start_us":95,"threads_started":1}
I20260811 05:10:29.637796 17693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:29.631925 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33788 (local address 127.26.191.194:33341)
0811 05:10:29.632134 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0811 05:10:29.632140 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 05:10:29.632431 (+ 291us) server_negotiation.cc:407] Connection header received
0811 05:10:29.632482 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:10:29.632485 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:10:29.632504 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:10:29.632686 (+ 182us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:10:29.633049 (+ 363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:29.634314 (+ 1265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:29.636085 (+ 1771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:29.636944 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:29.637030 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:29.637095 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 05:10:29.637650 (+ 555us) server_negotiation.cc:299] Negotiation successful
0811 05:10:29.637700 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":106,"threads_started":1}
I20260811 05:10:29.638520 17698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:29.632040 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.193:35057 (local address 127.0.0.1:35810)
0811 05:10:29.632284 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:29.632295 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 05:10:29.632339 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:10:29.632919 (+ 580us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:10:29.632920 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:10:29.632922 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:10:29.634217 (+ 1295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:10:29.634220 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:10:29.635481 (+ 1261us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:10:29.635482 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:10:29.636467 (+ 985us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:10:29.636470 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:10:29.638241 (+ 1771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:10:29.638242 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:10:29.638320 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:29.638325 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 05:10:29.638397 (+ 72us) client_negotiation.cc:240] Negotiation successful
0811 05:10:29.638440 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":223,"thread_start_us":83,"threads_started":1}
I20260811 05:10:29.638577 17344 tablet_service.cc:1467] Processing CreateTablet for tablet 9586d856265d48cb80a6aabf71ee25ff (DEFAULT_TABLE table=test-table [id=c9bb3b0de8b74cf88addfeb4c29204c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:10:29.638574 17556 tablet_service.cc:1467] Processing CreateTablet for tablet 9586d856265d48cb80a6aabf71ee25ff (DEFAULT_TABLE table=test-table [id=c9bb3b0de8b74cf88addfeb4c29204c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:10:29.638761 17699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:29.632324 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35810 (local address 127.26.191.193:35057)
0811 05:10:29.632673 (+ 349us) server_negotiation.cc:206] Beginning negotiation
0811 05:10:29.632678 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:10:29.632688 (+ 10us) server_negotiation.cc:407] Connection header received
0811 05:10:29.632793 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:10:29.632795 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:10:29.632812 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:10:29.634322 (+ 1510us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:10:29.634423 (+ 101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:29.635370 (+ 947us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:29.636568 (+ 1198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:29.638150 (+ 1582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:29.638246 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:29.638304 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 05:10:29.638413 (+ 109us) server_negotiation.cc:299] Negotiation successful
0811 05:10:29.638464 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":307,"thread_start_us":126,"threads_started":1}
I20260811 05:10:29.639006 17556 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9586d856265d48cb80a6aabf71ee25ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:10:29.639024 17344 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9586d856265d48cb80a6aabf71ee25ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:10:29.642128 17702 tablet_bootstrap.cc:492] T 9586d856265d48cb80a6aabf71ee25ff P 5641a5f8c562460583a125fdbcd4bafc: Bootstrap starting.
I20260811 05:10:29.642962 17702 tablet_bootstrap.cc:654] T 9586d856265d48cb80a6aabf71ee25ff P 5641a5f8c562460583a125fdbcd4bafc: Neither blocks nor log segments found. Creating new log.
I20260811 05:10:29.643004 17128 tablet_service.cc:1467] Processing CreateTablet for tablet 9586d856265d48cb80a6aabf71ee25ff (DEFAULT_TABLE table=test-table [id=c9bb3b0de8b74cf88addfeb4c29204c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:10:29.643455 17128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9586d856265d48cb80a6aabf71ee25ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:10:29.643667 17702 log.cc:824] T 9586d856265d48cb80a6aabf71ee25ff P 5641a5f8c562460583a125fdbcd4bafc: Log is configured to *not* fsync() on all Append() calls
I20260811 05:10:29.644115 17700 tablet_bootstrap.cc:492] T 9586d856265d48cb80a6aabf71ee25ff P 91cfea43aaac41249f8bffa4ae0c3366: Bootstrap starting.
I20260811 05:10:29.644763 17702 tablet_bootstrap.cc:492] T 9586d856265d48cb80a6aabf71ee25ff P 5641a5f8c562460583a125fdbcd4bafc: No bootstrap required, opened a new log
I20260811 05:10:29.644855 17702 ts_tablet_manager.cc:1397] T 9586d856265d48cb80a6aabf71ee25ff P 5641a5f8c562460583a125fdbcd4bafc: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 05:10:29.644964 17700 tablet_bootstrap.cc:654] T 9586d856265d48cb80a6aabf71ee25ff P 91cfea43aaac41249f8bffa4ae0c3366: Neither blocks nor log segments found. Creating new log.
I20260811 05:10:29.645644 17700 log.cc:824] T 9586d856265d48cb80a6aabf71ee25ff P 91cfea43aaac41249f8bffa4ae0c3366: Log is configured to *not* fsync() on all Append() calls
I20260811 05:10:29.646586 17700 tablet_bootstrap.cc:492] T 9586d856265d48cb80a6aabf71ee25ff P 91cfea43aaac41249f8bffa4ae0c3366: No bootstrap required, opened a new log
I20260811 05:10:29.646667 17700 ts_tablet_manager.cc:1397] T 9586d856265d48cb80a6aabf71ee25ff P 91cfea43aaac41249f8bffa4ae0c3366: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 05:10:29.646833 17702 raft_consensus.cc:348] T 9586d856265d48cb80a6aabf71ee25ff P 5641a5f8c562460583a125fdbcd4bafc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5641a5f8c562460583a125fdbcd4bafc" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 33341 } } peers { permanent_uuid: "eef4d191e08f406ab76a3b3d722cbdca" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 35057 } } peers { permanent_uuid: "91cfea43aaac41249f8bffa4ae0c3366" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 34413 } }
I20260811 05:10:29.647001 17702 raft_consensus.cc:374] T 9586d856265d48cb80a6aabf71ee25ff P 5641a5f8c562460583a125fdbcd4bafc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:10:29.647050 17702 raft_consensus.cc:729] T 9586d856265d48cb80a6aabf71ee25ff P 5641a5f8c562460583a125fdbcd4bafc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5641a5f8c562460583a125fdbcd4bafc, State: Initialized, Role: FOLLOWER
I20260811 05:10:29.647203 17702 consensus_queue.cc:260] T 9586d856265d48cb80a6aabf71ee25ff P 5641a5f8c562460583a125fdbcd4bafc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5641a5f8c562460583a125fdbcd4bafc" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 33341 } } peers { permanent_uuid: "eef4d191e08f406ab76a3b3d722cbdca" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 35057 } } peers { permanent_uuid: "91cfea43aaac41249f8bffa4ae0c3366" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 34413 } }
I20260811 05:10:29.647553 17702 ts_tablet_manager.cc:1428] T 9586d856265d48cb80a6aabf71ee25ff P 5641a5f8c562460583a125fdbcd4bafc: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 05:10:29.647593 17455 heartbeater.cc:503] Master 127.26.191.254:43163 was elected leader, sending a full tablet report...
I20260811 05:10:29.647768 17707 tablet_bootstrap.cc:492] T 9586d856265d48cb80a6aabf71ee25ff P eef4d191e08f406ab76a3b3d722cbdca: Bootstrap starting.
I20260811 05:10:29.648499 17707 tablet_bootstrap.cc:654] T 9586d856265d48cb80a6aabf71ee25ff P eef4d191e08f406ab76a3b3d722cbdca: Neither blocks nor log segments found. Creating new log.
I20260811 05:10:29.649178 17707 log.cc:824] T 9586d856265d48cb80a6aabf71ee25ff P eef4d191e08f406ab76a3b3d722cbdca: Log is configured to *not* fsync() on all Append() calls
I20260811 05:10:29.649535 17700 raft_consensus.cc:348] T 9586d856265d48cb80a6aabf71ee25ff P 91cfea43aaac41249f8bffa4ae0c3366 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5641a5f8c562460583a125fdbcd4bafc" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 33341 } } peers { permanent_uuid: "eef4d191e08f406ab76a3b3d722cbdca" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 35057 } } peers { permanent_uuid: "91cfea43aaac41249f8bffa4ae0c3366" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 34413 } }
I20260811 05:10:29.649684 17700 raft_consensus.cc:374] T 9586d856265d48cb80a6aabf71ee25ff P 91cfea43aaac41249f8bffa4ae0c3366 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:10:29.649711 17700 raft_consensus.cc:729] T 9586d856265d48cb80a6aabf71ee25ff P 91cfea43aaac41249f8bffa4ae0c3366 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91cfea43aaac41249f8bffa4ae0c3366, State: Initialized, Role: FOLLOWER
I20260811 05:10:29.649833 17700 consensus_queue.cc:260] T 9586d856265d48cb80a6aabf71ee25ff P 91cfea43aaac41249f8bffa4ae0c3366 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5641a5f8c562460583a125fdbcd4bafc" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 33341 } } peers { permanent_uuid: "eef4d191e08f406ab76a3b3d722cbdca" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 35057 } } peers { permanent_uuid: "91cfea43aaac41249f8bffa4ae0c3366" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 34413 } }
I20260811 05:10:29.650141 17700 ts_tablet_manager.cc:1428] T 9586d856265d48cb80a6aabf71ee25ff P 91cfea43aaac41249f8bffa4ae0c3366: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260811 05:10:29.650228 17668 heartbeater.cc:503] Master 127.26.191.254:43163 was elected leader, sending a full tablet report...
I20260811 05:10:29.650247 17707 tablet_bootstrap.cc:492] T 9586d856265d48cb80a6aabf71ee25ff P eef4d191e08f406ab76a3b3d722cbdca: No bootstrap required, opened a new log
I20260811 05:10:29.650357 17707 ts_tablet_manager.cc:1397] T 9586d856265d48cb80a6aabf71ee25ff P eef4d191e08f406ab76a3b3d722cbdca: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 05:10:29.652181 17707 raft_consensus.cc:348] T 9586d856265d48cb80a6aabf71ee25ff P eef4d191e08f406ab76a3b3d722cbdca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5641a5f8c562460583a125fdbcd4bafc" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 33341 } } peers { permanent_uuid: "eef4d191e08f406ab76a3b3d722cbdca" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 35057 } } peers { permanent_uuid: "91cfea43aaac41249f8bffa4ae0c3366" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 34413 } }
I20260811 05:10:29.652364 17707 raft_consensus.cc:374] T 9586d856265d48cb80a6aabf71ee25ff P eef4d191e08f406ab76a3b3d722cbdca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:10:29.652428 17707 raft_consensus.cc:729] T 9586d856265d48cb80a6aabf71ee25ff P eef4d191e08f406ab76a3b3d722cbdca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eef4d191e08f406ab76a3b3d722cbdca, State: Initialized, Role: FOLLOWER
I20260811 05:10:29.652562 17707 consensus_queue.cc:260] T 9586d856265d48cb80a6aabf71ee25ff P eef4d191e08f406ab76a3b3d722cbdca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5641a5f8c562460583a125fdbcd4bafc" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 33341 } } peers { permanent_uuid: "eef4d191e08f406ab76a3b3d722cbdca" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 35057 } } peers { permanent_uuid: "91cfea43aaac41249f8bffa4ae0c3366" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 34413 } }
I20260811 05:10:29.652917 17707 ts_tablet_manager.cc:1428] T 9586d856265d48cb80a6aabf71ee25ff P eef4d191e08f406ab76a3b3d722cbdca: Time spent starting tablet: real 0.003s user 0.001s sys 0.002s
I20260811 05:10:29.652952 17235 heartbeater.cc:503] Master 127.26.191.254:43163 was elected leader, sending a full tablet report...
W20260811 05:10:29.685127 17456 tablet.cc:2369] T 9586d856265d48cb80a6aabf71ee25ff P 5641a5f8c562460583a125fdbcd4bafc: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 05:10:29.765928 17237 tablet.cc:2369] T 9586d856265d48cb80a6aabf71ee25ff P eef4d191e08f406ab76a3b3d722cbdca: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 05:10:29.798851 17709 raft_consensus.cc:482] T 9586d856265d48cb80a6aabf71ee25ff P 5641a5f8c562460583a125fdbcd4bafc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 05:10:29.799014 17709 raft_consensus.cc:504] T 9586d856265d48cb80a6aabf71ee25ff P 5641a5f8c562460583a125fdbcd4bafc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5641a5f8c562460583a125fdbcd4bafc" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 33341 } } peers { permanent_uuid: "eef4d191e08f406ab76a3b3d722cbdca" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 35057 } } peers { permanent_uuid: "91cfea43aaac41249f8bffa4ae0c3366" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 34413 } }
I20260811 05:10:29.799510 17709 leader_election.cc:288] T 9586d856265d48cb80a6aabf71ee25ff P 5641a5f8c562460583a125fdbcd4bafc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eef4d191e08f406ab76a3b3d722cbdca (127.26.191.193:35057), 91cfea43aaac41249f8bffa4ae0c3366 (127.26.191.195:34413)
I20260811 05:10:29.802592 17695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:29.799829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.194:38789 (local address 127.26.191.195:34413)
0811 05:10:29.799910 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0811 05:10:29.799912 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:10:29.799922 (+ 10us) server_negotiation.cc:407] Connection header received
0811 05:10:29.799950 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:10:29.799951 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:10:29.799959 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:10:29.800013 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:10:29.800213 (+ 200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:29.800881 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:29.801837 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:29.802229 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:29.802314 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:29.802323 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 05:10:29.802477 (+ 154us) server_negotiation.cc:299] Negotiation successful
0811 05:10:29.802514 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 05:10:29.802634 17457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:29.799729 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.195:34413 (local address 127.26.191.194:38789)
0811 05:10:29.799795 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:29.799809 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 05:10:29.799862 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:10:29.800044 (+ 182us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:10:29.800045 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:10:29.800047 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:10:29.800138 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:10:29.800140 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:10:29.800967 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:10:29.800968 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:10:29.801742 (+ 774us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:10:29.801744 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:10:29.802312 (+ 568us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:10:29.802313 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:10:29.802404 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:29.802407 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 05:10:29.802472 (+ 65us) client_negotiation.cc:240] Negotiation successful
0811 05:10:29.802514 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40}
I20260811 05:10:29.802641 17699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:29.799846 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.194:38265 (local address 127.26.191.193:35057)
0811 05:10:29.799894 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 05:10:29.799896 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:10:29.800221 (+ 325us) server_negotiation.cc:407] Connection header received
0811 05:10:29.800285 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:10:29.800286 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:10:29.800295 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:10:29.800332 (+ 37us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:10:29.800497 (+ 165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:29.800993 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:29.801937 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:29.802301 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:29.802380 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:29.802389 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 05:10:29.802529 (+ 140us) server_negotiation.cc:299] Negotiation successful
0811 05:10:29.802568 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 05:10:29.802718 17714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:29.799737 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.193:35057 (local address 127.26.191.194:38265)
0811 05:10:29.800146 (+ 409us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:29.800156 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 05:10:29.800227 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:10:29.800353 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:10:29.800354 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:10:29.800356 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:10:29.800430 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:10:29.800432 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:10:29.801083 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:10:29.801085 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:10:29.801833 (+ 748us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:10:29.801835 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:10:29.802381 (+ 546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:10:29.802382 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:10:29.802457 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:29.802460 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 05:10:29.802523 (+ 63us) client_negotiation.cc:240] Negotiation successful
0811 05:10:29.802562 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":392,"mutex_wait_us":179,"thread_start_us":153,"threads_started":1}
I20260811 05:10:29.802980 17589 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9586d856265d48cb80a6aabf71ee25ff" candidate_uuid: "5641a5f8c562460583a125fdbcd4bafc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91cfea43aaac41249f8bffa4ae0c3366" is_pre_election: true
I20260811 05:10:29.803160 17589 raft_consensus.cc:2454] T 9586d856265d48cb80a6aabf71ee25ff P 91cfea43aaac41249f8bffa4ae0c3366 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5641a5f8c562460583a125fdbcd4bafc in term 0.
I20260811 05:10:29.803248 17161 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9586d856265d48cb80a6aabf71ee25ff" candidate_uuid: "5641a5f8c562460583a125fdbcd4bafc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eef4d191e08f406ab76a3b3d722cbdca" is_pre_election: true
I20260811 05:10:29.803421 17161 raft_consensus.cc:2454] T 9586d856265d48cb80a6aabf71ee25ff P eef4d191e08f406ab76a3b3d722cbdca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5641a5f8c562460583a125fdbcd4bafc in term 0.
I20260811 05:10:29.803436 17268 leader_election.cc:302] T 9586d856265d48cb80a6aabf71ee25ff P 5641a5f8c562460583a125fdbcd4bafc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5641a5f8c562460583a125fdbcd4bafc, 91cfea43aaac41249f8bffa4ae0c3366; no voters:
I20260811 05:10:29.803579 17709 raft_consensus.cc:2781] T 9586d856265d48cb80a6aabf71ee25ff P 5641a5f8c562460583a125fdbcd4bafc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 05:10:29.803642 17709 raft_consensus.cc:482] T 9586d856265d48cb80a6aabf71ee25ff P 5641a5f8c562460583a125fdbcd4bafc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 05:10:29.803666 17709 raft_consensus.cc:3037] T 9586d856265d48cb80a6aabf71ee25ff P 5641a5f8c562460583a125fdbcd4bafc [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:10:29.804432 17709 raft_consensus.cc:504] T 9586d856265d48cb80a6aabf71ee25ff P 5641a5f8c562460583a125fdbcd4bafc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5641a5f8c562460583a125fdbcd4bafc" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 33341 } } peers { permanent_uuid: "eef4d191e08f406ab76a3b3d722cbdca" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 35057 } } peers { permanent_uuid: "91cfea43aaac41249f8bffa4ae0c3366" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 34413 } }
I20260811 05:10:29.804582 17709 leader_election.cc:288] T 9586d856265d48cb80a6aabf71ee25ff P 5641a5f8c562460583a125fdbcd4bafc [CANDIDATE]: Term 1 election: Requested vote from peers eef4d191e08f406ab76a3b3d722cbdca (127.26.191.193:35057), 91cfea43aaac41249f8bffa4ae0c3366 (127.26.191.195:34413)
I20260811 05:10:29.804764 17161 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9586d856265d48cb80a6aabf71ee25ff" candidate_uuid: "5641a5f8c562460583a125fdbcd4bafc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eef4d191e08f406ab76a3b3d722cbdca"
I20260811 05:10:29.804800 17589 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9586d856265d48cb80a6aabf71ee25ff" candidate_uuid: "5641a5f8c562460583a125fdbcd4bafc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91cfea43aaac41249f8bffa4ae0c3366"
I20260811 05:10:29.804863 17161 raft_consensus.cc:3037] T 9586d856265d48cb80a6aabf71ee25ff P eef4d191e08f406ab76a3b3d722cbdca [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:10:29.804895 17589 raft_consensus.cc:3037] T 9586d856265d48cb80a6aabf71ee25ff P 91cfea43aaac41249f8bffa4ae0c3366 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:10:29.805588 17589 raft_consensus.cc:2454] T 9586d856265d48cb80a6aabf71ee25ff P 91cfea43aaac41249f8bffa4ae0c3366 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5641a5f8c562460583a125fdbcd4bafc in term 1.
I20260811 05:10:29.805660 17161 raft_consensus.cc:2454] T 9586d856265d48cb80a6aabf71ee25ff P eef4d191e08f406ab76a3b3d722cbdca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5641a5f8c562460583a125fdbcd4bafc in term 1.
I20260811 05:10:29.805759 17268 leader_election.cc:302] T 9586d856265d48cb80a6aabf71ee25ff P 5641a5f8c562460583a125fdbcd4bafc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5641a5f8c562460583a125fdbcd4bafc, 91cfea43aaac41249f8bffa4ae0c3366; no voters:
I20260811 05:10:29.805859 17709 raft_consensus.cc:2781] T 9586d856265d48cb80a6aabf71ee25ff P 5641a5f8c562460583a125fdbcd4bafc [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:10:29.806046 17709 raft_consensus.cc:686] T 9586d856265d48cb80a6aabf71ee25ff P 5641a5f8c562460583a125fdbcd4bafc [term 1 LEADER]: Becoming Leader. State: Replica: 5641a5f8c562460583a125fdbcd4bafc, State: Running, Role: LEADER
I20260811 05:10:29.806166 17709 consensus_queue.cc:237] T 9586d856265d48cb80a6aabf71ee25ff P 5641a5f8c562460583a125fdbcd4bafc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5641a5f8c562460583a125fdbcd4bafc" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 33341 } } peers { permanent_uuid: "eef4d191e08f406ab76a3b3d722cbdca" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 35057 } } peers { permanent_uuid: "91cfea43aaac41249f8bffa4ae0c3366" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 34413 } }
I20260811 05:10:29.806993 16911 catalog_manager.cc:5495] T 9586d856265d48cb80a6aabf71ee25ff P 5641a5f8c562460583a125fdbcd4bafc reported cstate change: term changed from 0 to 1, leader changed from <none> to 5641a5f8c562460583a125fdbcd4bafc (127.26.191.194). New cstate: current_term: 1 leader_uuid: "5641a5f8c562460583a125fdbcd4bafc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5641a5f8c562460583a125fdbcd4bafc" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 33341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eef4d191e08f406ab76a3b3d722cbdca" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91cfea43aaac41249f8bffa4ae0c3366" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 34413 } health_report { overall_health: UNKNOWN } } }
I20260811 05:10:29.820120 17693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:29.817574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33790 (local address 127.26.191.194:33341)
0811 05:10:29.817667 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0811 05:10:29.817669 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:10:29.817679 (+ 10us) server_negotiation.cc:407] Connection header received
0811 05:10:29.817748 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:10:29.817748 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:10:29.817770 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:10:29.817845 (+ 75us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:10:29.817974 (+ 129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:29.818514 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:29.819291 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:29.819499 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:29.819557 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:29.819692 (+ 135us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:10:29.819833 (+ 141us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:10:29.819902 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 05:10:29.819939 (+ 37us) server_negotiation.cc:299] Negotiation successful
0811 05:10:29.819959 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 05:10:29.822218 17161 raft_consensus.cc:1261] T 9586d856265d48cb80a6aabf71ee25ff P eef4d191e08f406ab76a3b3d722cbdca [term 1 FOLLOWER]: Refusing update from remote peer 5641a5f8c562460583a125fdbcd4bafc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:10:29.822218 17589 raft_consensus.cc:1261] T 9586d856265d48cb80a6aabf71ee25ff P 91cfea43aaac41249f8bffa4ae0c3366 [term 1 FOLLOWER]: Refusing update from remote peer 5641a5f8c562460583a125fdbcd4bafc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:10:29.822638 17716 consensus_queue.cc:1035] T 9586d856265d48cb80a6aabf71ee25ff P 5641a5f8c562460583a125fdbcd4bafc [LEADER]: Connected to new peer: Peer: permanent_uuid: "91cfea43aaac41249f8bffa4ae0c3366" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 34413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:10:29.822825 17709 consensus_queue.cc:1035] T 9586d856265d48cb80a6aabf71ee25ff P 5641a5f8c562460583a125fdbcd4bafc [LEADER]: Connected to new peer: Peer: permanent_uuid: "eef4d191e08f406ab76a3b3d722cbdca" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:10:29.825621 17723 mvcc.cc:205] Tried to move back new op lower bound from 7317196922148175872 to 7317196922086682624. Current Snapshot: MvccSnapshot[applied={T|T < 7317196922148175872}]
I20260811 05:10:29.827852 16911 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51682:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:10:29.827966 16911 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51682:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:10:29.828857 16911 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ba2c2f0becd44f9b9bd520495c4cac41: Sending DeleteTablet for 3 replicas of tablet 9586d856265d48cb80a6aabf71ee25ff
I20260811 05:10:29.829186 17344 tablet_service.cc:1514] Processing DeleteTablet for tablet 9586d856265d48cb80a6aabf71ee25ff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:10:29 UTC) from {username='kudu', principal='kudu/127.26.191.254@KRBTEST.COM'} at 127.0.0.1:33788
I20260811 05:10:29.829237 17556 tablet_service.cc:1514] Processing DeleteTablet for tablet 9586d856265d48cb80a6aabf71ee25ff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:10:29 UTC) from {username='kudu', principal='kudu/127.26.191.254@KRBTEST.COM'} at 127.0.0.1:59888
I20260811 05:10:29.829504 17738 tablet_replica.cc:330] T 9586d856265d48cb80a6aabf71ee25ff P 5641a5f8c562460583a125fdbcd4bafc: stopping tablet replica
I20260811 05:10:29.829514 17742 tablet_replica.cc:330] T 9586d856265d48cb80a6aabf71ee25ff P 91cfea43aaac41249f8bffa4ae0c3366: stopping tablet replica
I20260811 05:10:29.829530 17128 tablet_service.cc:1514] Processing DeleteTablet for tablet 9586d856265d48cb80a6aabf71ee25ff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:10:29 UTC) from {username='kudu', principal='kudu/127.26.191.254@KRBTEST.COM'} at 127.0.0.1:35810
I20260811 05:10:29.829617 17742 raft_consensus.cc:2229] T 9586d856265d48cb80a6aabf71ee25ff P 91cfea43aaac41249f8bffa4ae0c3366 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 05:10:29.829734 17742 raft_consensus.cc:2258] T 9586d856265d48cb80a6aabf71ee25ff P 91cfea43aaac41249f8bffa4ae0c3366 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:10:29.829816 17738 raft_consensus.cc:2229] T 9586d856265d48cb80a6aabf71ee25ff P 5641a5f8c562460583a125fdbcd4bafc [term 1 LEADER]: Raft consensus shutting down.
I20260811 05:10:29.829870 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 17015
I20260811 05:10:29.837308 17738 raft_consensus.cc:2258] T 9586d856265d48cb80a6aabf71ee25ff P 5641a5f8c562460583a125fdbcd4bafc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:10:29.839833 17738 ts_tablet_manager.cc:1905] T 9586d856265d48cb80a6aabf71ee25ff P 5641a5f8c562460583a125fdbcd4bafc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:10:29.841595 17738 ts_tablet_manager.cc:1918] T 9586d856265d48cb80a6aabf71ee25ff P 5641a5f8c562460583a125fdbcd4bafc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 05:10:29.841686 17738 log.cc:1196] T 9586d856265d48cb80a6aabf71ee25ff P 5641a5f8c562460583a125fdbcd4bafc: Deleting WAL directory at /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-1/wal/wals/9586d856265d48cb80a6aabf71ee25ff
I20260811 05:10:29.842012 17738 ts_tablet_manager.cc:1939] T 9586d856265d48cb80a6aabf71ee25ff P 5641a5f8c562460583a125fdbcd4bafc: Deleting consensus metadata
I20260811 05:10:29.842537 16890 catalog_manager.cc:4841] TS 5641a5f8c562460583a125fdbcd4bafc (127.26.191.194:33341): tablet 9586d856265d48cb80a6aabf71ee25ff (table test-table [id=c9bb3b0de8b74cf88addfeb4c29204c2]) successfully deleted
I20260811 05:10:29.845104 17742 ts_tablet_manager.cc:1905] T 9586d856265d48cb80a6aabf71ee25ff P 91cfea43aaac41249f8bffa4ae0c3366: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 05:10:29.846246 16890 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.191.193:35057 (error 108)
I20260811 05:10:29.846784 17742 ts_tablet_manager.cc:1918] T 9586d856265d48cb80a6aabf71ee25ff P 91cfea43aaac41249f8bffa4ae0c3366: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 05:10:29.846828 17698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:29.846681 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.193:35057 (local address 127.0.0.1:35812)
0811 05:10:29.846740 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:29.846782 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.193:35057: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260811 05:10:29.846868 17742 log.cc:1196] T 9586d856265d48cb80a6aabf71ee25ff P 91cfea43aaac41249f8bffa4ae0c3366: Deleting WAL directory at /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-2/wal/wals/9586d856265d48cb80a6aabf71ee25ff
W20260811 05:10:29.846943 16890 catalog_manager.cc:4584] TS eef4d191e08f406ab76a3b3d722cbdca (127.26.191.193:35057): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 9586d856265d48cb80a6aabf71ee25ff: Network error: Client connection negotiation failed: client connection to 127.26.191.193:35057: connect: Connection refused (error 111)
I20260811 05:10:29.847175 17742 ts_tablet_manager.cc:1939] T 9586d856265d48cb80a6aabf71ee25ff P 91cfea43aaac41249f8bffa4ae0c3366: Deleting consensus metadata
I20260811 05:10:29.847270 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 17247
I20260811 05:10:29.852125 16887 catalog_manager.cc:4841] TS 91cfea43aaac41249f8bffa4ae0c3366 (127.26.191.195:34413): tablet 9586d856265d48cb80a6aabf71ee25ff (table test-table [id=c9bb3b0de8b74cf88addfeb4c29204c2]) successfully deleted
I20260811 05:10:29.859705 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 17461
I20260811 05:10:29.871922 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 16861
I20260811 05:10:29.887761 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.254:43163
--webserver_interface=127.26.191.254
--webserver_port=34063
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab
--principal=kudu/127.26.191.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:33749
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.191.254:43163
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:10:29.982530 17746 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:10:29.982895 17746 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:10:29.982940 17746 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:10:29.985173 17746 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:10:29.985224 17746 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:10:29.985247 17746 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:10:29.985268 17746 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:10:29.985288 17746 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:10:29.987520 17746 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:33749
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.26.191.254:43163
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab
--principal=kudu/127.26.191.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.254:43163
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.191.254
--webserver_port=34063
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17746
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:10:29.987835 17746 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:10:29.988113 17746 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:10:30.000440 17757 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:10:30.000422 17756 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:10:30.000424 17760 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:10:30.000816 17746 server_base.cc:1034] running on GCE node
I20260811 05:10:30.001205 17746 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:10:30.001569 17746 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:10:30.002748 17746 hybrid_clock.cc:648] HybridClock initialized: now 1786425030002717 us; error 48 us; skew 500 ppm
Aug 11 05:10:30 dist-test-slave-x5fp krb5kdc[16839](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425030, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:10:30.005751 17746 init.cc:377] Logged in from keytab as kudu/127.26.191.254@KRBTEST.COM (short username kudu)
I20260811 05:10:30.006299 17746 webserver.cc:460] Webserver started at http://127.26.191.254:34063/ using document root <none> and password file <none>
I20260811 05:10:30.006570 17746 fs_manager.cc:359] Metadata directory not provided
I20260811 05:10:30.006655 17746 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:10:30.008289 17746 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 05:10:30.009147 17771 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:10:30.009400 17746 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 05:10:30.009513 17746 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/master-0/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/master-0/wal
uuid: "ba2c2f0becd44f9b9bd520495c4cac41"
format_stamp: "Formatted at 2026-08-11 05:10:29 on dist-test-slave-x5fp"
server_key: "04f58b49b582c5e55456094e5efd2200"
server_key_iv: "7fde29bab3f127054d556d3900a6962e"
server_key_version: "encryptionkey@0"
I20260811 05:10:30.009969 17746 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:10:30.033550 17746 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:10:30.035797 17746 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:10:30.035992 17746 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:10:30.040243 17746 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.254:43163
I20260811 05:10:30.040288 17857 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.254:43163 every 8 connection(s)
I20260811 05:10:30.040712 17746 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
I20260811 05:10:30.042518 17858 sys_catalog.cc:263] Verifying existing consensus state
I20260811 05:10:30.043243 17858 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ba2c2f0becd44f9b9bd520495c4cac41: Bootstrap starting.
I20260811 05:10:30.046880 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 17746
I20260811 05:10:30.047175 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.191.193:35057
--local_ip_for_outbound_sockets=127.26.191.193
--tserver_master_addrs=127.26.191.254:43163
--webserver_port=44305
--webserver_interface=127.26.191.193
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.193.keytab
--principal=kudu/127.26.191.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:33749
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 05:10:30.053311 17858 log.cc:824] T 00000000000000000000000000000000 P ba2c2f0becd44f9b9bd520495c4cac41: Log is configured to *not* fsync() on all Append() calls
I20260811 05:10:30.055389 17858 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ba2c2f0becd44f9b9bd520495c4cac41: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 05:10:30.055747 17858 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ba2c2f0becd44f9b9bd520495c4cac41: Bootstrap complete.
I20260811 05:10:30.058327 17858 raft_consensus.cc:348] T 00000000000000000000000000000000 P ba2c2f0becd44f9b9bd520495c4cac41 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba2c2f0becd44f9b9bd520495c4cac41" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 43163 } }
I20260811 05:10:30.058564 17858 raft_consensus.cc:729] T 00000000000000000000000000000000 P ba2c2f0becd44f9b9bd520495c4cac41 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba2c2f0becd44f9b9bd520495c4cac41, State: Initialized, Role: FOLLOWER
I20260811 05:10:30.058750 17858 consensus_queue.cc:260] T 00000000000000000000000000000000 P ba2c2f0becd44f9b9bd520495c4cac41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba2c2f0becd44f9b9bd520495c4cac41" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 43163 } }
I20260811 05:10:30.058817 17858 raft_consensus.cc:388] T 00000000000000000000000000000000 P ba2c2f0becd44f9b9bd520495c4cac41 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:10:30.058878 17858 raft_consensus.cc:482] T 00000000000000000000000000000000 P ba2c2f0becd44f9b9bd520495c4cac41 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:10:30.058945 17858 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ba2c2f0becd44f9b9bd520495c4cac41 [term 1 FOLLOWER]: Advancing to term 2
I20260811 05:10:30.060017 17858 raft_consensus.cc:504] T 00000000000000000000000000000000 P ba2c2f0becd44f9b9bd520495c4cac41 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba2c2f0becd44f9b9bd520495c4cac41" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 43163 } }
I20260811 05:10:30.060132 17858 leader_election.cc:302] T 00000000000000000000000000000000 P ba2c2f0becd44f9b9bd520495c4cac41 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ba2c2f0becd44f9b9bd520495c4cac41; no voters:
I20260811 05:10:30.060345 17858 leader_election.cc:288] T 00000000000000000000000000000000 P ba2c2f0becd44f9b9bd520495c4cac41 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 05:10:30.060386 17863 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ba2c2f0becd44f9b9bd520495c4cac41 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 05:10:30.060506 17863 raft_consensus.cc:686] T 00000000000000000000000000000000 P ba2c2f0becd44f9b9bd520495c4cac41 [term 2 LEADER]: Becoming Leader. State: Replica: ba2c2f0becd44f9b9bd520495c4cac41, State: Running, Role: LEADER
I20260811 05:10:30.060608 17863 consensus_queue.cc:237] T 00000000000000000000000000000000 P ba2c2f0becd44f9b9bd520495c4cac41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba2c2f0becd44f9b9bd520495c4cac41" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 43163 } }
I20260811 05:10:30.060644 17858 sys_catalog.cc:564] T 00000000000000000000000000000000 P ba2c2f0becd44f9b9bd520495c4cac41 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:10:30.060901 17866 sys_catalog.cc:455] T 00000000000000000000000000000000 P ba2c2f0becd44f9b9bd520495c4cac41 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "ba2c2f0becd44f9b9bd520495c4cac41" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba2c2f0becd44f9b9bd520495c4cac41" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 43163 } } }
I20260811 05:10:30.060997 17866 sys_catalog.cc:458] T 00000000000000000000000000000000 P ba2c2f0becd44f9b9bd520495c4cac41 [sys.catalog]: This master's current role is: LEADER
I20260811 05:10:30.061255 17868 sys_catalog.cc:455] T 00000000000000000000000000000000 P ba2c2f0becd44f9b9bd520495c4cac41 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ba2c2f0becd44f9b9bd520495c4cac41. Latest consensus state: current_term: 2 leader_uuid: "ba2c2f0becd44f9b9bd520495c4cac41" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba2c2f0becd44f9b9bd520495c4cac41" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 43163 } } }
I20260811 05:10:30.061360 17868 sys_catalog.cc:458] T 00000000000000000000000000000000 P ba2c2f0becd44f9b9bd520495c4cac41 [sys.catalog]: This master's current role is: LEADER
I20260811 05:10:30.061511 17878 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:10:30.062413 17878 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:10:30.062513 17878 catalog_manager.cc:1259] Loaded cluster ID: de5f0fec5a204d9fb159c5c5bb6f39a7
I20260811 05:10:30.062548 17878 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:10:30.062956 17878 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260811 05:10:30.068033 17878 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260811 05:10:30.070792 17878 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:10:30.071048 17878 catalog_manager.cc:5879] T 00000000000000000000000000000000 P ba2c2f0becd44f9b9bd520495c4cac41: Loaded TSK: 0
I20260811 05:10:30.071277 17878 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 05:10:30.137741 17860 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:10:30.137951 17860 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:10:30.137975 17860 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:10:30.139122 17860 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:10:30.139164 17860 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:10:30.139190 17860 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.191.193
I20260811 05:10:30.140630 17860 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:33749
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.193.keytab
--principal=kudu/127.26.191.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.191.193:35057
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.191.193
--webserver_port=44305
--tserver_master_addrs=127.26.191.254:43163
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17860
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.191.193
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:10:30.140901 17860 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:10:30.141140 17860 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:10:30.146461 17910 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:10:30.146477 17914 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:10:30.146445 17911 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:10:30.146689 17860 server_base.cc:1034] running on GCE node
I20260811 05:10:30.146927 17860 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:10:30.147218 17860 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:10:30.148411 17860 hybrid_clock.cc:648] HybridClock initialized: now 1786425030148394 us; error 32 us; skew 500 ppm
Aug 11 05:10:30 dist-test-slave-x5fp krb5kdc[16839](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425030, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:10:30.151600 17860 init.cc:377] Logged in from keytab as kudu/127.26.191.193@KRBTEST.COM (short username kudu)
I20260811 05:10:30.152120 17860 webserver.cc:460] Webserver started at http://127.26.191.193:44305/ using document root <none> and password file <none>
I20260811 05:10:30.152382 17860 fs_manager.cc:359] Metadata directory not provided
I20260811 05:10:30.152468 17860 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:10:30.154281 17860 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:10:30.155068 17925 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:10:30.155321 17860 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:10:30.155421 17860 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-0/wal
uuid: "eef4d191e08f406ab76a3b3d722cbdca"
format_stamp: "Formatted at 2026-08-11 05:10:29 on dist-test-slave-x5fp"
server_key: "805efe0fd7a3a4f93c06af8ccaa17225"
server_key_iv: "77b8c060e62f2548ca1c573b3328f660"
server_key_version: "encryptionkey@0"
I20260811 05:10:30.155872 17860 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:10:30.171991 17860 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:10:30.174691 17860 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:10:30.174865 17860 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:10:30.175148 17860 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:10:30.175719 17943 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 05:10:30.177419 17860 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 05:10:30.177484 17860 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260811 05:10:30.177521 17860 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 05:10:30.178423 17860 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 05:10:30.178471 17860 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260811 05:10:30.178560 17943 tablet_bootstrap.cc:492] T 9586d856265d48cb80a6aabf71ee25ff P eef4d191e08f406ab76a3b3d722cbdca: Bootstrap starting.
I20260811 05:10:30.185513 17860 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.193:35057
I20260811 05:10:30.185802 18121 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.193:35057 every 8 connection(s)
I20260811 05:10:30.185932 17860 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-0/data/info.pb
I20260811 05:10:30.190593 17943 log.cc:824] T 9586d856265d48cb80a6aabf71ee25ff P eef4d191e08f406ab76a3b3d722cbdca: Log is configured to *not* fsync() on all Append() calls
I20260811 05:10:30.193487 17943 tablet_bootstrap.cc:492] T 9586d856265d48cb80a6aabf71ee25ff P eef4d191e08f406ab76a3b3d722cbdca: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 05:10:30.193929 17943 tablet_bootstrap.cc:492] T 9586d856265d48cb80a6aabf71ee25ff P eef4d191e08f406ab76a3b3d722cbdca: Bootstrap complete.
I20260811 05:10:30.195075 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 17860
I20260811 05:10:30.195366 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.191.194:33341
--local_ip_for_outbound_sockets=127.26.191.194
--tserver_master_addrs=127.26.191.254:43163
--webserver_port=43125
--webserver_interface=127.26.191.194
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.194.keytab
--principal=kudu/127.26.191.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:33749
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 05:10:30.195400 17943 ts_tablet_manager.cc:1397] T 9586d856265d48cb80a6aabf71ee25ff P eef4d191e08f406ab76a3b3d722cbdca: Time spent bootstrapping tablet: real 0.017s user 0.005s sys 0.011s
I20260811 05:10:30.196691 17943 raft_consensus.cc:348] T 9586d856265d48cb80a6aabf71ee25ff P eef4d191e08f406ab76a3b3d722cbdca [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5641a5f8c562460583a125fdbcd4bafc" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 33341 } } peers { permanent_uuid: "eef4d191e08f406ab76a3b3d722cbdca" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 35057 } } peers { permanent_uuid: "91cfea43aaac41249f8bffa4ae0c3366" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 34413 } }
I20260811 05:10:30.197031 17943 raft_consensus.cc:729] T 9586d856265d48cb80a6aabf71ee25ff P eef4d191e08f406ab76a3b3d722cbdca [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: eef4d191e08f406ab76a3b3d722cbdca, State: Initialized, Role: FOLLOWER
I20260811 05:10:30.197191 17943 consensus_queue.cc:260] T 9586d856265d48cb80a6aabf71ee25ff P eef4d191e08f406ab76a3b3d722cbdca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5641a5f8c562460583a125fdbcd4bafc" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 33341 } } peers { permanent_uuid: "eef4d191e08f406ab76a3b3d722cbdca" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 35057 } } peers { permanent_uuid: "91cfea43aaac41249f8bffa4ae0c3366" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 34413 } }
I20260811 05:10:30.197466 17943 ts_tablet_manager.cc:1428] T 9586d856265d48cb80a6aabf71ee25ff P eef4d191e08f406ab76a3b3d722cbdca: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
Aug 11 05:10:30 dist-test-slave-x5fp krb5kdc[16839](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425030, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.193@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
I20260811 05:10:30.202040 18127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:30.186805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.193:40951 (local address 127.26.191.254:43163)
0811 05:10:30.187046 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0811 05:10:30.187056 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 05:10:30.187316 (+ 260us) server_negotiation.cc:407] Connection header received
0811 05:10:30.188230 (+ 914us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:10:30.188237 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:10:30.188307 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:10:30.188457 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:10:30.189596 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:30.190987 (+ 1391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:30.192040 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:30.192475 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:30.192606 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:30.198312 (+ 5706us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:10:30.198317 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:10:30.198318 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:10:30.198331 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:10:30.200086 (+ 1755us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:10:30.200567 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:10:30.200571 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:10:30.200571 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:10:30.200683 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:10:30.201016 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:10:30.201017 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:10:30.201017 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:10:30.201292 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:10:30.201393 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0811 05:10:30.201691 (+ 298us) server_negotiation.cc:299] Negotiation successful
0811 05:10:30.201840 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":181,"thread_start_us":124,"threads_started":1}
I20260811 05:10:30.202040 18125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:30.186671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:43163 (local address 127.26.191.193:40951)
0811 05:10:30.187096 (+ 425us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:30.187158 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0811 05:10:30.187971 (+ 813us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:10:30.188531 (+ 560us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:10:30.188536 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:10:30.189091 (+ 555us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:10:30.189457 (+ 366us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:10:30.189465 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:10:30.191119 (+ 1654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:10:30.191120 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:10:30.191943 (+ 823us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:10:30.191945 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:10:30.192596 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:10:30.192597 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:10:30.192788 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:30.193370 (+ 582us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:10:30.193379 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:10:30.198192 (+ 4813us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:10:30.200208 (+ 2016us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:10:30.200216 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:10:30.200219 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:10:30.200472 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:10:30.200820 (+ 348us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:10:30.200821 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:10:30.200821 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:10:30.200938 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:10:30.201370 (+ 432us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:10:30.201378 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:10:30.201519 (+ 141us) client_negotiation.cc:769] Sending connection context
0811 05:10:30.201633 (+ 114us) client_negotiation.cc:240] Negotiation successful
0811 05:10:30.201834 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":362,"thread_start_us":94,"threads_started":1}
I20260811 05:10:30.203207 18122 heartbeater.cc:347] Connected to a master server at 127.26.191.254:43163
I20260811 05:10:30.203316 18122 heartbeater.cc:464] Registering TS with master...
I20260811 05:10:30.203513 18122 heartbeater.cc:511] Master 127.26.191.254:43163 requested a full tablet report, sending...
I20260811 05:10:30.204344 17797 ts_manager.cc:194] Registered new tserver with Master: eef4d191e08f406ab76a3b3d722cbdca (127.26.191.193:35057)
I20260811 05:10:30.205605 17797 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.191.193@KRBTEST.COM'} at 127.26.191.193:40951
I20260811 05:10:30.206723 18122 heartbeater.cc:503] Master 127.26.191.254:43163 was elected leader, sending a full tablet report...
Aug 11 05:10:30 dist-test-slave-x5fp krb5kdc[16839](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425030, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.254@KRBTEST.COM for kudu/127.26.191.193@KRBTEST.COM
I20260811 05:10:30.213856 18133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:30.205069 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.193:35057 (local address 127.0.0.1:35822)
0811 05:10:30.205382 (+ 313us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:30.205418 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 05:10:30.205498 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:10:30.205709 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:10:30.205714 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:10:30.206053 (+ 339us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:10:30.206113 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:10:30.206116 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:10:30.207281 (+ 1165us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:10:30.207282 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:10:30.207896 (+ 614us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:10:30.207899 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:10:30.208387 (+ 488us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:10:30.208388 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:10:30.208468 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:30.209041 (+ 573us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:10:30.209047 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:10:30.210632 (+ 1585us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:10:30.212551 (+ 1919us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:10:30.212559 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:10:30.212561 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:10:30.212842 (+ 281us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:10:30.213069 (+ 227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:10:30.213069 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:10:30.213070 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:10:30.213133 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:10:30.213461 (+ 328us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:10:30.213468 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:10:30.213523 (+ 55us) client_negotiation.cc:769] Sending connection context
0811 05:10:30.213617 (+ 94us) client_negotiation.cc:240] Negotiation successful
0811 05:10:30.213753 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":284,"thread_start_us":115,"threads_started":1}
I20260811 05:10:30.213868 18134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:30.205145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35822 (local address 127.26.191.193:35057)
0811 05:10:30.205314 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0811 05:10:30.205319 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:10:30.205505 (+ 186us) server_negotiation.cc:407] Connection header received
0811 05:10:30.205583 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:10:30.205585 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:10:30.205603 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:10:30.205684 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:10:30.206220 (+ 536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:30.207184 (+ 964us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:30.207999 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:30.208307 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:30.208387 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:30.210770 (+ 2383us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:10:30.210778 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:10:30.210778 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:10:30.210785 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:10:30.212462 (+ 1677us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:10:30.212936 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:10:30.212938 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:10:30.212939 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:10:30.213003 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:10:30.213219 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:10:30.213220 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:10:30.213221 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:10:30.213372 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:10:30.213466 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0811 05:10:30.213657 (+ 191us) server_negotiation.cc:299] Negotiation successful
0811 05:10:30.213753 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":43,"server-negotiator.queue_time_us":141,"thread_start_us":96,"threads_started":1}
I20260811 05:10:30.214318 18004 tablet_service.cc:1514] Processing DeleteTablet for tablet 9586d856265d48cb80a6aabf71ee25ff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:10:29 UTC) from {username='kudu', principal='kudu/127.26.191.254@KRBTEST.COM'} at 127.0.0.1:35822
I20260811 05:10:30.214848 18135 tablet_replica.cc:330] stopping tablet replica
I20260811 05:10:30.214958 18135 raft_consensus.cc:2229] T 9586d856265d48cb80a6aabf71ee25ff P eef4d191e08f406ab76a3b3d722cbdca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 05:10:30.215030 18135 raft_consensus.cc:2258] T 9586d856265d48cb80a6aabf71ee25ff P eef4d191e08f406ab76a3b3d722cbdca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:10:30.215332 18135 ts_tablet_manager.cc:1905] T 9586d856265d48cb80a6aabf71ee25ff P eef4d191e08f406ab76a3b3d722cbdca: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:10:30.217257 18135 ts_tablet_manager.cc:1918] T 9586d856265d48cb80a6aabf71ee25ff P eef4d191e08f406ab76a3b3d722cbdca: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 05:10:30.217350 18135 log.cc:1196] T 9586d856265d48cb80a6aabf71ee25ff P eef4d191e08f406ab76a3b3d722cbdca: Deleting WAL directory at /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-0/wal/wals/9586d856265d48cb80a6aabf71ee25ff
I20260811 05:10:30.217628 18135 ts_tablet_manager.cc:1939] T 9586d856265d48cb80a6aabf71ee25ff P eef4d191e08f406ab76a3b3d722cbdca: Deleting consensus metadata
I20260811 05:10:30.218129 17774 catalog_manager.cc:4841] TS eef4d191e08f406ab76a3b3d722cbdca (127.26.191.193:35057): tablet 9586d856265d48cb80a6aabf71ee25ff (table test-table [id=c9bb3b0de8b74cf88addfeb4c29204c2]) successfully deleted
W20260811 05:10:30.294977 18131 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:10:30.295274 18131 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:10:30.295325 18131 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:10:30.296797 18131 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:10:30.296873 18131 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:10:30.296948 18131 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.191.194
I20260811 05:10:30.298714 18131 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:33749
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.194.keytab
--principal=kudu/127.26.191.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.191.194:33341
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.191.194
--webserver_port=43125
--tserver_master_addrs=127.26.191.254:43163
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18131
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.191.194
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:10:30.299026 18131 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:10:30.299290 18131 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:10:30.305125 18151 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:10:30.305189 18152 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:10:30.305189 18154 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:10:30.305644 18131 server_base.cc:1034] running on GCE node
I20260811 05:10:30.305892 18131 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:10:30.306232 18131 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:10:30.307435 18131 hybrid_clock.cc:648] HybridClock initialized: now 1786425030307416 us; error 30 us; skew 500 ppm
Aug 11 05:10:30 dist-test-slave-x5fp krb5kdc[16839](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425030, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:10:30.310473 18131 init.cc:377] Logged in from keytab as kudu/127.26.191.194@KRBTEST.COM (short username kudu)
I20260811 05:10:30.310992 18131 webserver.cc:460] Webserver started at http://127.26.191.194:43125/ using document root <none> and password file <none>
I20260811 05:10:30.311313 18131 fs_manager.cc:359] Metadata directory not provided
I20260811 05:10:30.311420 18131 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:10:30.313123 18131 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 05:10:30.313854 18166 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:10:30.314185 18131 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 05:10:30.314281 18131 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-1/wal
uuid: "5641a5f8c562460583a125fdbcd4bafc"
format_stamp: "Formatted at 2026-08-11 05:10:29 on dist-test-slave-x5fp"
server_key: "fb40a64055cfa20f1d51158c9c9b6974"
server_key_iv: "9a834454292b2c0b770554fc5faefd77"
server_key_version: "encryptionkey@0"
I20260811 05:10:30.314634 18131 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:10:30.340220 18131 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:10:30.342834 18131 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:10:30.342964 18131 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:10:30.343174 18131 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:10:30.343513 18131 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:10:30.343556 18131 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:10:30.343600 18131 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:10:30.343626 18131 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:10:30.351873 18131 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.194:33341
I20260811 05:10:30.351994 18341 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.194:33341 every 8 connection(s)
I20260811 05:10:30.352349 18131 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-1/data/info.pb
I20260811 05:10:30.357069 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 18131
I20260811 05:10:30.357400 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.191.195:34413
--local_ip_for_outbound_sockets=127.26.191.195
--tserver_master_addrs=127.26.191.254:43163
--webserver_port=37913
--webserver_interface=127.26.191.195
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.195.keytab
--principal=kudu/127.26.191.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:33749
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 05:10:30 dist-test-slave-x5fp krb5kdc[16839](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425030, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.194@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
I20260811 05:10:30.362694 18127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:30.353178 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.194:57851 (local address 127.26.191.254:43163)
0811 05:10:30.353236 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 05:10:30.353238 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:10:30.353467 (+ 229us) server_negotiation.cc:407] Connection header received
0811 05:10:30.354024 (+ 557us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:10:30.354026 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:10:30.354038 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:10:30.354106 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:10:30.355259 (+ 1153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:30.355758 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:30.356895 (+ 1137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:30.357098 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:30.357180 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:30.359459 (+ 2279us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:10:30.359461 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:10:30.359461 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:10:30.359494 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:10:30.361182 (+ 1688us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:10:30.361625 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:10:30.361627 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:10:30.361627 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:10:30.361707 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:10:30.361992 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:10:30.361993 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:10:30.361994 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:10:30.362122 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:10:30.362197 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 05:10:30.362499 (+ 302us) server_negotiation.cc:299] Negotiation successful
0811 05:10:30.362598 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 05:10:30.362893 18350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:30.353144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:43163 (local address 127.26.191.194:57851)
0811 05:10:30.353314 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:30.353379 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0811 05:10:30.353911 (+ 532us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:10:30.354237 (+ 326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:10:30.354241 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:10:30.354954 (+ 713us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:10:30.355170 (+ 216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:10:30.355175 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:10:30.355863 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:10:30.355865 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:10:30.356813 (+ 948us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:10:30.356817 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:10:30.357190 (+ 373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:10:30.357191 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:10:30.357330 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:30.357931 (+ 601us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:10:30.357940 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:10:30.359348 (+ 1408us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:10:30.361259 (+ 1911us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:10:30.361267 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:10:30.361269 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:10:30.361537 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:10:30.361775 (+ 238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:10:30.361776 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:10:30.361776 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:10:30.361916 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:10:30.362188 (+ 272us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:10:30.362195 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:10:30.362343 (+ 148us) client_negotiation.cc:769] Sending connection context
0811 05:10:30.362460 (+ 117us) client_negotiation.cc:240] Negotiation successful
0811 05:10:30.362633 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":96,"threads_started":1}
I20260811 05:10:30.363415 18343 heartbeater.cc:347] Connected to a master server at 127.26.191.254:43163
I20260811 05:10:30.363548 18343 heartbeater.cc:464] Registering TS with master...
I20260811 05:10:30.363795 18343 heartbeater.cc:511] Master 127.26.191.254:43163 requested a full tablet report, sending...
I20260811 05:10:30.364226 17797 ts_manager.cc:194] Registered new tserver with Master: 5641a5f8c562460583a125fdbcd4bafc (127.26.191.194:33341)
I20260811 05:10:30.364602 17797 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.191.194@KRBTEST.COM'} at 127.26.191.194:57851
W20260811 05:10:30.447548 18351 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:10:30.447767 18351 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:10:30.447832 18351 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:10:30.449079 18351 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:10:30.449119 18351 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:10:30.449146 18351 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.191.195
I20260811 05:10:30.450608 18351 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:33749
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.195.keytab
--principal=kudu/127.26.191.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.191.195:34413
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.191.195
--webserver_port=37913
--tserver_master_addrs=127.26.191.254:43163
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18351
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.191.195
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:10:30.450855 18351 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:10:30.451114 18351 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:10:30.456441 18356 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:10:30.456481 18357 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:10:30.456629 18351 server_base.cc:1034] running on GCE node
W20260811 05:10:30.456462 18359 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:10:30.456982 18351 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:10:30.457317 18351 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:10:30.458483 18351 hybrid_clock.cc:648] HybridClock initialized: now 1786425030458457 us; error 41 us; skew 500 ppm
Aug 11 05:10:30 dist-test-slave-x5fp krb5kdc[16839](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425030, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:10:30.461688 18351 init.cc:377] Logged in from keytab as kudu/127.26.191.195@KRBTEST.COM (short username kudu)
I20260811 05:10:30.462242 18351 webserver.cc:460] Webserver started at http://127.26.191.195:37913/ using document root <none> and password file <none>
I20260811 05:10:30.462508 18351 fs_manager.cc:359] Metadata directory not provided
I20260811 05:10:30.462589 18351 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:10:30.464025 18351 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:10:30.464812 18371 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:10:30.465003 18351 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:10:30.465104 18351 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-2/wal
uuid: "91cfea43aaac41249f8bffa4ae0c3366"
format_stamp: "Formatted at 2026-08-11 05:10:29 on dist-test-slave-x5fp"
server_key: "c05ffd01b9e8756ffe08bfda2dc837b0"
server_key_iv: "fcffb631b27a7aa591a1bfeeb6201c94"
server_key_version: "encryptionkey@0"
I20260811 05:10:30.465487 18351 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:10:30.478368 18351 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:10:30.480482 18351 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:10:30.480643 18351 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:10:30.480943 18351 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:10:30.481276 18351 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:10:30.481312 18351 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:10:30.481369 18351 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:10:30.481395 18351 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:10:30.487438 18351 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.195:34413
I20260811 05:10:30.487506 18553 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.195:34413 every 8 connection(s)
I20260811 05:10:30.487859 18351 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-2/data/info.pb
Aug 11 05:10:30 dist-test-slave-x5fp krb5kdc[16839](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425030, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.195@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
I20260811 05:10:30.494638 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 18351
I20260811 05:10:30.498131 18558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:30.488597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:43163 (local address 127.26.191.195:56333)
0811 05:10:30.488820 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:30.488857 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 05:10:30.489382 (+ 525us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:10:30.489621 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:10:30.489625 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:10:30.490232 (+ 607us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:10:30.490429 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:10:30.490434 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:10:30.491127 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:10:30.491129 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:10:30.491943 (+ 814us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:10:30.491946 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:10:30.492328 (+ 382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:10:30.492329 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:10:30.492485 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:30.493065 (+ 580us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:10:30.493074 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:10:30.494527 (+ 1453us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:10:30.496423 (+ 1896us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:10:30.496429 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:10:30.496431 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:10:30.496675 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:10:30.496959 (+ 284us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:10:30.496960 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:10:30.496960 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:10:30.497117 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:10:30.497352 (+ 235us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:10:30.497359 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:10:30.497533 (+ 174us) client_negotiation.cc:769] Sending connection context
0811 05:10:30.497642 (+ 109us) client_negotiation.cc:240] Negotiation successful
0811 05:10:30.497814 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":94,"threads_started":1}
I20260811 05:10:30.498694 18127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:30.488606 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.195:56333 (local address 127.26.191.254:43163)
0811 05:10:30.488655 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 05:10:30.488658 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:10:30.488939 (+ 281us) server_negotiation.cc:407] Connection header received
0811 05:10:30.489491 (+ 552us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:10:30.489493 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:10:30.489505 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:10:30.489552 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:10:30.490528 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:30.491028 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:30.492035 (+ 1007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:30.492239 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:30.492322 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:30.494637 (+ 2315us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:10:30.494638 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:10:30.494639 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:10:30.494647 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:10:30.496338 (+ 1691us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:10:30.496835 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:10:30.496836 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:10:30.496836 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:10:30.496897 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:10:30.497189 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:10:30.497190 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:10:30.497190 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:10:30.497289 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:10:30.497338 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 05:10:30.498051 (+ 713us) server_negotiation.cc:299] Negotiation successful
0811 05:10:30.498147 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 05:10:30.499123 18554 heartbeater.cc:347] Connected to a master server at 127.26.191.254:43163
I20260811 05:10:30.499258 18554 heartbeater.cc:464] Registering TS with master...
I20260811 05:10:30.499500 18554 heartbeater.cc:511] Master 127.26.191.254:43163 requested a full tablet report, sending...
I20260811 05:10:30.499987 17797 ts_manager.cc:194] Registered new tserver with Master: 91cfea43aaac41249f8bffa4ae0c3366 (127.26.191.195:34413)
I20260811 05:10:30.500497 17797 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.191.195@KRBTEST.COM'} at 127.26.191.195:56333
I20260811 05:10:30.502887 18560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:30.495093 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43046 (local address 127.26.191.254:43163)
0811 05:10:30.495238 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0811 05:10:30.495250 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 05:10:30.495325 (+ 75us) server_negotiation.cc:407] Connection header received
0811 05:10:30.495387 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:10:30.495388 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:10:30.495400 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:10:30.495471 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:10:30.496081 (+ 610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:30.496758 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:30.497984 (+ 1226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:30.498430 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:30.498497 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:30.500234 (+ 1737us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:10:30.500236 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:10:30.500236 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:10:30.500243 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:10:30.501965 (+ 1722us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:10:30.502286 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:10:30.502286 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:10:30.502287 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:10:30.502337 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:10:30.502464 (+ 127us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:10:30.502464 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:10:30.502465 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:10:30.502557 (+ 92us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:10:30.502690 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0811 05:10:30.502726 (+ 36us) server_negotiation.cc:299] Negotiation successful
0811 05:10:30.502793 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":55,"threads_started":1}
I20260811 05:10:30.503695 27391 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 05:10:30.506526 18560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:30.504101 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43052 (local address 127.26.191.254:43163)
0811 05:10:30.504138 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0811 05:10:30.504139 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 05:10:30.504265 (+ 126us) server_negotiation.cc:407] Connection header received
0811 05:10:30.504314 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:10:30.504315 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:10:30.504345 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:10:30.504412 (+ 67us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:10:30.504489 (+ 77us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:30.505049 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:30.505863 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:30.506054 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:30.506122 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:30.506251 (+ 129us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:10:30.506344 (+ 93us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:10:30.506405 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 05:10:30.506445 (+ 40us) server_negotiation.cc:299] Negotiation successful
0811 05:10:30.506464 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260811 05:10:30.506860 17797 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:43052:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 05:10:30.508620 17797 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 05:10:30.511298 18004 tablet_service.cc:1467] Processing CreateTablet for tablet 19e435eb40df449f9927f7b448d7d807 (DEFAULT_TABLE table=test-table [id=a58bbcfd511742f4aa6722b08e07618a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:10:30.511557 18004 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 19e435eb40df449f9927f7b448d7d807. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:10:30.513340 17943 tablet_bootstrap.cc:492] T 19e435eb40df449f9927f7b448d7d807 P eef4d191e08f406ab76a3b3d722cbdca: Bootstrap starting.
I20260811 05:10:30.513756 17943 tablet_bootstrap.cc:654] T 19e435eb40df449f9927f7b448d7d807 P eef4d191e08f406ab76a3b3d722cbdca: Neither blocks nor log segments found. Creating new log.
I20260811 05:10:30.514410 17943 tablet_bootstrap.cc:492] T 19e435eb40df449f9927f7b448d7d807 P eef4d191e08f406ab76a3b3d722cbdca: No bootstrap required, opened a new log
I20260811 05:10:30.514478 17943 ts_tablet_manager.cc:1397] T 19e435eb40df449f9927f7b448d7d807 P eef4d191e08f406ab76a3b3d722cbdca: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260811 05:10:30.514858 18133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:30.510728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.195:34413 (local address 127.0.0.1:41754)
0811 05:10:30.510894 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:30.510905 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 05:10:30.510936 (+ 31us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:10:30.511277 (+ 341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:10:30.511279 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:10:30.511281 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:10:30.511343 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:10:30.511345 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:10:30.512431 (+ 1086us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:10:30.512433 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:10:30.513512 (+ 1079us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:10:30.513515 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:10:30.514545 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:10:30.514546 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:10:30.514635 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:30.514663 (+ 28us) client_negotiation.cc:769] Sending connection context
0811 05:10:30.514707 (+ 44us) client_negotiation.cc:240] Negotiation successful
0811 05:10:30.514768 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"mutex_wait_us":24,"thread_start_us":58,"threads_started":1}
I20260811 05:10:30.514907 17943 raft_consensus.cc:348] T 19e435eb40df449f9927f7b448d7d807 P eef4d191e08f406ab76a3b3d722cbdca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5641a5f8c562460583a125fdbcd4bafc" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 33341 } } peers { permanent_uuid: "91cfea43aaac41249f8bffa4ae0c3366" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 34413 } } peers { permanent_uuid: "eef4d191e08f406ab76a3b3d722cbdca" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 35057 } }
I20260811 05:10:30.515015 17943 raft_consensus.cc:374] T 19e435eb40df449f9927f7b448d7d807 P eef4d191e08f406ab76a3b3d722cbdca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:10:30.515074 17943 raft_consensus.cc:729] T 19e435eb40df449f9927f7b448d7d807 P eef4d191e08f406ab76a3b3d722cbdca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eef4d191e08f406ab76a3b3d722cbdca, State: Initialized, Role: FOLLOWER
I20260811 05:10:30.515129 17943 consensus_queue.cc:260] T 19e435eb40df449f9927f7b448d7d807 P eef4d191e08f406ab76a3b3d722cbdca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5641a5f8c562460583a125fdbcd4bafc" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 33341 } } peers { permanent_uuid: "91cfea43aaac41249f8bffa4ae0c3366" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 34413 } } peers { permanent_uuid: "eef4d191e08f406ab76a3b3d722cbdca" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 35057 } }
I20260811 05:10:30.515241 17943 ts_tablet_manager.cc:1428] T 19e435eb40df449f9927f7b448d7d807 P eef4d191e08f406ab76a3b3d722cbdca: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260811 05:10:30.515317 18566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:30.510897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41754 (local address 127.26.191.195:34413)
0811 05:10:30.511090 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0811 05:10:30.511095 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:10:30.511106 (+ 11us) server_negotiation.cc:407] Connection header received
0811 05:10:30.511152 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:10:30.511154 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:10:30.511168 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:10:30.511268 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:10:30.511414 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:30.512310 (+ 896us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:30.513592 (+ 1282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:30.514423 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:30.515053 (+ 630us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:30.515132 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 05:10:30.515166 (+ 34us) server_negotiation.cc:299] Negotiation successful
0811 05:10:30.515214 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":121,"threads_started":1}
I20260811 05:10:30.515517 18564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:30.510728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.194:33341 (local address 127.0.0.1:58036)
0811 05:10:30.510867 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:30.510879 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 05:10:30.510936 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:10:30.511591 (+ 655us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:10:30.511593 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:10:30.511596 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:10:30.511712 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:10:30.511715 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:10:30.513240 (+ 1525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:10:30.513241 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:10:30.514259 (+ 1018us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:10:30.514263 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:10:30.515254 (+ 991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:10:30.515255 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:10:30.515326 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:30.515330 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 05:10:30.515384 (+ 54us) client_negotiation.cc:240] Negotiation successful
0811 05:10:30.515445 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124}
I20260811 05:10:30.515847 18567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:30.511186 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58036 (local address 127.26.191.194:33341)
0811 05:10:30.511407 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0811 05:10:30.511412 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:10:30.511424 (+ 12us) server_negotiation.cc:407] Connection header received
0811 05:10:30.511468 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:10:30.511470 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:10:30.511487 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:10:30.511579 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:10:30.511785 (+ 206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:30.513132 (+ 1347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:30.514367 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:30.515088 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:30.515160 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:30.515216 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 05:10:30.515707 (+ 491us) server_negotiation.cc:299] Negotiation successful
0811 05:10:30.515766 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":186,"thread_start_us":92,"threads_started":1}
I20260811 05:10:30.516238 18446 tablet_service.cc:1467] Processing CreateTablet for tablet 19e435eb40df449f9927f7b448d7d807 (DEFAULT_TABLE table=test-table [id=a58bbcfd511742f4aa6722b08e07618a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:10:30.516592 18446 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 19e435eb40df449f9927f7b448d7d807. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:10:30.516604 18238 tablet_service.cc:1467] Processing CreateTablet for tablet 19e435eb40df449f9927f7b448d7d807 (DEFAULT_TABLE table=test-table [id=a58bbcfd511742f4aa6722b08e07618a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:10:30.516950 18238 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 19e435eb40df449f9927f7b448d7d807. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:10:30.519768 18571 tablet_bootstrap.cc:492] T 19e435eb40df449f9927f7b448d7d807 P 91cfea43aaac41249f8bffa4ae0c3366: Bootstrap starting.
I20260811 05:10:30.520323 18572 tablet_bootstrap.cc:492] T 19e435eb40df449f9927f7b448d7d807 P 5641a5f8c562460583a125fdbcd4bafc: Bootstrap starting.
I20260811 05:10:30.520594 18571 tablet_bootstrap.cc:654] T 19e435eb40df449f9927f7b448d7d807 P 91cfea43aaac41249f8bffa4ae0c3366: Neither blocks nor log segments found. Creating new log.
I20260811 05:10:30.521041 18572 tablet_bootstrap.cc:654] T 19e435eb40df449f9927f7b448d7d807 P 5641a5f8c562460583a125fdbcd4bafc: Neither blocks nor log segments found. Creating new log.
I20260811 05:10:30.521287 18571 log.cc:824] T 19e435eb40df449f9927f7b448d7d807 P 91cfea43aaac41249f8bffa4ae0c3366: Log is configured to *not* fsync() on all Append() calls
I20260811 05:10:30.521593 18572 log.cc:824] T 19e435eb40df449f9927f7b448d7d807 P 5641a5f8c562460583a125fdbcd4bafc: Log is configured to *not* fsync() on all Append() calls
I20260811 05:10:30.522121 18571 tablet_bootstrap.cc:492] T 19e435eb40df449f9927f7b448d7d807 P 91cfea43aaac41249f8bffa4ae0c3366: No bootstrap required, opened a new log
I20260811 05:10:30.522185 18571 ts_tablet_manager.cc:1397] T 19e435eb40df449f9927f7b448d7d807 P 91cfea43aaac41249f8bffa4ae0c3366: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 05:10:30.522364 18572 tablet_bootstrap.cc:492] T 19e435eb40df449f9927f7b448d7d807 P 5641a5f8c562460583a125fdbcd4bafc: No bootstrap required, opened a new log
I20260811 05:10:30.522444 18572 ts_tablet_manager.cc:1397] T 19e435eb40df449f9927f7b448d7d807 P 5641a5f8c562460583a125fdbcd4bafc: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260811 05:10:30.523780 18572 raft_consensus.cc:348] T 19e435eb40df449f9927f7b448d7d807 P 5641a5f8c562460583a125fdbcd4bafc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5641a5f8c562460583a125fdbcd4bafc" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 33341 } } peers { permanent_uuid: "91cfea43aaac41249f8bffa4ae0c3366" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 34413 } } peers { permanent_uuid: "eef4d191e08f406ab76a3b3d722cbdca" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 35057 } }
I20260811 05:10:30.523782 18571 raft_consensus.cc:348] T 19e435eb40df449f9927f7b448d7d807 P 91cfea43aaac41249f8bffa4ae0c3366 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5641a5f8c562460583a125fdbcd4bafc" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 33341 } } peers { permanent_uuid: "91cfea43aaac41249f8bffa4ae0c3366" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 34413 } } peers { permanent_uuid: "eef4d191e08f406ab76a3b3d722cbdca" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 35057 } }
I20260811 05:10:30.523938 18571 raft_consensus.cc:374] T 19e435eb40df449f9927f7b448d7d807 P 91cfea43aaac41249f8bffa4ae0c3366 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:10:30.523939 18572 raft_consensus.cc:374] T 19e435eb40df449f9927f7b448d7d807 P 5641a5f8c562460583a125fdbcd4bafc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:10:30.523989 18572 raft_consensus.cc:729] T 19e435eb40df449f9927f7b448d7d807 P 5641a5f8c562460583a125fdbcd4bafc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5641a5f8c562460583a125fdbcd4bafc, State: Initialized, Role: FOLLOWER
I20260811 05:10:30.523988 18571 raft_consensus.cc:729] T 19e435eb40df449f9927f7b448d7d807 P 91cfea43aaac41249f8bffa4ae0c3366 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91cfea43aaac41249f8bffa4ae0c3366, State: Initialized, Role: FOLLOWER
I20260811 05:10:30.524115 18571 consensus_queue.cc:260] T 19e435eb40df449f9927f7b448d7d807 P 91cfea43aaac41249f8bffa4ae0c3366 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5641a5f8c562460583a125fdbcd4bafc" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 33341 } } peers { permanent_uuid: "91cfea43aaac41249f8bffa4ae0c3366" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 34413 } } peers { permanent_uuid: "eef4d191e08f406ab76a3b3d722cbdca" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 35057 } }
I20260811 05:10:30.524113 18572 consensus_queue.cc:260] T 19e435eb40df449f9927f7b448d7d807 P 5641a5f8c562460583a125fdbcd4bafc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5641a5f8c562460583a125fdbcd4bafc" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 33341 } } peers { permanent_uuid: "91cfea43aaac41249f8bffa4ae0c3366" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 34413 } } peers { permanent_uuid: "eef4d191e08f406ab76a3b3d722cbdca" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 35057 } }
I20260811 05:10:30.524443 18571 ts_tablet_manager.cc:1428] T 19e435eb40df449f9927f7b448d7d807 P 91cfea43aaac41249f8bffa4ae0c3366: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 05:10:30.524447 18554 heartbeater.cc:503] Master 127.26.191.254:43163 was elected leader, sending a full tablet report...
I20260811 05:10:30.524471 18572 ts_tablet_manager.cc:1428] T 19e435eb40df449f9927f7b448d7d807 P 5641a5f8c562460583a125fdbcd4bafc: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260811 05:10:30.524695 18343 heartbeater.cc:503] Master 127.26.191.254:43163 was elected leader, sending a full tablet report...
I20260811 05:10:30.564523 18581 raft_consensus.cc:482] T 19e435eb40df449f9927f7b448d7d807 P 91cfea43aaac41249f8bffa4ae0c3366 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 05:10:30.564666 18581 raft_consensus.cc:504] T 19e435eb40df449f9927f7b448d7d807 P 91cfea43aaac41249f8bffa4ae0c3366 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5641a5f8c562460583a125fdbcd4bafc" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 33341 } } peers { permanent_uuid: "91cfea43aaac41249f8bffa4ae0c3366" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 34413 } } peers { permanent_uuid: "eef4d191e08f406ab76a3b3d722cbdca" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 35057 } }
I20260811 05:10:30.565120 18581 leader_election.cc:288] T 19e435eb40df449f9927f7b448d7d807 P 91cfea43aaac41249f8bffa4ae0c3366 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5641a5f8c562460583a125fdbcd4bafc (127.26.191.194:33341), eef4d191e08f406ab76a3b3d722cbdca (127.26.191.193:35057)
I20260811 05:10:30.567965 18567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:30.565405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.195:48949 (local address 127.26.191.194:33341)
0811 05:10:30.565551 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0811 05:10:30.565553 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:10:30.565563 (+ 10us) server_negotiation.cc:407] Connection header received
0811 05:10:30.565599 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:10:30.565600 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:10:30.565615 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:10:30.565688 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:10:30.565846 (+ 158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:30.566327 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:30.567229 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:30.567607 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:30.567692 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:30.567701 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 05:10:30.567858 (+ 157us) server_negotiation.cc:299] Negotiation successful
0811 05:10:30.567894 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118}
I20260811 05:10:30.567965 18558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:30.565296 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.194:33341 (local address 127.26.191.195:48949)
0811 05:10:30.565356 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:30.565371 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 05:10:30.565453 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:10:30.565692 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:10:30.565693 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:10:30.565695 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:10:30.565775 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:10:30.565778 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:10:30.566413 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:10:30.566414 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:10:30.567140 (+ 726us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:10:30.567141 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:10:30.567701 (+ 560us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:10:30.567703 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:10:30.567786 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:30.567789 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 05:10:30.567852 (+ 63us) client_negotiation.cc:240] Negotiation successful
0811 05:10:30.567892 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260811 05:10:30.568397 18585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:30.565404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.193:35057 (local address 127.26.191.195:57467)
0811 05:10:30.565587 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:30.565595 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 05:10:30.565657 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:10:30.565841 (+ 184us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:10:30.565842 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:10:30.565844 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:10:30.565922 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:10:30.565924 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:10:30.566579 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:10:30.566580 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:10:30.567336 (+ 756us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:10:30.567338 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:10:30.568010 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:10:30.568149 (+ 139us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:10:30.568218 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:30.568223 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 05:10:30.568282 (+ 59us) client_negotiation.cc:240] Negotiation successful
0811 05:10:30.568323 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":128,"threads_started":1}
I20260811 05:10:30.568423 18134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:30.565492 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.195:57467 (local address 127.26.191.193:35057)
0811 05:10:30.565556 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 05:10:30.565558 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:10:30.565648 (+ 90us) server_negotiation.cc:407] Connection header received
0811 05:10:30.565723 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:10:30.565724 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:10:30.565756 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:10:30.565837 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:10:30.565994 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:30.566496 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:30.567427 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:30.567933 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:30.568011 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:30.568094 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 05:10:30.568303 (+ 209us) server_negotiation.cc:299] Negotiation successful
0811 05:10:30.568348 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 05:10:30.568367 18264 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "19e435eb40df449f9927f7b448d7d807" candidate_uuid: "91cfea43aaac41249f8bffa4ae0c3366" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5641a5f8c562460583a125fdbcd4bafc" is_pre_election: true
I20260811 05:10:30.568538 18264 raft_consensus.cc:2454] T 19e435eb40df449f9927f7b448d7d807 P 5641a5f8c562460583a125fdbcd4bafc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91cfea43aaac41249f8bffa4ae0c3366 in term 0.
I20260811 05:10:30.568837 18378 leader_election.cc:302] T 19e435eb40df449f9927f7b448d7d807 P 91cfea43aaac41249f8bffa4ae0c3366 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5641a5f8c562460583a125fdbcd4bafc, 91cfea43aaac41249f8bffa4ae0c3366; no voters:
I20260811 05:10:30.568882 18033 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "19e435eb40df449f9927f7b448d7d807" candidate_uuid: "91cfea43aaac41249f8bffa4ae0c3366" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eef4d191e08f406ab76a3b3d722cbdca" is_pre_election: true
I20260811 05:10:30.568967 18581 raft_consensus.cc:2781] T 19e435eb40df449f9927f7b448d7d807 P 91cfea43aaac41249f8bffa4ae0c3366 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 05:10:30.569018 18581 raft_consensus.cc:482] T 19e435eb40df449f9927f7b448d7d807 P 91cfea43aaac41249f8bffa4ae0c3366 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 05:10:30.569051 18581 raft_consensus.cc:3037] T 19e435eb40df449f9927f7b448d7d807 P 91cfea43aaac41249f8bffa4ae0c3366 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:10:30.569052 18033 raft_consensus.cc:2454] T 19e435eb40df449f9927f7b448d7d807 P eef4d191e08f406ab76a3b3d722cbdca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91cfea43aaac41249f8bffa4ae0c3366 in term 0.
I20260811 05:10:30.569823 18581 raft_consensus.cc:504] T 19e435eb40df449f9927f7b448d7d807 P 91cfea43aaac41249f8bffa4ae0c3366 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5641a5f8c562460583a125fdbcd4bafc" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 33341 } } peers { permanent_uuid: "91cfea43aaac41249f8bffa4ae0c3366" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 34413 } } peers { permanent_uuid: "eef4d191e08f406ab76a3b3d722cbdca" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 35057 } }
I20260811 05:10:30.569957 18581 leader_election.cc:288] T 19e435eb40df449f9927f7b448d7d807 P 91cfea43aaac41249f8bffa4ae0c3366 [CANDIDATE]: Term 1 election: Requested vote from peers 5641a5f8c562460583a125fdbcd4bafc (127.26.191.194:33341), eef4d191e08f406ab76a3b3d722cbdca (127.26.191.193:35057)
I20260811 05:10:30.570142 18264 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "19e435eb40df449f9927f7b448d7d807" candidate_uuid: "91cfea43aaac41249f8bffa4ae0c3366" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5641a5f8c562460583a125fdbcd4bafc"
I20260811 05:10:30.570142 18033 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "19e435eb40df449f9927f7b448d7d807" candidate_uuid: "91cfea43aaac41249f8bffa4ae0c3366" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eef4d191e08f406ab76a3b3d722cbdca"
I20260811 05:10:30.570215 18264 raft_consensus.cc:3037] T 19e435eb40df449f9927f7b448d7d807 P 5641a5f8c562460583a125fdbcd4bafc [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:10:30.570252 18033 raft_consensus.cc:3037] T 19e435eb40df449f9927f7b448d7d807 P eef4d191e08f406ab76a3b3d722cbdca [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:10:30.571056 18264 raft_consensus.cc:2454] T 19e435eb40df449f9927f7b448d7d807 P 5641a5f8c562460583a125fdbcd4bafc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91cfea43aaac41249f8bffa4ae0c3366 in term 1.
I20260811 05:10:30.571086 18033 raft_consensus.cc:2454] T 19e435eb40df449f9927f7b448d7d807 P eef4d191e08f406ab76a3b3d722cbdca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91cfea43aaac41249f8bffa4ae0c3366 in term 1.
I20260811 05:10:30.571259 18378 leader_election.cc:302] T 19e435eb40df449f9927f7b448d7d807 P 91cfea43aaac41249f8bffa4ae0c3366 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91cfea43aaac41249f8bffa4ae0c3366, eef4d191e08f406ab76a3b3d722cbdca; no voters:
I20260811 05:10:30.571348 18581 raft_consensus.cc:2781] T 19e435eb40df449f9927f7b448d7d807 P 91cfea43aaac41249f8bffa4ae0c3366 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:10:30.571499 18581 raft_consensus.cc:686] T 19e435eb40df449f9927f7b448d7d807 P 91cfea43aaac41249f8bffa4ae0c3366 [term 1 LEADER]: Becoming Leader. State: Replica: 91cfea43aaac41249f8bffa4ae0c3366, State: Running, Role: LEADER
I20260811 05:10:30.571604 18581 consensus_queue.cc:237] T 19e435eb40df449f9927f7b448d7d807 P 91cfea43aaac41249f8bffa4ae0c3366 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5641a5f8c562460583a125fdbcd4bafc" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 33341 } } peers { permanent_uuid: "91cfea43aaac41249f8bffa4ae0c3366" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 34413 } } peers { permanent_uuid: "eef4d191e08f406ab76a3b3d722cbdca" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 35057 } }
I20260811 05:10:30.572459 17797 catalog_manager.cc:5495] T 19e435eb40df449f9927f7b448d7d807 P 91cfea43aaac41249f8bffa4ae0c3366 reported cstate change: term changed from 0 to 1, leader changed from <none> to 91cfea43aaac41249f8bffa4ae0c3366 (127.26.191.195). New cstate: current_term: 1 leader_uuid: "91cfea43aaac41249f8bffa4ae0c3366" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5641a5f8c562460583a125fdbcd4bafc" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 33341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91cfea43aaac41249f8bffa4ae0c3366" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 34413 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eef4d191e08f406ab76a3b3d722cbdca" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 35057 } health_report { overall_health: UNKNOWN } } }
I20260811 05:10:30.591077 18566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:30.588667 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41758 (local address 127.26.191.195:34413)
0811 05:10:30.588799 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0811 05:10:30.588801 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:10:30.588817 (+ 16us) server_negotiation.cc:407] Connection header received
0811 05:10:30.588855 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:10:30.588856 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:10:30.588876 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:10:30.588947 (+ 71us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:10:30.589062 (+ 115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:30.589582 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:30.590312 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:30.590517 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:30.590577 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:30.590697 (+ 120us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:10:30.590816 (+ 119us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:10:30.590888 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 05:10:30.590903 (+ 15us) server_negotiation.cc:299] Negotiation successful
0811 05:10:30.590921 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 05:10:30.593230 18033 raft_consensus.cc:1261] T 19e435eb40df449f9927f7b448d7d807 P eef4d191e08f406ab76a3b3d722cbdca [term 1 FOLLOWER]: Refusing update from remote peer 91cfea43aaac41249f8bffa4ae0c3366: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:10:30.593259 18264 raft_consensus.cc:1261] T 19e435eb40df449f9927f7b448d7d807 P 5641a5f8c562460583a125fdbcd4bafc [term 1 FOLLOWER]: Refusing update from remote peer 91cfea43aaac41249f8bffa4ae0c3366: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:10:30.593647 18586 consensus_queue.cc:1035] T 19e435eb40df449f9927f7b448d7d807 P 91cfea43aaac41249f8bffa4ae0c3366 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eef4d191e08f406ab76a3b3d722cbdca" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:10:30.593802 18581 consensus_queue.cc:1035] T 19e435eb40df449f9927f7b448d7d807 P 91cfea43aaac41249f8bffa4ae0c3366 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5641a5f8c562460583a125fdbcd4bafc" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 33341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:10:30.596333 18591 mvcc.cc:205] Tried to move back new op lower bound from 7317196925306490880 to 7317196925221974016. Current Snapshot: MvccSnapshot[applied={T|T < 7317196925306490880}]
I20260811 05:10:30.596549 18593 mvcc.cc:205] Tried to move back new op lower bound from 7317196925306490880 to 7317196925221974016. Current Snapshot: MvccSnapshot[applied={T|T < 7317196925306490880}]
I20260811 05:10:30.596899 18594 mvcc.cc:205] Tried to move back new op lower bound from 7317196925306490880 to 7317196925221974016. Current Snapshot: MvccSnapshot[applied={T|T < 7317196925306490880}]
I20260811 05:10:30.599428 17797 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:43052:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:10:30.599529 17797 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:43052:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:10:30.600339 17797 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ba2c2f0becd44f9b9bd520495c4cac41: Sending DeleteTablet for 3 replicas of tablet 19e435eb40df449f9927f7b448d7d807
I20260811 05:10:30.600734 18004 tablet_service.cc:1514] Processing DeleteTablet for tablet 19e435eb40df449f9927f7b448d7d807 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:10:30 UTC) from {username='kudu', principal='kudu/127.26.191.254@KRBTEST.COM'} at 127.0.0.1:35822
I20260811 05:10:30.600842 18135 tablet_replica.cc:330] T 19e435eb40df449f9927f7b448d7d807 P eef4d191e08f406ab76a3b3d722cbdca: stopping tablet replica
I20260811 05:10:30.600806 18238 tablet_service.cc:1514] Processing DeleteTablet for tablet 19e435eb40df449f9927f7b448d7d807 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:10:30 UTC) from {username='kudu', principal='kudu/127.26.191.254@KRBTEST.COM'} at 127.0.0.1:58036
I20260811 05:10:30.600854 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 17860
I20260811 05:10:30.600891 18135 raft_consensus.cc:2229] T 19e435eb40df449f9927f7b448d7d807 P eef4d191e08f406ab76a3b3d722cbdca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 05:10:30.600950 18135 raft_consensus.cc:2258] T 19e435eb40df449f9927f7b448d7d807 P eef4d191e08f406ab76a3b3d722cbdca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:10:30.603739 18446 tablet_service.cc:1514] Processing DeleteTablet for tablet 19e435eb40df449f9927f7b448d7d807 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:10:30 UTC) from {username='kudu', principal='kudu/127.26.191.254@KRBTEST.COM'} at 127.0.0.1:41754
I20260811 05:10:30.605350 18604 tablet_replica.cc:330] T 19e435eb40df449f9927f7b448d7d807 P 5641a5f8c562460583a125fdbcd4bafc: stopping tablet replica
I20260811 05:10:30.605453 18604 raft_consensus.cc:2229] T 19e435eb40df449f9927f7b448d7d807 P 5641a5f8c562460583a125fdbcd4bafc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 05:10:30.605558 18604 raft_consensus.cc:2258] T 19e435eb40df449f9927f7b448d7d807 P 5641a5f8c562460583a125fdbcd4bafc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:10:30.607535 18604 ts_tablet_manager.cc:1905] T 19e435eb40df449f9927f7b448d7d807 P 5641a5f8c562460583a125fdbcd4bafc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:10:30.608251 18605 tablet_replica.cc:330] T 19e435eb40df449f9927f7b448d7d807 P 91cfea43aaac41249f8bffa4ae0c3366: stopping tablet replica
I20260811 05:10:30.608366 18605 raft_consensus.cc:2229] T 19e435eb40df449f9927f7b448d7d807 P 91cfea43aaac41249f8bffa4ae0c3366 [term 1 LEADER]: Raft consensus shutting down.
I20260811 05:10:30.608500 18605 raft_consensus.cc:2258] T 19e435eb40df449f9927f7b448d7d807 P 91cfea43aaac41249f8bffa4ae0c3366 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:10:30.609045 18605 ts_tablet_manager.cc:1905] T 19e435eb40df449f9927f7b448d7d807 P 91cfea43aaac41249f8bffa4ae0c3366: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:10:30.609493 18604 ts_tablet_manager.cc:1918] T 19e435eb40df449f9927f7b448d7d807 P 5641a5f8c562460583a125fdbcd4bafc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 05:10:30.609570 18604 log.cc:1196] T 19e435eb40df449f9927f7b448d7d807 P 5641a5f8c562460583a125fdbcd4bafc: Deleting WAL directory at /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-1/wal/wals/19e435eb40df449f9927f7b448d7d807
I20260811 05:10:30.609903 18604 ts_tablet_manager.cc:1939] T 19e435eb40df449f9927f7b448d7d807 P 5641a5f8c562460583a125fdbcd4bafc: Deleting consensus metadata
I20260811 05:10:30.610416 17774 catalog_manager.cc:4841] TS 5641a5f8c562460583a125fdbcd4bafc (127.26.191.194:33341): tablet 19e435eb40df449f9927f7b448d7d807 (table test-table [id=a58bbcfd511742f4aa6722b08e07618a]) successfully deleted
I20260811 05:10:30.610965 18605 ts_tablet_manager.cc:1918] T 19e435eb40df449f9927f7b448d7d807 P 91cfea43aaac41249f8bffa4ae0c3366: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 05:10:30.611018 18605 log.cc:1196] T 19e435eb40df449f9927f7b448d7d807 P 91cfea43aaac41249f8bffa4ae0c3366: Deleting WAL directory at /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-2/wal/wals/19e435eb40df449f9927f7b448d7d807
I20260811 05:10:30.611238 18605 ts_tablet_manager.cc:1939] T 19e435eb40df449f9927f7b448d7d807 P 91cfea43aaac41249f8bffa4ae0c3366: Deleting consensus metadata
I20260811 05:10:30.611662 17772 catalog_manager.cc:4841] TS 91cfea43aaac41249f8bffa4ae0c3366 (127.26.191.195:34413): tablet 19e435eb40df449f9927f7b448d7d807 (table test-table [id=a58bbcfd511742f4aa6722b08e07618a]) successfully deleted
W20260811 05:10:30.618094 17774 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.191.193:35057 (error 108)
I20260811 05:10:30.618535 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 18131
I20260811 05:10:30.618670 18564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:30.618512 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.193:35057 (local address 127.0.0.1:49666)
0811 05:10:30.618578 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:30.618624 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.193:35057: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260811 05:10:30.628433 17774 catalog_manager.cc:4584] TS eef4d191e08f406ab76a3b3d722cbdca (127.26.191.193:35057): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 19e435eb40df449f9927f7b448d7d807: Network error: Client connection negotiation failed: client connection to 127.26.191.193:35057: connect: Connection refused (error 111)
I20260811 05:10:30.633980 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 18351
I20260811 05:10:30.645882 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 17746
I20260811 05:10:30.656405 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.254:43163
--webserver_interface=127.26.191.254
--webserver_port=34063
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab
--principal=kudu/127.26.191.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:33749
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.191.254:43163
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:10:30.744344 18607 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:10:30.744588 18607 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:10:30.744614 18607 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:10:30.745767 18607 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:10:30.745813 18607 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:10:30.745831 18607 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:10:30.745846 18607 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:10:30.745859 18607 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:10:30.747342 18607 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:33749
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.191.254:43163
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab
--principal=kudu/127.26.191.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.254:43163
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.191.254
--webserver_port=34063
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18607
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:10:30.747893 18607 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:10:30.748132 18607 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:10:30.753655 18618 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:10:30.753624 18616 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:10:30.753618 18614 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:10:30.753696 18607 server_base.cc:1034] running on GCE node
I20260811 05:10:30.754108 18607 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:10:30.754446 18607 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:10:30.755615 18607 hybrid_clock.cc:648] HybridClock initialized: now 1786425030755598 us; error 49 us; skew 500 ppm
Aug 11 05:10:30 dist-test-slave-x5fp krb5kdc[16839](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425030, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:10:30.758224 18607 init.cc:377] Logged in from keytab as kudu/127.26.191.254@KRBTEST.COM (short username kudu)
I20260811 05:10:30.758633 18607 webserver.cc:460] Webserver started at http://127.26.191.254:34063/ using document root <none> and password file <none>
I20260811 05:10:30.758826 18607 fs_manager.cc:359] Metadata directory not provided
I20260811 05:10:30.758873 18607 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:10:30.760221 18607 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:10:30.761031 18628 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:10:30.761263 18607 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:10:30.761368 18607 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/master-0/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/master-0/wal
uuid: "ba2c2f0becd44f9b9bd520495c4cac41"
format_stamp: "Formatted at 2026-08-11 05:10:29 on dist-test-slave-x5fp"
server_key: "04f58b49b582c5e55456094e5efd2200"
server_key_iv: "7fde29bab3f127054d556d3900a6962e"
server_key_version: "encryptionkey@0"
I20260811 05:10:30.761783 18607 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:10:30.784392 18607 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:10:30.786895 18607 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:10:30.787027 18607 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:10:30.791330 18607 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.254:43163
I20260811 05:10:30.791371 18725 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.254:43163 every 8 connection(s)
I20260811 05:10:30.791766 18607 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
I20260811 05:10:30.792856 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 18607
I20260811 05:10:30.793141 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.191.193:35057
--local_ip_for_outbound_sockets=127.26.191.193
--tserver_master_addrs=127.26.191.254:43163
--webserver_port=44305
--webserver_interface=127.26.191.193
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.193.keytab
--principal=kudu/127.26.191.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:33749
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 05:10:30.793711 18726 sys_catalog.cc:263] Verifying existing consensus state
I20260811 05:10:30.794381 18726 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ba2c2f0becd44f9b9bd520495c4cac41: Bootstrap starting.
I20260811 05:10:30.804598 18726 log.cc:824] T 00000000000000000000000000000000 P ba2c2f0becd44f9b9bd520495c4cac41: Log is configured to *not* fsync() on all Append() calls
I20260811 05:10:30.807417 18726 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ba2c2f0becd44f9b9bd520495c4cac41: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 05:10:30.807813 18726 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ba2c2f0becd44f9b9bd520495c4cac41: Bootstrap complete.
I20260811 05:10:30.810403 18726 raft_consensus.cc:348] T 00000000000000000000000000000000 P ba2c2f0becd44f9b9bd520495c4cac41 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba2c2f0becd44f9b9bd520495c4cac41" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 43163 } }
I20260811 05:10:30.810645 18726 raft_consensus.cc:729] T 00000000000000000000000000000000 P ba2c2f0becd44f9b9bd520495c4cac41 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba2c2f0becd44f9b9bd520495c4cac41, State: Initialized, Role: FOLLOWER
I20260811 05:10:30.810854 18726 consensus_queue.cc:260] T 00000000000000000000000000000000 P ba2c2f0becd44f9b9bd520495c4cac41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba2c2f0becd44f9b9bd520495c4cac41" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 43163 } }
I20260811 05:10:30.810927 18726 raft_consensus.cc:388] T 00000000000000000000000000000000 P ba2c2f0becd44f9b9bd520495c4cac41 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:10:30.810990 18726 raft_consensus.cc:482] T 00000000000000000000000000000000 P ba2c2f0becd44f9b9bd520495c4cac41 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:10:30.811045 18726 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ba2c2f0becd44f9b9bd520495c4cac41 [term 2 FOLLOWER]: Advancing to term 3
I20260811 05:10:30.812144 18726 raft_consensus.cc:504] T 00000000000000000000000000000000 P ba2c2f0becd44f9b9bd520495c4cac41 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba2c2f0becd44f9b9bd520495c4cac41" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 43163 } }
I20260811 05:10:30.812276 18726 leader_election.cc:302] T 00000000000000000000000000000000 P ba2c2f0becd44f9b9bd520495c4cac41 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ba2c2f0becd44f9b9bd520495c4cac41; no voters:
I20260811 05:10:30.812517 18726 leader_election.cc:288] T 00000000000000000000000000000000 P ba2c2f0becd44f9b9bd520495c4cac41 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260811 05:10:30.812561 18733 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ba2c2f0becd44f9b9bd520495c4cac41 [term 3 FOLLOWER]: Leader election won for term 3
I20260811 05:10:30.812865 18733 raft_consensus.cc:686] T 00000000000000000000000000000000 P ba2c2f0becd44f9b9bd520495c4cac41 [term 3 LEADER]: Becoming Leader. State: Replica: ba2c2f0becd44f9b9bd520495c4cac41, State: Running, Role: LEADER
I20260811 05:10:30.812920 18726 sys_catalog.cc:564] T 00000000000000000000000000000000 P ba2c2f0becd44f9b9bd520495c4cac41 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:10:30.812996 18733 consensus_queue.cc:237] T 00000000000000000000000000000000 P ba2c2f0becd44f9b9bd520495c4cac41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba2c2f0becd44f9b9bd520495c4cac41" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 43163 } }
I20260811 05:10:30.813323 18735 sys_catalog.cc:455] T 00000000000000000000000000000000 P ba2c2f0becd44f9b9bd520495c4cac41 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "ba2c2f0becd44f9b9bd520495c4cac41" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba2c2f0becd44f9b9bd520495c4cac41" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 43163 } } }
I20260811 05:10:30.813568 18735 sys_catalog.cc:458] T 00000000000000000000000000000000 P ba2c2f0becd44f9b9bd520495c4cac41 [sys.catalog]: This master's current role is: LEADER
I20260811 05:10:30.813319 18733 sys_catalog.cc:455] T 00000000000000000000000000000000 P ba2c2f0becd44f9b9bd520495c4cac41 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ba2c2f0becd44f9b9bd520495c4cac41. Latest consensus state: current_term: 3 leader_uuid: "ba2c2f0becd44f9b9bd520495c4cac41" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba2c2f0becd44f9b9bd520495c4cac41" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 43163 } } }
I20260811 05:10:30.813846 18733 sys_catalog.cc:458] T 00000000000000000000000000000000 P ba2c2f0becd44f9b9bd520495c4cac41 [sys.catalog]: This master's current role is: LEADER
I20260811 05:10:30.814111 18753 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:10:30.815058 18753 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:10:30.815258 18753 catalog_manager.cc:1259] Loaded cluster ID: de5f0fec5a204d9fb159c5c5bb6f39a7
I20260811 05:10:30.815353 18753 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260811 05:10:30.815714 18753 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f0abc46d9ad google::LogMessage::Fail() at ??:0
@ 0x7f0abc47088a google::LogMessage::SendToLog() at ??:0
@ 0x7f0abc46d4de google::LogMessage::Flush() at ??:0
@ 0x7f0abc46ea19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f0ac438e0f1 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7f0ac43978b9 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f0abe33b0d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f0abe330954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f0abf1946db start_thread at ??:0
@ 0x7f0abaf6b61f clone at ??:0
W20260811 05:10:30.908464 18729 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:10:30.908859 18729 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:10:30.908907 18729 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:10:30.910645 18729 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:10:30.910718 18729 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:10:30.910763 18729 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.191.193
I20260811 05:10:30.913133 18729 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:33749
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.193.keytab
--principal=kudu/127.26.191.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.191.193:35057
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.191.193
--webserver_port=44305
--tserver_master_addrs=127.26.191.254:43163
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18729
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.191.193
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:10:30.913424 18729 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:10:30.913707 18729 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:10:30.919348 18794 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:10:30.919376 18793 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:10:30.919348 18802 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:10:30.919868 18729 server_base.cc:1034] running on GCE node
I20260811 05:10:30.920085 18729 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:10:30.920347 18729 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:10:30.921530 18729 hybrid_clock.cc:648] HybridClock initialized: now 1786425030921510 us; error 32 us; skew 500 ppm
Aug 11 05:10:30 dist-test-slave-x5fp krb5kdc[16839](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425030, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:10:30.924475 18729 init.cc:377] Logged in from keytab as kudu/127.26.191.193@KRBTEST.COM (short username kudu)
I20260811 05:10:30.924986 18729 webserver.cc:460] Webserver started at http://127.26.191.193:44305/ using document root <none> and password file <none>
I20260811 05:10:30.925259 18729 fs_manager.cc:359] Metadata directory not provided
I20260811 05:10:30.925333 18729 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:10:30.927237 18729 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 05:10:30.928164 18810 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:10:30.928375 18729 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:10:30.928480 18729 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-0/wal
uuid: "eef4d191e08f406ab76a3b3d722cbdca"
format_stamp: "Formatted at 2026-08-11 05:10:29 on dist-test-slave-x5fp"
server_key: "805efe0fd7a3a4f93c06af8ccaa17225"
server_key_iv: "77b8c060e62f2548ca1c573b3328f660"
server_key_version: "encryptionkey@0"
I20260811 05:10:30.928972 18729 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:10:30.944808 18729 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:10:30.947561 18729 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:10:30.947727 18729 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:10:30.948005 18729 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:10:30.948606 18819 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 05:10:30.950430 18729 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 05:10:30.950492 18729 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260811 05:10:30.950531 18729 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 05:10:30.951399 18729 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 05:10:30.951447 18729 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260811 05:10:30.951534 18819 tablet_bootstrap.cc:492] T 19e435eb40df449f9927f7b448d7d807 P eef4d191e08f406ab76a3b3d722cbdca: Bootstrap starting.
I20260811 05:10:30.959285 18729 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.193:35057
I20260811 05:10:30.959492 19008 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.193:35057 every 8 connection(s)
I20260811 05:10:30.959769 18729 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-0/data/info.pb
I20260811 05:10:30.960254 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 18729
I20260811 05:10:30.960620 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.191.194:33341
--local_ip_for_outbound_sockets=127.26.191.194
--tserver_master_addrs=127.26.191.254:43163
--webserver_port=43125
--webserver_interface=127.26.191.194
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.194.keytab
--principal=kudu/127.26.191.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:33749
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 05:10:30.963729 18819 log.cc:824] T 19e435eb40df449f9927f7b448d7d807 P eef4d191e08f406ab76a3b3d722cbdca: Log is configured to *not* fsync() on all Append() calls
I20260811 05:10:30.966948 18819 tablet_bootstrap.cc:492] T 19e435eb40df449f9927f7b448d7d807 P eef4d191e08f406ab76a3b3d722cbdca: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 05:10:30.967337 18819 tablet_bootstrap.cc:492] T 19e435eb40df449f9927f7b448d7d807 P eef4d191e08f406ab76a3b3d722cbdca: Bootstrap complete.
I20260811 05:10:30.968871 18819 ts_tablet_manager.cc:1397] T 19e435eb40df449f9927f7b448d7d807 P eef4d191e08f406ab76a3b3d722cbdca: Time spent bootstrapping tablet: real 0.017s user 0.006s sys 0.011s
I20260811 05:10:30.970964 18819 raft_consensus.cc:348] T 19e435eb40df449f9927f7b448d7d807 P eef4d191e08f406ab76a3b3d722cbdca [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5641a5f8c562460583a125fdbcd4bafc" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 33341 } } peers { permanent_uuid: "91cfea43aaac41249f8bffa4ae0c3366" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 34413 } } peers { permanent_uuid: "eef4d191e08f406ab76a3b3d722cbdca" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 35057 } }
I20260811 05:10:30.971441 18819 raft_consensus.cc:729] T 19e435eb40df449f9927f7b448d7d807 P eef4d191e08f406ab76a3b3d722cbdca [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: eef4d191e08f406ab76a3b3d722cbdca, State: Initialized, Role: FOLLOWER
I20260811 05:10:30.971658 18819 consensus_queue.cc:260] T 19e435eb40df449f9927f7b448d7d807 P eef4d191e08f406ab76a3b3d722cbdca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5641a5f8c562460583a125fdbcd4bafc" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 33341 } } peers { permanent_uuid: "91cfea43aaac41249f8bffa4ae0c3366" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 34413 } } peers { permanent_uuid: "eef4d191e08f406ab76a3b3d722cbdca" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 35057 } }
I20260811 05:10:30.972043 18819 ts_tablet_manager.cc:1428] T 19e435eb40df449f9927f7b448d7d807 P eef4d191e08f406ab76a3b3d722cbdca: Time spent starting tablet: real 0.003s user 0.001s sys 0.002s
W20260811 05:10:31.037556 19015 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:10:30.963454 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:43163 (local address 127.26.191.193:38685)
0811 05:10:30.963686 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:30.963748 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0811 05:10:30.964484 (+ 736us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:10:31.037328 (+ 72844us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:43163: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":123,"threads_started":1}
W20260811 05:10:31.037837 19011 heartbeater.cc:644] Failed to heartbeat to 127.26.191.254:43163 (0 consecutive failures): Network error: Failed to ping master at 127.26.191.254:43163: Client connection negotiation failed: client connection to 127.26.191.254:43163: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 05:10:31.038169 19015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:31.038056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:43163 (local address 127.26.191.193:54695)
0811 05:10:31.038108 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:31.038150 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:43163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260811 05:10:31.038522 19015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:31.038437 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:43163 (local address 127.26.191.193:38873)
0811 05:10:31.038482 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:31.038506 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:43163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260811 05:10:31.038643 19011 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 05:10:31.053360 19013 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:10:31.053555 19013 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:10:31.053579 19013 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:10:31.054636 19013 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:10:31.054669 19013 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:10:31.054694 19013 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.191.194
I20260811 05:10:31.056030 19013 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:33749
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.194.keytab
--principal=kudu/127.26.191.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.191.194:33341
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.191.194
--webserver_port=43125
--tserver_master_addrs=127.26.191.254:43163
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19013
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.191.194
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:10:31.056210 19013 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:10:31.056387 19013 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:10:31.061539 19027 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:10:31.061630 19026 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:10:31.061517 19029 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:10:31.061702 19013 server_base.cc:1034] running on GCE node
I20260811 05:10:31.061960 19013 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:10:31.062152 19013 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:10:31.063285 19013 hybrid_clock.cc:648] HybridClock initialized: now 1786425031063274 us; error 30 us; skew 500 ppm
Aug 11 05:10:31 dist-test-slave-x5fp krb5kdc[16839](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425031, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:10:31.066120 19013 init.cc:377] Logged in from keytab as kudu/127.26.191.194@KRBTEST.COM (short username kudu)
I20260811 05:10:31.066620 19013 webserver.cc:460] Webserver started at http://127.26.191.194:43125/ using document root <none> and password file <none>
I20260811 05:10:31.066845 19013 fs_manager.cc:359] Metadata directory not provided
I20260811 05:10:31.066915 19013 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:10:31.068262 19013 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:10:31.069141 19045 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:10:31.069327 19013 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:10:31.069432 19013 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-1/wal
uuid: "5641a5f8c562460583a125fdbcd4bafc"
format_stamp: "Formatted at 2026-08-11 05:10:29 on dist-test-slave-x5fp"
server_key: "fb40a64055cfa20f1d51158c9c9b6974"
server_key_iv: "9a834454292b2c0b770554fc5faefd77"
server_key_version: "encryptionkey@0"
I20260811 05:10:31.069782 19013 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:10:31.081919 19013 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:10:31.084261 19013 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:10:31.084434 19013 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:10:31.084678 19013 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:10:31.085018 19013 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:10:31.085070 19013 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:10:31.085112 19013 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:10:31.085141 19013 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:10:31.091403 19013 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.194:33341
I20260811 05:10:31.091449 19220 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.194:33341 every 8 connection(s)
I20260811 05:10:31.091795 19013 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-1/data/info.pb
I20260811 05:10:31.092954 19224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:31.092476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:43163 (local address 127.26.191.194:56379)
0811 05:10:31.092631 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:31.092786 (+ 155us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:43163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":73,"threads_started":1}
W20260811 05:10:31.093369 19221 heartbeater.cc:644] Failed to heartbeat to 127.26.191.254:43163 (0 consecutive failures): Network error: Failed to ping master at 127.26.191.254:43163: Client connection negotiation failed: client connection to 127.26.191.254:43163: connect: Connection refused (error 111)
I20260811 05:10:31.093688 19224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:31.093564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:43163 (local address 127.26.191.194:58477)
0811 05:10:31.093628 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:31.093663 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:43163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260811 05:10:31.094094 19224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:31.093985 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:43163 (local address 127.26.191.194:44233)
0811 05:10:31.094041 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:31.094072 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:43163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260811 05:10:31.094264 19221 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 05:10:31.099057 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 19013
I20260811 05:10:31.099323 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.191.195:34413
--local_ip_for_outbound_sockets=127.26.191.195
--tserver_master_addrs=127.26.191.254:43163
--webserver_port=37913
--webserver_interface=127.26.191.195
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.195.keytab
--principal=kudu/127.26.191.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:33749
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:10:31.185395 19225 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:10:31.185613 19225 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:10:31.185638 19225 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:10:31.186733 19225 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:10:31.186781 19225 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:10:31.186808 19225 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.191.195
I20260811 05:10:31.188205 19225 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:33749
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.195.keytab
--principal=kudu/127.26.191.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.191.195:34413
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.191.195
--webserver_port=37913
--tserver_master_addrs=127.26.191.254:43163
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19225
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.191.195
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:10:31.188405 19225 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:10:31.188588 19225 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:10:31.193804 19238 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:10:31.193923 19240 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:10:31.193813 19236 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:10:31.194315 19225 server_base.cc:1034] running on GCE node
I20260811 05:10:31.194643 19225 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:10:31.194959 19225 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:10:31.196144 19225 hybrid_clock.cc:648] HybridClock initialized: now 1786425031196126 us; error 30 us; skew 500 ppm
Aug 11 05:10:31 dist-test-slave-x5fp krb5kdc[16839](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425031, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:10:31.199062 19225 init.cc:377] Logged in from keytab as kudu/127.26.191.195@KRBTEST.COM (short username kudu)
I20260811 05:10:31.199538 19225 webserver.cc:460] Webserver started at http://127.26.191.195:37913/ using document root <none> and password file <none>
I20260811 05:10:31.199795 19225 fs_manager.cc:359] Metadata directory not provided
I20260811 05:10:31.199867 19225 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:10:31.201524 19225 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.000s
I20260811 05:10:31.202243 19249 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:10:31.202436 19225 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 05:10:31.202549 19225 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-2/wal
uuid: "91cfea43aaac41249f8bffa4ae0c3366"
format_stamp: "Formatted at 2026-08-11 05:10:29 on dist-test-slave-x5fp"
server_key: "c05ffd01b9e8756ffe08bfda2dc837b0"
server_key_iv: "fcffb631b27a7aa591a1bfeeb6201c94"
server_key_version: "encryptionkey@0"
I20260811 05:10:31.202937 19225 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:10:31.218935 19225 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:10:31.221025 19225 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:10:31.221196 19225 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:10:31.221462 19225 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:10:31.221810 19225 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:10:31.221869 19225 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:10:31.221915 19225 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:10:31.221966 19225 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:10:31.228637 19225 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.195:34413
I20260811 05:10:31.228741 19433 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.195:34413 every 8 connection(s)
I20260811 05:10:31.229140 19225 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424853995437-27391-0/minicluster-data/ts-2/data/info.pb
I20260811 05:10:31.230387 19437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:31.229997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:43163 (local address 127.26.191.195:37689)
0811 05:10:31.230157 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:31.230243 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:43163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":76,"threads_started":1}
W20260811 05:10:31.230870 19435 heartbeater.cc:644] Failed to heartbeat to 127.26.191.254:43163 (0 consecutive failures): Network error: Failed to ping master at 127.26.191.254:43163: Client connection negotiation failed: client connection to 127.26.191.254:43163: connect: Connection refused (error 111)
I20260811 05:10:31.231199 19437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:31.231074 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:43163 (local address 127.26.191.195:38811)
0811 05:10:31.231143 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:31.231176 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:43163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260811 05:10:31.231583 19437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:31.231504 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:43163 (local address 127.26.191.195:34575)
0811 05:10:31.231533 (+ 29us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:31.231560 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:43163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":15}
W20260811 05:10:31.231698 19435 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 05:10:31.235610 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 19225
I20260811 05:10:32.039410 19445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:32.039084 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:43163 (local address 127.26.191.193:35317)
0811 05:10:32.039268 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:32.039349 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:43163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":72,"threads_started":1}
I20260811 05:10:32.094990 19446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:32.094686 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:43163 (local address 127.26.191.194:32849)
0811 05:10:32.094866 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:32.094919 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:43163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":68,"threads_started":1}
I20260811 05:10:32.232316 19447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:32.232052 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:43163 (local address 127.26.191.195:51363)
0811 05:10:32.232204 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:32.232245 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:43163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":66,"threads_started":1}
I20260811 05:10:32.766801 19448 raft_consensus.cc:482] T 19e435eb40df449f9927f7b448d7d807 P eef4d191e08f406ab76a3b3d722cbdca [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 05:10:32.767059 19448 raft_consensus.cc:504] T 19e435eb40df449f9927f7b448d7d807 P eef4d191e08f406ab76a3b3d722cbdca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5641a5f8c562460583a125fdbcd4bafc" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 33341 } } peers { permanent_uuid: "91cfea43aaac41249f8bffa4ae0c3366" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 34413 } } peers { permanent_uuid: "eef4d191e08f406ab76a3b3d722cbdca" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 35057 } }
I20260811 05:10:32.767450 19448 leader_election.cc:288] T 19e435eb40df449f9927f7b448d7d807 P eef4d191e08f406ab76a3b3d722cbdca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5641a5f8c562460583a125fdbcd4bafc (127.26.191.194:33341), 91cfea43aaac41249f8bffa4ae0c3366 (127.26.191.195:34413)
Aug 11 05:10:32 dist-test-slave-x5fp krb5kdc[16839](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425030, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.193@KRBTEST.COM for kudu/127.26.191.195@KRBTEST.COM
Aug 11 05:10:32 dist-test-slave-x5fp krb5kdc[16839](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425030, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.193@KRBTEST.COM for kudu/127.26.191.194@KRBTEST.COM
I20260811 05:10:32.782483 19450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:32.767625 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.195:34413 (local address 127.26.191.193:34257)
0811 05:10:32.767756 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:32.767770 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 05:10:32.767831 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:10:32.768997 (+ 1166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:10:32.768998 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:10:32.769243 (+ 245us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:10:32.769427 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:10:32.769434 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:10:32.770577 (+ 1143us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:10:32.770579 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:10:32.771398 (+ 819us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:10:32.771400 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:10:32.772131 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:10:32.772132 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:10:32.772265 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:32.776382 (+ 4117us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:10:32.776387 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:10:32.778279 (+ 1892us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:10:32.780457 (+ 2178us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:10:32.780464 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:10:32.780467 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:10:32.780800 (+ 333us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:10:32.781085 (+ 285us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:10:32.781086 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:10:32.781086 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:10:32.781236 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:10:32.781806 (+ 570us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:10:32.781816 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:10:32.781993 (+ 177us) client_negotiation.cc:769] Sending connection context
0811 05:10:32.782127 (+ 134us) client_negotiation.cc:240] Negotiation successful
0811 05:10:32.782327 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"mutex_wait_us":7,"thread_start_us":53,"threads_started":1}
I20260811 05:10:32.782574 19454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:32.767944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.193:34257 (local address 127.26.191.195:34413)
0811 05:10:32.768111 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0811 05:10:32.768119 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 05:10:32.768140 (+ 21us) server_negotiation.cc:407] Connection header received
0811 05:10:32.768574 (+ 434us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:10:32.768576 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:10:32.768616 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:10:32.768808 (+ 192us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:10:32.769584 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:32.770467 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:32.771496 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:32.771932 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:32.772016 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:32.778476 (+ 6460us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:10:32.778482 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:10:32.778483 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:10:32.778497 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:10:32.780359 (+ 1862us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:10:32.780888 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:10:32.780892 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:10:32.780898 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:10:32.781002 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:10:32.781309 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:10:32.781310 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:10:32.781311 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:10:32.781682 (+ 371us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:10:32.781779 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0811 05:10:32.782243 (+ 464us) server_negotiation.cc:299] Negotiation successful
0811 05:10:32.782449 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":125,"thread_start_us":75,"threads_started":1}
I20260811 05:10:32.782641 19451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:32.767630 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.194:33341 (local address 127.26.191.193:55823)
0811 05:10:32.767857 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:32.767868 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 05:10:32.767929 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:10:32.768793 (+ 864us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:10:32.768796 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:10:32.769235 (+ 439us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:10:32.769428 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:10:32.769434 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:10:32.770602 (+ 1168us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:10:32.770603 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:10:32.771400 (+ 797us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:10:32.771403 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:10:32.772156 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:10:32.772157 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:10:32.772251 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:32.776357 (+ 4106us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:10:32.776368 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:10:32.778689 (+ 2321us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:10:32.781144 (+ 2455us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:10:32.781145 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:10:32.781145 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:10:32.781361 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:10:32.781634 (+ 273us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:10:32.781634 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:10:32.781635 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:10:32.781708 (+ 73us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:10:32.782272 (+ 564us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:10:32.782273 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:10:32.782334 (+ 61us) client_negotiation.cc:769] Sending connection context
0811 05:10:32.782426 (+ 92us) client_negotiation.cc:240] Negotiation successful
0811 05:10:32.782533 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":212,"mutex_wait_us":86,"thread_start_us":59,"threads_started":1}
I20260811 05:10:32.782805 19452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:32.767748 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.193:55823 (local address 127.26.191.194:33341)
0811 05:10:32.767963 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0811 05:10:32.767977 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 05:10:32.768003 (+ 26us) server_negotiation.cc:407] Connection header received
0811 05:10:32.768501 (+ 498us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:10:32.768504 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:10:32.768546 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:10:32.768664 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:10:32.769577 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:32.770476 (+ 899us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:32.771534 (+ 1058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:32.772065 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:32.772186 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:32.778826 (+ 6640us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:10:32.778830 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:10:32.778831 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:10:32.778842 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:10:32.781028 (+ 2186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:10:32.781469 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:10:32.781472 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:10:32.781472 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:10:32.781566 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:10:32.781806 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:10:32.781807 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:10:32.781807 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:10:32.782180 (+ 373us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:10:32.782262 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 05:10:32.782509 (+ 247us) server_negotiation.cc:299] Negotiation successful
0811 05:10:32.782671 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":174,"thread_start_us":62,"threads_started":1}
W20260811 05:10:32.784206 18812 leader_election.cc:341] T 19e435eb40df449f9927f7b448d7d807 P eef4d191e08f406ab76a3b3d722cbdca [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 91cfea43aaac41249f8bffa4ae0c3366 (127.26.191.195:34413): Not found: Tablet not found: 19e435eb40df449f9927f7b448d7d807
W20260811 05:10:32.784314 18814 leader_election.cc:341] T 19e435eb40df449f9927f7b448d7d807 P eef4d191e08f406ab76a3b3d722cbdca [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5641a5f8c562460583a125fdbcd4bafc (127.26.191.194:33341): Not found: Tablet not found: 19e435eb40df449f9927f7b448d7d807
I20260811 05:10:32.784353 18814 leader_election.cc:302] T 19e435eb40df449f9927f7b448d7d807 P eef4d191e08f406ab76a3b3d722cbdca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eef4d191e08f406ab76a3b3d722cbdca; no voters: 5641a5f8c562460583a125fdbcd4bafc, 91cfea43aaac41249f8bffa4ae0c3366
I20260811 05:10:32.784480 19448 raft_consensus.cc:2726] T 19e435eb40df449f9927f7b448d7d807 P eef4d191e08f406ab76a3b3d722cbdca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 05:10:33.040292 19450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:33.040106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:43163 (local address 127.26.191.193:59529)
0811 05:10:33.040184 (+ 78us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:33.040238 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:43163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260811 05:10:33.095849 19455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:33.095572 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:43163 (local address 127.26.191.194:33753)
0811 05:10:33.095725 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:33.095775 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:43163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":68,"threads_started":1}
I20260811 05:10:33.233260 19456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:33.232965 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:43163 (local address 127.26.191.195:38719)
0811 05:10:33.233137 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:33.233205 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:43163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":80,"threads_started":1}
I20260811 05:10:34.041220 19458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:34.040973 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:43163 (local address 127.26.191.193:32805)
0811 05:10:34.041121 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:34.041166 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:43163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":73,"threads_started":1}
I20260811 05:10:34.096779 19459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:34.096448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:43163 (local address 127.26.191.194:40713)
0811 05:10:34.096629 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:34.096671 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:43163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":106,"threads_started":1}
I20260811 05:10:34.234118 19460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:34.233834 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:43163 (local address 127.26.191.195:33673)
0811 05:10:34.234002 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:34.234045 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:43163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":66,"threads_started":1}
I20260811 05:10:34.461612 19461 raft_consensus.cc:482] T 19e435eb40df449f9927f7b448d7d807 P eef4d191e08f406ab76a3b3d722cbdca [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 05:10:34.461788 19461 raft_consensus.cc:504] T 19e435eb40df449f9927f7b448d7d807 P eef4d191e08f406ab76a3b3d722cbdca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5641a5f8c562460583a125fdbcd4bafc" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 33341 } } peers { permanent_uuid: "91cfea43aaac41249f8bffa4ae0c3366" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 34413 } } peers { permanent_uuid: "eef4d191e08f406ab76a3b3d722cbdca" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 35057 } }
I20260811 05:10:34.462020 19461 leader_election.cc:288] T 19e435eb40df449f9927f7b448d7d807 P eef4d191e08f406ab76a3b3d722cbdca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5641a5f8c562460583a125fdbcd4bafc (127.26.191.194:33341), 91cfea43aaac41249f8bffa4ae0c3366 (127.26.191.195:34413)
W20260811 05:10:34.462497 18814 leader_election.cc:341] T 19e435eb40df449f9927f7b448d7d807 P eef4d191e08f406ab76a3b3d722cbdca [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5641a5f8c562460583a125fdbcd4bafc (127.26.191.194:33341): Not found: Tablet not found: 19e435eb40df449f9927f7b448d7d807
W20260811 05:10:34.462594 18812 leader_election.cc:341] T 19e435eb40df449f9927f7b448d7d807 P eef4d191e08f406ab76a3b3d722cbdca [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 91cfea43aaac41249f8bffa4ae0c3366 (127.26.191.195:34413): Not found: Tablet not found: 19e435eb40df449f9927f7b448d7d807
I20260811 05:10:34.462690 18812 leader_election.cc:302] T 19e435eb40df449f9927f7b448d7d807 P eef4d191e08f406ab76a3b3d722cbdca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eef4d191e08f406ab76a3b3d722cbdca; no voters: 5641a5f8c562460583a125fdbcd4bafc, 91cfea43aaac41249f8bffa4ae0c3366
I20260811 05:10:34.462801 19461 raft_consensus.cc:2726] T 19e435eb40df449f9927f7b448d7d807 P eef4d191e08f406ab76a3b3d722cbdca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 05:10:35.042047 19462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:35.041804 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:43163 (local address 127.26.191.193:56867)
0811 05:10:35.041944 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:35.041993 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:43163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":70,"threads_started":1}
I20260811 05:10:35.097730 19463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:35.097392 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:43163 (local address 127.26.191.194:58891)
0811 05:10:35.097604 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:35.097655 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:43163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":87,"threads_started":1}
I20260811 05:10:35.234972 19466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:35.234708 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:43163 (local address 127.26.191.195:39379)
0811 05:10:35.234867 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:35.234905 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:43163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":87,"threads_started":1}
I20260811 05:10:36.042972 19467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:36.042660 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:43163 (local address 127.26.191.193:56099)
0811 05:10:36.042857 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:36.042911 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:43163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":70,"threads_started":1}
I20260811 05:10:36.098685 19468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:36.098376 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:43163 (local address 127.26.191.194:60893)
0811 05:10:36.098579 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:36.098629 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:43163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":101,"threads_started":1}
I20260811 05:10:36.235608 19469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:36.235385 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:43163 (local address 127.26.191.195:52617)
0811 05:10:36.235522 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:36.235562 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:43163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":67,"threads_started":1}
I20260811 05:10:36.838721 19470 raft_consensus.cc:482] T 19e435eb40df449f9927f7b448d7d807 P eef4d191e08f406ab76a3b3d722cbdca [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 05:10:36.838887 19470 raft_consensus.cc:504] T 19e435eb40df449f9927f7b448d7d807 P eef4d191e08f406ab76a3b3d722cbdca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5641a5f8c562460583a125fdbcd4bafc" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 33341 } } peers { permanent_uuid: "91cfea43aaac41249f8bffa4ae0c3366" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 34413 } } peers { permanent_uuid: "eef4d191e08f406ab76a3b3d722cbdca" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 35057 } }
I20260811 05:10:36.839138 19470 leader_election.cc:288] T 19e435eb40df449f9927f7b448d7d807 P eef4d191e08f406ab76a3b3d722cbdca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5641a5f8c562460583a125fdbcd4bafc (127.26.191.194:33341), 91cfea43aaac41249f8bffa4ae0c3366 (127.26.191.195:34413)
W20260811 05:10:36.839532 18814 leader_election.cc:341] T 19e435eb40df449f9927f7b448d7d807 P eef4d191e08f406ab76a3b3d722cbdca [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5641a5f8c562460583a125fdbcd4bafc (127.26.191.194:33341): Not found: Tablet not found: 19e435eb40df449f9927f7b448d7d807
W20260811 05:10:36.839617 18812 leader_election.cc:341] T 19e435eb40df449f9927f7b448d7d807 P eef4d191e08f406ab76a3b3d722cbdca [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 91cfea43aaac41249f8bffa4ae0c3366 (127.26.191.195:34413): Not found: Tablet not found: 19e435eb40df449f9927f7b448d7d807
I20260811 05:10:36.839649 18814 leader_election.cc:302] T 19e435eb40df449f9927f7b448d7d807 P eef4d191e08f406ab76a3b3d722cbdca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eef4d191e08f406ab76a3b3d722cbdca; no voters: 5641a5f8c562460583a125fdbcd4bafc, 91cfea43aaac41249f8bffa4ae0c3366
I20260811 05:10:36.839736 19470 raft_consensus.cc:2726] T 19e435eb40df449f9927f7b448d7d807 P eef4d191e08f406ab76a3b3d722cbdca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 05:10:37.043768 19472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:37.043517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:43163 (local address 127.26.191.193:57687)
0811 05:10:37.043668 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:37.043709 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:43163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":78,"threads_started":1}
I20260811 05:10:37.099646 19476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:37.099367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:43163 (local address 127.26.191.194:37147)
0811 05:10:37.099543 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:37.099587 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:43163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":92,"threads_started":1}
I20260811 05:10:37.236379 19478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:37.236145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:43163 (local address 127.26.191.195:49717)
0811 05:10:37.236290 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:37.236328 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:43163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":83,"threads_started":1}
I20260811 05:10:38.044639 19480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:38.044368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:43163 (local address 127.26.191.193:39857)
0811 05:10:38.044545 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:38.044586 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:43163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":98,"threads_started":1}
I20260811 05:10:38.100603 19481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:38.100324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:43163 (local address 127.26.191.194:38425)
0811 05:10:38.100502 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:38.100550 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:43163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":87,"threads_started":1}
I20260811 05:10:38.237293 19482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:38.236970 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:43163 (local address 127.26.191.195:54305)
0811 05:10:38.237188 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:38.237238 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:43163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":84,"threads_started":1}
I20260811 05:10:39.045492 19484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:39.045231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:43163 (local address 127.26.191.193:51299)
0811 05:10:39.045391 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:39.045439 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:43163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":73,"threads_started":1}
I20260811 05:10:39.101583 19485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:39.101308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:43163 (local address 127.26.191.194:53905)
0811 05:10:39.101488 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:39.101532 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:43163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":111,"threads_started":1}
I20260811 05:10:39.238240 19486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:39.237959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:43163 (local address 127.26.191.195:42717)
0811 05:10:39.238133 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:39.238187 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:43163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":83,"threads_started":1}
I20260811 05:10:40.046373 19487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:40.046058 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:43163 (local address 127.26.191.193:34489)
0811 05:10:40.046237 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:40.046281 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:43163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":103,"threads_started":1}
I20260811 05:10:40.102430 19488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:40.102174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:43163 (local address 127.26.191.194:47143)
0811 05:10:40.102319 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:40.102375 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:43163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":73,"threads_started":1}
I20260811 05:10:40.148655 19489 raft_consensus.cc:482] T 19e435eb40df449f9927f7b448d7d807 P eef4d191e08f406ab76a3b3d722cbdca [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 05:10:40.148860 19489 raft_consensus.cc:504] T 19e435eb40df449f9927f7b448d7d807 P eef4d191e08f406ab76a3b3d722cbdca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5641a5f8c562460583a125fdbcd4bafc" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 33341 } } peers { permanent_uuid: "91cfea43aaac41249f8bffa4ae0c3366" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 34413 } } peers { permanent_uuid: "eef4d191e08f406ab76a3b3d722cbdca" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 35057 } }
I20260811 05:10:40.149120 19489 leader_election.cc:288] T 19e435eb40df449f9927f7b448d7d807 P eef4d191e08f406ab76a3b3d722cbdca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5641a5f8c562460583a125fdbcd4bafc (127.26.191.194:33341), 91cfea43aaac41249f8bffa4ae0c3366 (127.26.191.195:34413)
W20260811 05:10:40.149559 18814 leader_election.cc:341] T 19e435eb40df449f9927f7b448d7d807 P eef4d191e08f406ab76a3b3d722cbdca [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5641a5f8c562460583a125fdbcd4bafc (127.26.191.194:33341): Not found: Tablet not found: 19e435eb40df449f9927f7b448d7d807
W20260811 05:10:40.149639 18812 leader_election.cc:341] T 19e435eb40df449f9927f7b448d7d807 P eef4d191e08f406ab76a3b3d722cbdca [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 91cfea43aaac41249f8bffa4ae0c3366 (127.26.191.195:34413): Not found: Tablet not found: 19e435eb40df449f9927f7b448d7d807
I20260811 05:10:40.149745 18812 leader_election.cc:302] T 19e435eb40df449f9927f7b448d7d807 P eef4d191e08f406ab76a3b3d722cbdca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eef4d191e08f406ab76a3b3d722cbdca; no voters: 5641a5f8c562460583a125fdbcd4bafc, 91cfea43aaac41249f8bffa4ae0c3366
I20260811 05:10:40.149842 19489 raft_consensus.cc:2726] T 19e435eb40df449f9927f7b448d7d807 P eef4d191e08f406ab76a3b3d722cbdca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 05:10:40.239235 19490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:40.238958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:43163 (local address 127.26.191.195:43397)
0811 05:10:40.239123 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:40.239181 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:43163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":88,"threads_started":1}
I20260811 05:10:41.047277 19491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:41.047000 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:43163 (local address 127.26.191.193:50577)
0811 05:10:41.047180 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:41.047225 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:43163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":96,"threads_started":1}
I20260811 05:10:41.103327 19494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:41.103048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:43163 (local address 127.26.191.194:57925)
0811 05:10:41.103223 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:41.103273 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:43163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":73,"threads_started":1}
I20260811 05:10:41.240098 19496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:41.239812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:43163 (local address 127.26.191.195:58303)
0811 05:10:41.239992 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:41.240044 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:43163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":86,"threads_started":1}
I20260811 05:10:42.048125 19498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:42.047878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:43163 (local address 127.26.191.193:43329)
0811 05:10:42.048021 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:42.048069 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:43163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":70,"threads_started":1}
I20260811 05:10:42.104300 19499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:42.103995 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:43163 (local address 127.26.191.194:55135)
0811 05:10:42.104189 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:42.104242 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:43163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":92,"threads_started":1}
I20260811 05:10:42.241056 19500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:42.240772 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:43163 (local address 127.26.191.195:38005)
0811 05:10:42.240955 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:42.241002 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:43163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":89,"threads_started":1}
I20260811 05:10:43.048995 19503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:43.048682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:43163 (local address 127.26.191.193:57935)
0811 05:10:43.048896 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:43.048940 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:43163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":149,"threads_started":1}
I20260811 05:10:43.105284 19507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:43.104998 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:43163 (local address 127.26.191.194:55635)
0811 05:10:43.105179 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:43.105230 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:43163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":70,"threads_started":1}
I20260811 05:10:43.241880 19508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:43.241616 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:43163 (local address 127.26.191.195:53203)
0811 05:10:43.241780 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:43.241826 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:43163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":67,"threads_started":1}
I20260811 05:10:44.049821 19511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:44.049517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:43163 (local address 127.26.191.193:47117)
0811 05:10:44.049703 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:44.049763 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:43163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":72,"threads_started":1}
I20260811 05:10:44.106240 19513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:44.105929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:43163 (local address 127.26.191.194:50769)
0811 05:10:44.106104 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:44.106158 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:43163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":73,"threads_started":1}
I20260811 05:10:44.242908 19514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:44.242589 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:43163 (local address 127.26.191.195:55451)
0811 05:10:44.242769 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:44.242855 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:43163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":111,"threads_started":1}
I20260811 05:10:44.779399 19518 raft_consensus.cc:482] T 19e435eb40df449f9927f7b448d7d807 P eef4d191e08f406ab76a3b3d722cbdca [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 05:10:44.779551 19518 raft_consensus.cc:504] T 19e435eb40df449f9927f7b448d7d807 P eef4d191e08f406ab76a3b3d722cbdca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5641a5f8c562460583a125fdbcd4bafc" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 33341 } } peers { permanent_uuid: "91cfea43aaac41249f8bffa4ae0c3366" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 34413 } } peers { permanent_uuid: "eef4d191e08f406ab76a3b3d722cbdca" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 35057 } }
I20260811 05:10:44.779852 19518 leader_election.cc:288] T 19e435eb40df449f9927f7b448d7d807 P eef4d191e08f406ab76a3b3d722cbdca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5641a5f8c562460583a125fdbcd4bafc (127.26.191.194:33341), 91cfea43aaac41249f8bffa4ae0c3366 (127.26.191.195:34413)
W20260811 05:10:44.780411 18814 leader_election.cc:341] T 19e435eb40df449f9927f7b448d7d807 P eef4d191e08f406ab76a3b3d722cbdca [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5641a5f8c562460583a125fdbcd4bafc (127.26.191.194:33341): Not found: Tablet not found: 19e435eb40df449f9927f7b448d7d807
W20260811 05:10:44.780503 18812 leader_election.cc:341] T 19e435eb40df449f9927f7b448d7d807 P eef4d191e08f406ab76a3b3d722cbdca [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 91cfea43aaac41249f8bffa4ae0c3366 (127.26.191.195:34413): Not found: Tablet not found: 19e435eb40df449f9927f7b448d7d807
I20260811 05:10:44.780594 18812 leader_election.cc:302] T 19e435eb40df449f9927f7b448d7d807 P eef4d191e08f406ab76a3b3d722cbdca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eef4d191e08f406ab76a3b3d722cbdca; no voters: 5641a5f8c562460583a125fdbcd4bafc, 91cfea43aaac41249f8bffa4ae0c3366
I20260811 05:10:44.780680 19518 raft_consensus.cc:2726] T 19e435eb40df449f9927f7b448d7d807 P eef4d191e08f406ab76a3b3d722cbdca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 05:10:45.050637 19519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:45.050388 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:43163 (local address 127.26.191.193:33281)
0811 05:10:45.050528 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:45.050584 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:43163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":71,"threads_started":1}
I20260811 05:10:45.107229 19521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:45.106924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:43163 (local address 127.26.191.194:41881)
0811 05:10:45.107101 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:45.107154 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:43163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":76,"threads_started":1}
I20260811 05:10:45.243741 19522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:45.243482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:43163 (local address 127.26.191.195:60389)
0811 05:10:45.243632 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:45.243680 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:43163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":67,"threads_started":1}
I20260811 05:10:46.051620 19523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:46.051355 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:43163 (local address 127.26.191.193:49091)
0811 05:10:46.051527 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:46.051570 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:43163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":107,"threads_started":1}
I20260811 05:10:46.108111 19529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:46.107856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:43163 (local address 127.26.191.194:38459)
0811 05:10:46.108017 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:46.108059 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:43163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":68,"threads_started":1}
I20260811 05:10:46.244689 19531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:46.244430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:43163 (local address 127.26.191.195:53863)
0811 05:10:46.244596 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:46.244640 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:43163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":95,"threads_started":1}
I20260811 05:10:46.244899 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 18729
I20260811 05:10:46.259038 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 19013
I20260811 05:10:46.271339 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 19225
2026-08-11T05:10:46Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (18743 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 05:10:46 dist-test-slave-x5fp krb5kdc[19536](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 05:10:46 dist-test-slave-x5fp krb5kdc[19536](info): set up 2 sockets
Aug 11 05:10:46 dist-test-slave-x5fp krb5kdc[19536](info): commencing operation
krb5kdc: starting...
W20260811 05:10:47.574394 27391 mini_kdc.cc:121] Time spent starting KDC: real 1.277s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/krb5kdc/test-user.keytab.
Aug 11 05:10:47 dist-test-slave-x5fp krb5kdc[19536](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425047, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T05:10:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:10:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.191.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.191.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.191.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab.
Entry for principal kudu/127.26.191.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab.
I20260811 05:10:47.708137 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.254:35153
--webserver_interface=127.26.191.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab
--principal=kudu/127.26.191.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:36843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.191.254:35153
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:10:47.794646 19559 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:10:47.794899 19559 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:10:47.794938 19559 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:10:47.796100 19559 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260811 05:10:47.796166 19559 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260811 05:10:47.796187 19559 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260811 05:10:47.796208 19559 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:10:47.796241 19559 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:10:47.796271 19559 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:10:47.796299 19559 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:10:47.796329 19559 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:10:47.797950 19559 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:36843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.26.191.254:35153
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab
--principal=kudu/127.26.191.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.254:35153
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.191.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19559
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:10:47.798219 19559 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:10:47.798450 19559 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:10:47.803973 19571 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:10:47.803934 19568 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:10:47.803948 19573 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:10:47.803985 19559 server_base.cc:1034] running on GCE node
I20260811 05:10:47.804584 19559 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:10:47.804958 19559 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:10:47.806162 19559 hybrid_clock.cc:648] HybridClock initialized: now 1786425047806136 us; error 37 us; skew 500 ppm
Aug 11 05:10:47 dist-test-slave-x5fp krb5kdc[19536](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425047, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:10:47.808923 19559 init.cc:377] Logged in from keytab as kudu/127.26.191.254@KRBTEST.COM (short username kudu)
I20260811 05:10:47.809423 19559 webserver.cc:460] Webserver started at http://127.26.191.254:42835/ using document root <none> and password file <none>
I20260811 05:10:47.809661 19559 fs_manager.cc:359] Metadata directory not provided
I20260811 05:10:47.809739 19559 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:10:47.809878 19559 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:10:47.811122 19559 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/master-0/data/instance:
uuid: "ea8d771dbb754fa395a9c28a383f0178"
format_stamp: "Formatted at 2026-08-11 05:10:47 on dist-test-slave-x5fp"
server_key: "b4215ce217a7be6d831df908706b72fc"
server_key_iv: "1aedcdb52a6b5d1d6183dbd00bd4fa9e"
server_key_version: "encryptionkey@0"
I20260811 05:10:47.811548 19559 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/master-0/wal/instance:
uuid: "ea8d771dbb754fa395a9c28a383f0178"
format_stamp: "Formatted at 2026-08-11 05:10:47 on dist-test-slave-x5fp"
server_key: "b4215ce217a7be6d831df908706b72fc"
server_key_iv: "1aedcdb52a6b5d1d6183dbd00bd4fa9e"
server_key_version: "encryptionkey@0"
I20260811 05:10:47.813109 19559 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 05:10:47.814093 19584 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:10:47.814327 19559 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:10:47.814566 19559 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/master-0/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/master-0/wal
uuid: "ea8d771dbb754fa395a9c28a383f0178"
format_stamp: "Formatted at 2026-08-11 05:10:47 on dist-test-slave-x5fp"
server_key: "b4215ce217a7be6d831df908706b72fc"
server_key_iv: "1aedcdb52a6b5d1d6183dbd00bd4fa9e"
server_key_version: "encryptionkey@0"
I20260811 05:10:47.814713 19559 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:10:47.833853 19559 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:10:47.836211 19559 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:10:47.836416 19559 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:10:47.841077 19559 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.254:35153
I20260811 05:10:47.841157 19667 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.254:35153 every 8 connection(s)
I20260811 05:10:47.841566 19559 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
I20260811 05:10:47.842600 19668 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:10:47.844494 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 19559
I20260811 05:10:47.844635 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/master-0/wal/instance
I20260811 05:10:47.844887 27391 external_mini_cluster.cc:1428] Setting key 9e0b76c83d8d9447a937d3225a4158d6
I20260811 05:10:47.845196 19668 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ea8d771dbb754fa395a9c28a383f0178: Bootstrap starting.
I20260811 05:10:47.846027 19668 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ea8d771dbb754fa395a9c28a383f0178: Neither blocks nor log segments found. Creating new log.
I20260811 05:10:47.846383 19668 log.cc:824] T 00000000000000000000000000000000 P ea8d771dbb754fa395a9c28a383f0178: Log is configured to *not* fsync() on all Append() calls
I20260811 05:10:47.847208 19668 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ea8d771dbb754fa395a9c28a383f0178: No bootstrap required, opened a new log
I20260811 05:10:47.849188 19668 raft_consensus.cc:348] T 00000000000000000000000000000000 P ea8d771dbb754fa395a9c28a383f0178 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea8d771dbb754fa395a9c28a383f0178" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 35153 } }
I20260811 05:10:47.849359 19668 raft_consensus.cc:374] T 00000000000000000000000000000000 P ea8d771dbb754fa395a9c28a383f0178 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:10:47.849409 19668 raft_consensus.cc:729] T 00000000000000000000000000000000 P ea8d771dbb754fa395a9c28a383f0178 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea8d771dbb754fa395a9c28a383f0178, State: Initialized, Role: FOLLOWER
I20260811 05:10:47.849581 19668 consensus_queue.cc:260] T 00000000000000000000000000000000 P ea8d771dbb754fa395a9c28a383f0178 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea8d771dbb754fa395a9c28a383f0178" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 35153 } }
I20260811 05:10:47.849677 19668 raft_consensus.cc:388] T 00000000000000000000000000000000 P ea8d771dbb754fa395a9c28a383f0178 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:10:47.849725 19668 raft_consensus.cc:482] T 00000000000000000000000000000000 P ea8d771dbb754fa395a9c28a383f0178 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:10:47.849776 19668 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ea8d771dbb754fa395a9c28a383f0178 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:10:47.850466 19668 raft_consensus.cc:504] T 00000000000000000000000000000000 P ea8d771dbb754fa395a9c28a383f0178 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea8d771dbb754fa395a9c28a383f0178" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 35153 } }
I20260811 05:10:47.850603 19668 leader_election.cc:302] T 00000000000000000000000000000000 P ea8d771dbb754fa395a9c28a383f0178 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ea8d771dbb754fa395a9c28a383f0178; no voters:
I20260811 05:10:47.850811 19668 leader_election.cc:288] T 00000000000000000000000000000000 P ea8d771dbb754fa395a9c28a383f0178 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 05:10:47.850857 19676 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ea8d771dbb754fa395a9c28a383f0178 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:10:47.850980 19676 raft_consensus.cc:686] T 00000000000000000000000000000000 P ea8d771dbb754fa395a9c28a383f0178 [term 1 LEADER]: Becoming Leader. State: Replica: ea8d771dbb754fa395a9c28a383f0178, State: Running, Role: LEADER
I20260811 05:10:47.851135 19676 consensus_queue.cc:237] T 00000000000000000000000000000000 P ea8d771dbb754fa395a9c28a383f0178 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea8d771dbb754fa395a9c28a383f0178" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 35153 } }
I20260811 05:10:47.851119 19668 sys_catalog.cc:564] T 00000000000000000000000000000000 P ea8d771dbb754fa395a9c28a383f0178 [sys.catalog]: configured and running, proceeding with master startup.
Aug 11 05:10:47 dist-test-slave-x5fp krb5kdc[19536](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425047, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
I20260811 05:10:47.852463 19681 sys_catalog.cc:455] T 00000000000000000000000000000000 P ea8d771dbb754fa395a9c28a383f0178 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ea8d771dbb754fa395a9c28a383f0178" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea8d771dbb754fa395a9c28a383f0178" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 35153 } } }
I20260811 05:10:47.852543 19681 sys_catalog.cc:458] T 00000000000000000000000000000000 P ea8d771dbb754fa395a9c28a383f0178 [sys.catalog]: This master's current role is: LEADER
I20260811 05:10:47.852840 19683 sys_catalog.cc:455] T 00000000000000000000000000000000 P ea8d771dbb754fa395a9c28a383f0178 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ea8d771dbb754fa395a9c28a383f0178. Latest consensus state: current_term: 1 leader_uuid: "ea8d771dbb754fa395a9c28a383f0178" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea8d771dbb754fa395a9c28a383f0178" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 35153 } } }
I20260811 05:10:47.853179 19683 sys_catalog.cc:458] T 00000000000000000000000000000000 P ea8d771dbb754fa395a9c28a383f0178 [sys.catalog]: This master's current role is: LEADER
W20260811 05:10:47.853538 19703 catalog_manager.cc:1558] T 00000000000000000000000000000000 P ea8d771dbb754fa395a9c28a383f0178: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 05:10:47.853611 19703 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 05:10:47.853709 19704 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:10:47.853868 19704 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:10:47.855340 19704 catalog_manager.cc:1347] Generated new cluster ID: a9cf77d6ad6b4c549accd9844fb2dcab
I20260811 05:10:47.855394 19704 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:10:47.858089 19671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:47.845487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32858 (local address 127.26.191.254:35153)
0811 05:10:47.845706 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0811 05:10:47.845717 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 05:10:47.845762 (+ 45us) server_negotiation.cc:407] Connection header received
0811 05:10:47.846413 (+ 651us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:10:47.846423 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:10:47.846486 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:10:47.846643 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:10:47.847445 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:47.848382 (+ 937us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:47.849237 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:47.849768 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:47.849887 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:47.852951 (+ 3064us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:10:47.852955 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:10:47.852956 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:10:47.852970 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:10:47.854925 (+ 1955us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:10:47.856789 (+ 1864us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:10:47.856793 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:10:47.856793 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:10:47.856909 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:10:47.857150 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:10:47.857151 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:10:47.857151 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:10:47.857447 (+ 296us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:10:47.857591 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0811 05:10:47.857743 (+ 152us) server_negotiation.cc:299] Negotiation successful
0811 05:10:47.857881 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":94,"threads_started":1}
I20260811 05:10:47.884496 19704 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:10:47.885130 19704 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:10:47.888868 19704 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ea8d771dbb754fa395a9c28a383f0178: Generated new TSK 0
I20260811 05:10:47.889115 19704 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.191.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.191.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.191.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.193.keytab.
Entry for principal kudu/127.26.191.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.193.keytab.
I20260811 05:10:47.931964 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.191.193:0
--local_ip_for_outbound_sockets=127.26.191.193
--webserver_interface=127.26.191.193
--webserver_port=0
--tserver_master_addrs=127.26.191.254:35153
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.193.keytab
--principal=kudu/127.26.191.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:36843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:10:48.027978 19713 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:10:48.028220 19713 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:10:48.028247 19713 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:10:48.029498 19713 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:10:48.029551 19713 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:10:48.029578 19713 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.191.193
I20260811 05:10:48.031051 19713 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:36843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.193.keytab
--principal=kudu/127.26.191.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.191.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.191.193
--webserver_port=0
--tserver_master_addrs=127.26.191.254:35153
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19713
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.191.193
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:10:48.031288 19713 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:10:48.031494 19713 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:10:48.036691 19724 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:10:48.036831 19721 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:10:48.036828 19722 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:10:48.037067 19713 server_base.cc:1034] running on GCE node
I20260811 05:10:48.037333 19713 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:10:48.037613 19713 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:10:48.038795 19713 hybrid_clock.cc:648] HybridClock initialized: now 1786425048038783 us; error 35 us; skew 500 ppm
Aug 11 05:10:48 dist-test-slave-x5fp krb5kdc[19536](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425048, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:10:48.041780 19713 init.cc:377] Logged in from keytab as kudu/127.26.191.193@KRBTEST.COM (short username kudu)
I20260811 05:10:48.042367 19713 webserver.cc:460] Webserver started at http://127.26.191.193:44643/ using document root <none> and password file <none>
I20260811 05:10:48.042647 19713 fs_manager.cc:359] Metadata directory not provided
I20260811 05:10:48.042726 19713 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:10:48.042902 19713 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:10:48.044118 19713 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-0/data/instance:
uuid: "a0916e4208f14bd8a51a53080d28caba"
format_stamp: "Formatted at 2026-08-11 05:10:48 on dist-test-slave-x5fp"
server_key: "c02dbf53b00f159dc70028e7b3b48d2c"
server_key_iv: "e89fd6caa536e0ef2d903330b9dd1ae2"
server_key_version: "encryptionkey@0"
I20260811 05:10:48.044510 19713 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-0/wal/instance:
uuid: "a0916e4208f14bd8a51a53080d28caba"
format_stamp: "Formatted at 2026-08-11 05:10:48 on dist-test-slave-x5fp"
server_key: "c02dbf53b00f159dc70028e7b3b48d2c"
server_key_iv: "e89fd6caa536e0ef2d903330b9dd1ae2"
server_key_version: "encryptionkey@0"
I20260811 05:10:48.046144 19713 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:10:48.047053 19740 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:10:48.047375 19713 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:10:48.047506 19713 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-0/wal
uuid: "a0916e4208f14bd8a51a53080d28caba"
format_stamp: "Formatted at 2026-08-11 05:10:48 on dist-test-slave-x5fp"
server_key: "c02dbf53b00f159dc70028e7b3b48d2c"
server_key_iv: "e89fd6caa536e0ef2d903330b9dd1ae2"
server_key_version: "encryptionkey@0"
I20260811 05:10:48.047601 19713 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:10:48.079469 19713 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:10:48.082418 19713 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:10:48.082628 19713 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:10:48.082917 19713 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:10:48.083272 19713 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:10:48.083333 19713 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:10:48.083376 19713 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:10:48.083406 19713 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:10:48.089983 19713 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.193:36645
I20260811 05:10:48.090049 19939 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.193:36645 every 8 connection(s)
I20260811 05:10:48.090421 19713 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-0/data/info.pb
Aug 11 05:10:48 dist-test-slave-x5fp krb5kdc[19536](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425048, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.193@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
I20260811 05:10:48.099812 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 19713
I20260811 05:10:48.099939 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-0/wal/instance
I20260811 05:10:48.100185 27391 external_mini_cluster.cc:1428] Setting key ea0795799a253fb7ed2a02cd999ea706
I20260811 05:10:48.102257 19671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:48.091279 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.193:49005 (local address 127.26.191.254:35153)
0811 05:10:48.091417 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0811 05:10:48.091420 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:10:48.091609 (+ 189us) server_negotiation.cc:407] Connection header received
0811 05:10:48.092286 (+ 677us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:10:48.092288 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:10:48.092303 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:10:48.092366 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:10:48.093520 (+ 1154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:48.094112 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:48.095286 (+ 1174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:48.095533 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:48.095631 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:48.098356 (+ 2725us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:10:48.098357 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:10:48.098357 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:10:48.098365 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:10:48.100357 (+ 1992us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:10:48.100940 (+ 583us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:10:48.100941 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:10:48.100942 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:10:48.101019 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:10:48.101407 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:10:48.101408 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:10:48.101409 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:10:48.101578 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:10:48.101654 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 05:10:48.101984 (+ 330us) server_negotiation.cc:299] Negotiation successful
0811 05:10:48.102104 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101}
I20260811 05:10:48.102280 19942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:48.091198 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:35153 (local address 127.26.191.193:49005)
0811 05:10:48.091450 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:48.091503 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 05:10:48.092100 (+ 597us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:10:48.092467 (+ 367us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:10:48.092470 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:10:48.093167 (+ 697us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:10:48.093401 (+ 234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:10:48.093407 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:10:48.094228 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:10:48.094229 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:10:48.095157 (+ 928us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:10:48.095161 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:10:48.095665 (+ 504us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:10:48.095668 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:10:48.095820 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:48.096455 (+ 635us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:10:48.096465 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:10:48.098225 (+ 1760us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:10:48.100451 (+ 2226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:10:48.100460 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:10:48.100463 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:10:48.100830 (+ 367us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:10:48.101121 (+ 291us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:10:48.101123 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:10:48.101123 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:10:48.101311 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:10:48.101657 (+ 346us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:10:48.101664 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:10:48.101820 (+ 156us) client_negotiation.cc:769] Sending connection context
0811 05:10:48.101917 (+ 97us) client_negotiation.cc:240] Negotiation successful
0811 05:10:48.102068 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":87,"threads_started":1}
I20260811 05:10:48.102900 19940 heartbeater.cc:347] Connected to a master server at 127.26.191.254:35153
I20260811 05:10:48.103037 19940 heartbeater.cc:464] Registering TS with master...
I20260811 05:10:48.103252 19940 heartbeater.cc:511] Master 127.26.191.254:35153 requested a full tablet report, sending...
I20260811 05:10:48.103855 19615 ts_manager.cc:194] Registered new tserver with Master: a0916e4208f14bd8a51a53080d28caba (127.26.191.193:36645)
I20260811 05:10:48.104548 19615 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.191.193@KRBTEST.COM'} at 127.26.191.193:49005
WARNING: no policy specified for kudu/127.26.191.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.191.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.191.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.194.keytab.
Entry for principal kudu/127.26.191.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.194.keytab.
I20260811 05:10:48.129882 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.191.194:0
--local_ip_for_outbound_sockets=127.26.191.194
--webserver_interface=127.26.191.194
--webserver_port=0
--tserver_master_addrs=127.26.191.254:35153
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.194.keytab
--principal=kudu/127.26.191.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:36843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:10:48.221808 19946 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:10:48.222088 19946 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:10:48.222136 19946 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:10:48.223393 19946 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:10:48.223475 19946 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:10:48.223526 19946 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.191.194
I20260811 05:10:48.225142 19946 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:36843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.194.keytab
--principal=kudu/127.26.191.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.191.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.191.194
--webserver_port=0
--tserver_master_addrs=127.26.191.254:35153
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19946
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.191.194
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:10:48.225440 19946 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:10:48.225704 19946 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:10:48.231098 19960 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:10:48.231076 19951 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:10:48.231077 19957 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:10:48.231199 19946 server_base.cc:1034] running on GCE node
I20260811 05:10:48.231545 19946 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:10:48.231815 19946 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:10:48.232946 19946 hybrid_clock.cc:648] HybridClock initialized: now 1786425048232921 us; error 41 us; skew 500 ppm
Aug 11 05:10:48 dist-test-slave-x5fp krb5kdc[19536](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425048, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:10:48.235548 19946 init.cc:377] Logged in from keytab as kudu/127.26.191.194@KRBTEST.COM (short username kudu)
I20260811 05:10:48.236068 19946 webserver.cc:460] Webserver started at http://127.26.191.194:35331/ using document root <none> and password file <none>
I20260811 05:10:48.236310 19946 fs_manager.cc:359] Metadata directory not provided
I20260811 05:10:48.236382 19946 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:10:48.236536 19946 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:10:48.237681 19946 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-1/data/instance:
uuid: "6eb1d755e6cb48a7a36212e6dcdf7155"
format_stamp: "Formatted at 2026-08-11 05:10:48 on dist-test-slave-x5fp"
server_key: "5c56ab43652dbb991c79e466e2879dad"
server_key_iv: "71bb3d65dea196d2e7f8a8967e8cfad9"
server_key_version: "encryptionkey@0"
I20260811 05:10:48.238062 19946 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-1/wal/instance:
uuid: "6eb1d755e6cb48a7a36212e6dcdf7155"
format_stamp: "Formatted at 2026-08-11 05:10:48 on dist-test-slave-x5fp"
server_key: "5c56ab43652dbb991c79e466e2879dad"
server_key_iv: "71bb3d65dea196d2e7f8a8967e8cfad9"
server_key_version: "encryptionkey@0"
I20260811 05:10:48.239435 19946 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 05:10:48.240269 19971 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:10:48.240473 19946 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:10:48.240579 19946 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-1/wal
uuid: "6eb1d755e6cb48a7a36212e6dcdf7155"
format_stamp: "Formatted at 2026-08-11 05:10:48 on dist-test-slave-x5fp"
server_key: "5c56ab43652dbb991c79e466e2879dad"
server_key_iv: "71bb3d65dea196d2e7f8a8967e8cfad9"
server_key_version: "encryptionkey@0"
I20260811 05:10:48.240671 19946 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:10:48.269070 19946 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:10:48.271910 19946 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:10:48.272094 19946 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:10:48.272397 19946 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:10:48.272855 19946 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:10:48.272899 19946 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:10:48.272944 19946 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:10:48.272974 19946 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:10:48.279759 19946 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.194:38813
I20260811 05:10:48.279795 20169 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.194:38813 every 8 connection(s)
I20260811 05:10:48.280182 19946 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-1/data/info.pb
I20260811 05:10:48.286726 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 19946
I20260811 05:10:48.286844 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-1/wal/instance
I20260811 05:10:48.287056 27391 external_mini_cluster.cc:1428] Setting key 767c81694f0791b33653ce4cc8adb787
Aug 11 05:10:48 dist-test-slave-x5fp krb5kdc[19536](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425048, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.194@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
I20260811 05:10:48.291702 19671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:48.281189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.194:55897 (local address 127.26.191.254:35153)
0811 05:10:48.281295 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0811 05:10:48.281298 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:10:48.281483 (+ 185us) server_negotiation.cc:407] Connection header received
0811 05:10:48.282072 (+ 589us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:10:48.282074 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:10:48.282090 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:10:48.282157 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:10:48.283233 (+ 1076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:48.283769 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:48.284932 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:48.285155 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:48.285260 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:48.287917 (+ 2657us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:10:48.287919 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:10:48.287919 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:10:48.287929 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:10:48.289838 (+ 1909us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:10:48.290396 (+ 558us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:10:48.290397 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:10:48.290397 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:10:48.290474 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:10:48.290823 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:10:48.290824 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:10:48.290825 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:10:48.290961 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:10:48.291032 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 05:10:48.291408 (+ 376us) server_negotiation.cc:299] Negotiation successful
0811 05:10:48.291547 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260811 05:10:48.291746 20172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:48.281083 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:35153 (local address 127.26.191.194:55897)
0811 05:10:48.281333 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:48.281384 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0811 05:10:48.281942 (+ 558us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:10:48.282242 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:10:48.282246 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:10:48.282881 (+ 635us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:10:48.283116 (+ 235us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:10:48.283121 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:10:48.283899 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:10:48.283900 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:10:48.284823 (+ 923us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:10:48.284826 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:10:48.285273 (+ 447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:10:48.285274 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:10:48.285411 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:48.286031 (+ 620us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:10:48.286040 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:10:48.287813 (+ 1773us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:10:48.289939 (+ 2126us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:10:48.289949 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:10:48.289951 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:10:48.290297 (+ 346us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:10:48.290553 (+ 256us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:10:48.290554 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:10:48.290554 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:10:48.290707 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:10:48.291042 (+ 335us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:10:48.291049 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:10:48.291239 (+ 190us) client_negotiation.cc:769] Sending connection context
0811 05:10:48.291368 (+ 129us) client_negotiation.cc:240] Negotiation successful
0811 05:10:48.291535 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":112,"threads_started":1}
I20260811 05:10:48.292357 20170 heartbeater.cc:347] Connected to a master server at 127.26.191.254:35153
I20260811 05:10:48.292493 20170 heartbeater.cc:464] Registering TS with master...
I20260811 05:10:48.292694 20170 heartbeater.cc:511] Master 127.26.191.254:35153 requested a full tablet report, sending...
I20260811 05:10:48.293248 19615 ts_manager.cc:194] Registered new tserver with Master: 6eb1d755e6cb48a7a36212e6dcdf7155 (127.26.191.194:38813)
I20260811 05:10:48.293860 19615 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.191.194@KRBTEST.COM'} at 127.26.191.194:55897
WARNING: no policy specified for kudu/127.26.191.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.191.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.191.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.195.keytab.
Entry for principal kudu/127.26.191.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.195.keytab.
I20260811 05:10:48.320627 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.191.195:0
--local_ip_for_outbound_sockets=127.26.191.195
--webserver_interface=127.26.191.195
--webserver_port=0
--tserver_master_addrs=127.26.191.254:35153
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.195.keytab
--principal=kudu/127.26.191.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:36843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:10:48.407512 20177 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:10:48.407728 20177 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:10:48.407759 20177 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:10:48.409004 20177 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:10:48.409049 20177 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:10:48.409076 20177 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.191.195
I20260811 05:10:48.410586 20177 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:36843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.195.keytab
--principal=kudu/127.26.191.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.191.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.191.195
--webserver_port=0
--tserver_master_addrs=127.26.191.254:35153
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20177
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.191.195
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:10:48.410828 20177 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:10:48.411074 20177 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:10:48.416333 20185 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:10:48.416378 20189 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:10:48.416333 20183 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:10:48.416603 20177 server_base.cc:1034] running on GCE node
I20260811 05:10:48.416935 20177 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:10:48.417230 20177 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:10:48.418396 20177 hybrid_clock.cc:648] HybridClock initialized: now 1786425048418370 us; error 37 us; skew 500 ppm
Aug 11 05:10:48 dist-test-slave-x5fp krb5kdc[19536](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425048, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:10:48.421245 20177 init.cc:377] Logged in from keytab as kudu/127.26.191.195@KRBTEST.COM (short username kudu)
I20260811 05:10:48.421665 20177 webserver.cc:460] Webserver started at http://127.26.191.195:35075/ using document root <none> and password file <none>
I20260811 05:10:48.421862 20177 fs_manager.cc:359] Metadata directory not provided
I20260811 05:10:48.421908 20177 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:10:48.422016 20177 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:10:48.423106 20177 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-2/data/instance:
uuid: "b9d8742784a64a76ad99371c0f72da2c"
format_stamp: "Formatted at 2026-08-11 05:10:48 on dist-test-slave-x5fp"
server_key: "2bba353c97da7dc11dc022b8833b0c22"
server_key_iv: "552dc03385f07064afd938f5ff593dc3"
server_key_version: "encryptionkey@0"
I20260811 05:10:48.423449 20177 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-2/wal/instance:
uuid: "b9d8742784a64a76ad99371c0f72da2c"
format_stamp: "Formatted at 2026-08-11 05:10:48 on dist-test-slave-x5fp"
server_key: "2bba353c97da7dc11dc022b8833b0c22"
server_key_iv: "552dc03385f07064afd938f5ff593dc3"
server_key_version: "encryptionkey@0"
I20260811 05:10:48.425021 20177 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 05:10:48.425933 20197 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:10:48.426170 20177 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:10:48.426267 20177 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-2/wal
uuid: "b9d8742784a64a76ad99371c0f72da2c"
format_stamp: "Formatted at 2026-08-11 05:10:48 on dist-test-slave-x5fp"
server_key: "2bba353c97da7dc11dc022b8833b0c22"
server_key_iv: "552dc03385f07064afd938f5ff593dc3"
server_key_version: "encryptionkey@0"
I20260811 05:10:48.426327 20177 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:10:48.435509 20177 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:10:48.437871 20177 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:10:48.437986 20177 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:10:48.438179 20177 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:10:48.438443 20177 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:10:48.438475 20177 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:10:48.438498 20177 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:10:48.438511 20177 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:10:48.444586 20177 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.195:37069
I20260811 05:10:48.444661 20389 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.195:37069 every 8 connection(s)
I20260811 05:10:48.445035 20177 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-2/data/info.pb
I20260811 05:10:48.446837 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 20177
I20260811 05:10:48.446946 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-2/wal/instance
I20260811 05:10:48.447116 27391 external_mini_cluster.cc:1428] Setting key 01901f16bdf057eb37ea0892a9112608
Aug 11 05:10:48 dist-test-slave-x5fp krb5kdc[19536](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425048, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.195@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
I20260811 05:10:48.455031 19671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:48.445828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.195:48951 (local address 127.26.191.254:35153)
0811 05:10:48.445895 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0811 05:10:48.445897 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:10:48.446114 (+ 217us) server_negotiation.cc:407] Connection header received
0811 05:10:48.446600 (+ 486us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:10:48.446601 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:10:48.446612 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:10:48.446695 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:10:48.447916 (+ 1221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:48.448535 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:48.449568 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:48.449754 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:48.449809 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:48.452219 (+ 2410us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:10:48.452220 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:10:48.452221 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:10:48.452227 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:10:48.453780 (+ 1553us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:10:48.454164 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:10:48.454164 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:10:48.454164 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:10:48.454217 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:10:48.454454 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:10:48.454454 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:10:48.454455 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:10:48.454558 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:10:48.454608 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 05:10:48.454885 (+ 277us) server_negotiation.cc:299] Negotiation successful
0811 05:10:48.454961 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260811 05:10:48.455117 20393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:48.445808 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:35153 (local address 127.26.191.195:48951)
0811 05:10:48.445990 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:48.446029 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 05:10:48.446517 (+ 488us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:10:48.446749 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:10:48.446752 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:10:48.447538 (+ 786us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:10:48.447833 (+ 295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:10:48.447840 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:10:48.448617 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:10:48.448617 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:10:48.449493 (+ 876us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:10:48.449496 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:10:48.449835 (+ 339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:10:48.449836 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:10:48.449951 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:48.450475 (+ 524us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:10:48.450484 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:10:48.452135 (+ 1651us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:10:48.453863 (+ 1728us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:10:48.453869 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:10:48.453872 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:10:48.454093 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:10:48.454291 (+ 198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:10:48.454291 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:10:48.454292 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:10:48.454399 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:10:48.454613 (+ 214us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:10:48.454617 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:10:48.454733 (+ 116us) client_negotiation.cc:769] Sending connection context
0811 05:10:48.454822 (+ 89us) client_negotiation.cc:240] Negotiation successful
0811 05:10:48.454949 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":99,"threads_started":1}
I20260811 05:10:48.455768 20391 heartbeater.cc:347] Connected to a master server at 127.26.191.254:35153
I20260811 05:10:48.455868 20391 heartbeater.cc:464] Registering TS with master...
I20260811 05:10:48.456079 20391 heartbeater.cc:511] Master 127.26.191.254:35153 requested a full tablet report, sending...
I20260811 05:10:48.456513 19615 ts_manager.cc:194] Registered new tserver with Master: b9d8742784a64a76ad99371c0f72da2c (127.26.191.195:37069)
I20260811 05:10:48.456976 19615 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.191.195@KRBTEST.COM'} at 127.26.191.195:48951
I20260811 05:10:48.459264 27391 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 05:10:48.467118 19671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:48.460637 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32868 (local address 127.26.191.254:35153)
0811 05:10:48.460820 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0811 05:10:48.460822 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:10:48.460924 (+ 102us) server_negotiation.cc:407] Connection header received
0811 05:10:48.461008 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:10:48.461009 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:10:48.461019 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:10:48.461094 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:10:48.461684 (+ 590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:48.462165 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:48.462924 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:48.463125 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:48.463207 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:48.464491 (+ 1284us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:10:48.464493 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:10:48.464493 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:10:48.464500 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:10:48.465822 (+ 1322us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:10:48.466230 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:10:48.466231 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:10:48.466232 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:10:48.466309 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:10:48.466523 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:10:48.466524 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:10:48.466524 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:10:48.466690 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:10:48.466809 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0811 05:10:48.466921 (+ 112us) server_negotiation.cc:299] Negotiation successful
0811 05:10:48.467010 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132}
I20260811 05:10:48.469003 19615 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:32868:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 05:10:48.470639 19615 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 05:10:48.477675 20409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:48.473500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54682 (local address 127.26.191.195:37069)
0811 05:10:48.473707 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0811 05:10:48.473713 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 05:10:48.473989 (+ 276us) server_negotiation.cc:407] Connection header received
0811 05:10:48.474034 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:10:48.474037 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:10:48.474053 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:10:48.474134 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:10:48.474493 (+ 359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:48.475553 (+ 1060us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:48.476679 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:48.477232 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:48.477323 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:48.477387 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 05:10:48.477542 (+ 155us) server_negotiation.cc:299] Negotiation successful
0811 05:10:48.477582 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":159,"thread_start_us":95,"threads_started":1}
I20260811 05:10:48.477664 20407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:48.473413 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.195:37069 (local address 127.0.0.1:54682)
0811 05:10:48.473769 (+ 356us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:48.473816 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 05:10:48.473897 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:10:48.474310 (+ 413us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:10:48.474310 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:10:48.474312 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:10:48.474353 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:10:48.474354 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:10:48.475665 (+ 1311us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:10:48.475666 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:10:48.476583 (+ 917us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:10:48.476585 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:10:48.477332 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:10:48.477334 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:10:48.477429 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:48.477441 (+ 12us) client_negotiation.cc:769] Sending connection context
0811 05:10:48.477526 (+ 85us) client_negotiation.cc:240] Negotiation successful
0811 05:10:48.477582 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":327,"mutex_wait_us":2,"thread_start_us":68,"threads_started":1}
I20260811 05:10:48.477944 20412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:48.473435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.193:36645 (local address 127.0.0.1:42888)
0811 05:10:48.473855 (+ 420us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:48.473864 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 05:10:48.473911 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:10:48.474150 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:10:48.474153 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:10:48.474155 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:10:48.474238 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:10:48.474240 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:10:48.475534 (+ 1294us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:10:48.475535 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:10:48.476630 (+ 1095us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:10:48.476632 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:10:48.477677 (+ 1045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:10:48.477677 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:10:48.477752 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:48.477759 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 05:10:48.477820 (+ 61us) client_negotiation.cc:240] Negotiation successful
0811 05:10:48.477858 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":403,"mutex_wait_us":10,"thread_start_us":88,"threads_started":1}
I20260811 05:10:48.478055 20413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:48.473928 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55514 (local address 127.26.191.194:38813)
0811 05:10:48.474120 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0811 05:10:48.474124 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:10:48.474134 (+ 10us) server_negotiation.cc:407] Connection header received
0811 05:10:48.474171 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:10:48.474173 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:10:48.474188 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:10:48.474282 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:10:48.474462 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:48.475164 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:48.476762 (+ 1598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:48.477504 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:48.477581 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:48.477635 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 05:10:48.477910 (+ 275us) server_negotiation.cc:299] Negotiation successful
0811 05:10:48.477958 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":160,"thread_start_us":78,"threads_started":1}
I20260811 05:10:48.478173 20408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:48.473631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.194:38813 (local address 127.0.0.1:55514)
0811 05:10:48.473937 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:48.473951 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 05:10:48.474012 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:10:48.474366 (+ 354us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:10:48.474366 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:10:48.474368 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:10:48.474403 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:10:48.474405 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:10:48.475284 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:10:48.475286 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:10:48.476623 (+ 1337us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:10:48.476626 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:10:48.477674 (+ 1048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:10:48.477676 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:10:48.477752 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:48.477759 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 05:10:48.477813 (+ 54us) client_negotiation.cc:240] Negotiation successful
0811 05:10:48.477860 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":284,"mutex_wait_us":5,"thread_start_us":69,"threads_started":1}
I20260811 05:10:48.478420 20410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:48.473560 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42888 (local address 127.26.191.193:36645)
0811 05:10:48.473804 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0811 05:10:48.473808 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:10:48.473987 (+ 179us) server_negotiation.cc:407] Connection header received
0811 05:10:48.474037 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:10:48.474039 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:10:48.474053 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:10:48.474207 (+ 154us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:10:48.474290 (+ 83us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:48.475428 (+ 1138us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:48.476780 (+ 1352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:48.477504 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:48.477581 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:48.477635 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 05:10:48.478273 (+ 638us) server_negotiation.cc:299] Negotiation successful
0811 05:10:48.478315 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":203,"thread_start_us":134,"threads_started":1}
I20260811 05:10:48.478878 20272 tablet_service.cc:1467] Processing CreateTablet for tablet 1304279a21294224b581d62c9dd4e2d6 (DEFAULT_TABLE table=test-table [id=e391ca4624964ab88e8d54acc4ce6567]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:10:48.479054 20053 tablet_service.cc:1467] Processing CreateTablet for tablet 1304279a21294224b581d62c9dd4e2d6 (DEFAULT_TABLE table=test-table [id=e391ca4624964ab88e8d54acc4ce6567]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:10:48.479054 19831 tablet_service.cc:1467] Processing CreateTablet for tablet 1304279a21294224b581d62c9dd4e2d6 (DEFAULT_TABLE table=test-table [id=e391ca4624964ab88e8d54acc4ce6567]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:10:48.479189 20272 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1304279a21294224b581d62c9dd4e2d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:10:48.479390 19831 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1304279a21294224b581d62c9dd4e2d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:10:48.479390 20053 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1304279a21294224b581d62c9dd4e2d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:10:48.481871 20414 tablet_bootstrap.cc:492] T 1304279a21294224b581d62c9dd4e2d6 P b9d8742784a64a76ad99371c0f72da2c: Bootstrap starting.
I20260811 05:10:48.482419 20414 tablet_bootstrap.cc:654] T 1304279a21294224b581d62c9dd4e2d6 P b9d8742784a64a76ad99371c0f72da2c: Neither blocks nor log segments found. Creating new log.
I20260811 05:10:48.482825 20418 tablet_bootstrap.cc:492] T 1304279a21294224b581d62c9dd4e2d6 P a0916e4208f14bd8a51a53080d28caba: Bootstrap starting.
I20260811 05:10:48.483098 20414 log.cc:824] T 1304279a21294224b581d62c9dd4e2d6 P b9d8742784a64a76ad99371c0f72da2c: Log is configured to *not* fsync() on all Append() calls
I20260811 05:10:48.483587 20418 tablet_bootstrap.cc:654] T 1304279a21294224b581d62c9dd4e2d6 P a0916e4208f14bd8a51a53080d28caba: Neither blocks nor log segments found. Creating new log.
I20260811 05:10:48.483649 20419 tablet_bootstrap.cc:492] T 1304279a21294224b581d62c9dd4e2d6 P 6eb1d755e6cb48a7a36212e6dcdf7155: Bootstrap starting.
I20260811 05:10:48.484234 20419 tablet_bootstrap.cc:654] T 1304279a21294224b581d62c9dd4e2d6 P 6eb1d755e6cb48a7a36212e6dcdf7155: Neither blocks nor log segments found. Creating new log.
I20260811 05:10:48.484236 20418 log.cc:824] T 1304279a21294224b581d62c9dd4e2d6 P a0916e4208f14bd8a51a53080d28caba: Log is configured to *not* fsync() on all Append() calls
I20260811 05:10:48.484290 20414 tablet_bootstrap.cc:492] T 1304279a21294224b581d62c9dd4e2d6 P b9d8742784a64a76ad99371c0f72da2c: No bootstrap required, opened a new log
I20260811 05:10:48.484351 20414 ts_tablet_manager.cc:1397] T 1304279a21294224b581d62c9dd4e2d6 P b9d8742784a64a76ad99371c0f72da2c: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 05:10:48.484900 20419 log.cc:824] T 1304279a21294224b581d62c9dd4e2d6 P 6eb1d755e6cb48a7a36212e6dcdf7155: Log is configured to *not* fsync() on all Append() calls
I20260811 05:10:48.485106 20418 tablet_bootstrap.cc:492] T 1304279a21294224b581d62c9dd4e2d6 P a0916e4208f14bd8a51a53080d28caba: No bootstrap required, opened a new log
I20260811 05:10:48.485183 20418 ts_tablet_manager.cc:1397] T 1304279a21294224b581d62c9dd4e2d6 P a0916e4208f14bd8a51a53080d28caba: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 05:10:48.485646 20419 tablet_bootstrap.cc:492] T 1304279a21294224b581d62c9dd4e2d6 P 6eb1d755e6cb48a7a36212e6dcdf7155: No bootstrap required, opened a new log
I20260811 05:10:48.485738 20419 ts_tablet_manager.cc:1397] T 1304279a21294224b581d62c9dd4e2d6 P 6eb1d755e6cb48a7a36212e6dcdf7155: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260811 05:10:48.486361 20414 raft_consensus.cc:348] T 1304279a21294224b581d62c9dd4e2d6 P b9d8742784a64a76ad99371c0f72da2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d8742784a64a76ad99371c0f72da2c" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 37069 } } peers { permanent_uuid: "6eb1d755e6cb48a7a36212e6dcdf7155" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 38813 } } peers { permanent_uuid: "a0916e4208f14bd8a51a53080d28caba" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 36645 } }
I20260811 05:10:48.486562 20414 raft_consensus.cc:374] T 1304279a21294224b581d62c9dd4e2d6 P b9d8742784a64a76ad99371c0f72da2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:10:48.486600 20414 raft_consensus.cc:729] T 1304279a21294224b581d62c9dd4e2d6 P b9d8742784a64a76ad99371c0f72da2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9d8742784a64a76ad99371c0f72da2c, State: Initialized, Role: FOLLOWER
I20260811 05:10:48.486732 20414 consensus_queue.cc:260] T 1304279a21294224b581d62c9dd4e2d6 P b9d8742784a64a76ad99371c0f72da2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d8742784a64a76ad99371c0f72da2c" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 37069 } } peers { permanent_uuid: "6eb1d755e6cb48a7a36212e6dcdf7155" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 38813 } } peers { permanent_uuid: "a0916e4208f14bd8a51a53080d28caba" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 36645 } }
I20260811 05:10:48.487190 20414 ts_tablet_manager.cc:1428] T 1304279a21294224b581d62c9dd4e2d6 P b9d8742784a64a76ad99371c0f72da2c: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 05:10:48.487351 20391 heartbeater.cc:503] Master 127.26.191.254:35153 was elected leader, sending a full tablet report...
I20260811 05:10:48.487246 20418 raft_consensus.cc:348] T 1304279a21294224b581d62c9dd4e2d6 P a0916e4208f14bd8a51a53080d28caba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d8742784a64a76ad99371c0f72da2c" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 37069 } } peers { permanent_uuid: "6eb1d755e6cb48a7a36212e6dcdf7155" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 38813 } } peers { permanent_uuid: "a0916e4208f14bd8a51a53080d28caba" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 36645 } }
I20260811 05:10:48.487432 20418 raft_consensus.cc:374] T 1304279a21294224b581d62c9dd4e2d6 P a0916e4208f14bd8a51a53080d28caba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:10:48.487459 20418 raft_consensus.cc:729] T 1304279a21294224b581d62c9dd4e2d6 P a0916e4208f14bd8a51a53080d28caba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0916e4208f14bd8a51a53080d28caba, State: Initialized, Role: FOLLOWER
I20260811 05:10:48.487423 20419 raft_consensus.cc:348] T 1304279a21294224b581d62c9dd4e2d6 P 6eb1d755e6cb48a7a36212e6dcdf7155 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d8742784a64a76ad99371c0f72da2c" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 37069 } } peers { permanent_uuid: "6eb1d755e6cb48a7a36212e6dcdf7155" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 38813 } } peers { permanent_uuid: "a0916e4208f14bd8a51a53080d28caba" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 36645 } }
I20260811 05:10:48.487587 20419 raft_consensus.cc:374] T 1304279a21294224b581d62c9dd4e2d6 P 6eb1d755e6cb48a7a36212e6dcdf7155 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:10:48.487576 20418 consensus_queue.cc:260] T 1304279a21294224b581d62c9dd4e2d6 P a0916e4208f14bd8a51a53080d28caba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d8742784a64a76ad99371c0f72da2c" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 37069 } } peers { permanent_uuid: "6eb1d755e6cb48a7a36212e6dcdf7155" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 38813 } } peers { permanent_uuid: "a0916e4208f14bd8a51a53080d28caba" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 36645 } }
I20260811 05:10:48.487630 20419 raft_consensus.cc:729] T 1304279a21294224b581d62c9dd4e2d6 P 6eb1d755e6cb48a7a36212e6dcdf7155 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6eb1d755e6cb48a7a36212e6dcdf7155, State: Initialized, Role: FOLLOWER
I20260811 05:10:48.487778 20419 consensus_queue.cc:260] T 1304279a21294224b581d62c9dd4e2d6 P 6eb1d755e6cb48a7a36212e6dcdf7155 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d8742784a64a76ad99371c0f72da2c" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 37069 } } peers { permanent_uuid: "6eb1d755e6cb48a7a36212e6dcdf7155" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 38813 } } peers { permanent_uuid: "a0916e4208f14bd8a51a53080d28caba" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 36645 } }
I20260811 05:10:48.487854 20418 ts_tablet_manager.cc:1428] T 1304279a21294224b581d62c9dd4e2d6 P a0916e4208f14bd8a51a53080d28caba: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 05:10:48.487998 19940 heartbeater.cc:503] Master 127.26.191.254:35153 was elected leader, sending a full tablet report...
I20260811 05:10:48.488072 20419 ts_tablet_manager.cc:1428] T 1304279a21294224b581d62c9dd4e2d6 P 6eb1d755e6cb48a7a36212e6dcdf7155: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260811 05:10:48.488215 20170 heartbeater.cc:503] Master 127.26.191.254:35153 was elected leader, sending a full tablet report...
W20260811 05:10:48.530864 20171 tablet.cc:2369] T 1304279a21294224b581d62c9dd4e2d6 P 6eb1d755e6cb48a7a36212e6dcdf7155: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 05:10:48.591341 19941 tablet.cc:2369] T 1304279a21294224b581d62c9dd4e2d6 P a0916e4208f14bd8a51a53080d28caba: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 05:10:48.646610 20426 raft_consensus.cc:482] T 1304279a21294224b581d62c9dd4e2d6 P 6eb1d755e6cb48a7a36212e6dcdf7155 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 05:10:48.646763 20426 raft_consensus.cc:504] T 1304279a21294224b581d62c9dd4e2d6 P 6eb1d755e6cb48a7a36212e6dcdf7155 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d8742784a64a76ad99371c0f72da2c" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 37069 } } peers { permanent_uuid: "6eb1d755e6cb48a7a36212e6dcdf7155" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 38813 } } peers { permanent_uuid: "a0916e4208f14bd8a51a53080d28caba" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 36645 } }
I20260811 05:10:48.647140 20426 leader_election.cc:288] T 1304279a21294224b581d62c9dd4e2d6 P 6eb1d755e6cb48a7a36212e6dcdf7155 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9d8742784a64a76ad99371c0f72da2c (127.26.191.195:37069), a0916e4208f14bd8a51a53080d28caba (127.26.191.193:36645)
I20260811 05:10:48.651724 20172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:48.647393 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.195:37069 (local address 127.26.191.194:57167)
0811 05:10:48.647464 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:48.647477 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 05:10:48.647529 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:10:48.647808 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:10:48.647808 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:10:48.647810 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:10:48.647914 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:10:48.647916 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:10:48.648996 (+ 1080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:10:48.648997 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:10:48.650379 (+ 1382us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:10:48.650383 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:10:48.651357 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:10:48.651358 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:10:48.651461 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:48.651463 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 05:10:48.651539 (+ 76us) client_negotiation.cc:240] Negotiation successful
0811 05:10:48.651594 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":51,"mutex_wait_us":109}
I20260811 05:10:48.651782 20410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:48.647474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.194:55677 (local address 127.26.191.193:36645)
0811 05:10:48.647530 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 05:10:48.647532 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:10:48.647681 (+ 149us) server_negotiation.cc:407] Connection header received
0811 05:10:48.647716 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:10:48.647717 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:10:48.647728 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:10:48.647789 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:10:48.648004 (+ 215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:48.648893 (+ 889us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:48.650517 (+ 1624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:48.651185 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:48.651289 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:48.651299 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 05:10:48.651584 (+ 285us) server_negotiation.cc:299] Negotiation successful
0811 05:10:48.651640 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260811 05:10:48.651810 20428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:48.647407 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.193:36645 (local address 127.26.191.194:55677)
0811 05:10:48.647608 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:48.647616 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 05:10:48.647662 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:10:48.647807 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:10:48.647808 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:10:48.647810 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:10:48.647920 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:10:48.647922 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:10:48.648996 (+ 1074us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:10:48.648997 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:10:48.650395 (+ 1398us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:10:48.650396 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:10:48.651360 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:10:48.651360 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:10:48.651458 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:48.651463 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 05:10:48.651553 (+ 90us) client_negotiation.cc:240] Negotiation successful
0811 05:10:48.651594 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":177,"mutex_wait_us":94,"thread_start_us":134,"threads_started":1}
I20260811 05:10:48.652141 20409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:48.647508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.194:57167 (local address 127.26.191.195:37069)
0811 05:10:48.647613 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0811 05:10:48.647615 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:10:48.647625 (+ 10us) server_negotiation.cc:407] Connection header received
0811 05:10:48.647674 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:10:48.647675 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:10:48.647687 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:10:48.647773 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:10:48.648004 (+ 231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:48.648910 (+ 906us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:48.650493 (+ 1583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:48.651212 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:48.651290 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:48.651299 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 05:10:48.652024 (+ 725us) server_negotiation.cc:299] Negotiation successful
0811 05:10:48.652075 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260811 05:10:48.652494 19861 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1304279a21294224b581d62c9dd4e2d6" candidate_uuid: "6eb1d755e6cb48a7a36212e6dcdf7155" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0916e4208f14bd8a51a53080d28caba" is_pre_election: true
I20260811 05:10:48.652530 20310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1304279a21294224b581d62c9dd4e2d6" candidate_uuid: "6eb1d755e6cb48a7a36212e6dcdf7155" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d8742784a64a76ad99371c0f72da2c" is_pre_election: true
I20260811 05:10:48.652702 20310 raft_consensus.cc:2454] T 1304279a21294224b581d62c9dd4e2d6 P b9d8742784a64a76ad99371c0f72da2c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6eb1d755e6cb48a7a36212e6dcdf7155 in term 0.
I20260811 05:10:48.652711 19861 raft_consensus.cc:2454] T 1304279a21294224b581d62c9dd4e2d6 P a0916e4208f14bd8a51a53080d28caba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6eb1d755e6cb48a7a36212e6dcdf7155 in term 0.
I20260811 05:10:48.652997 19973 leader_election.cc:302] T 1304279a21294224b581d62c9dd4e2d6 P 6eb1d755e6cb48a7a36212e6dcdf7155 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6eb1d755e6cb48a7a36212e6dcdf7155, a0916e4208f14bd8a51a53080d28caba; no voters:
I20260811 05:10:48.653162 20426 raft_consensus.cc:2781] T 1304279a21294224b581d62c9dd4e2d6 P 6eb1d755e6cb48a7a36212e6dcdf7155 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 05:10:48.653237 20426 raft_consensus.cc:482] T 1304279a21294224b581d62c9dd4e2d6 P 6eb1d755e6cb48a7a36212e6dcdf7155 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 05:10:48.653299 20426 raft_consensus.cc:3037] T 1304279a21294224b581d62c9dd4e2d6 P 6eb1d755e6cb48a7a36212e6dcdf7155 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:10:48.654078 20426 raft_consensus.cc:504] T 1304279a21294224b581d62c9dd4e2d6 P 6eb1d755e6cb48a7a36212e6dcdf7155 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d8742784a64a76ad99371c0f72da2c" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 37069 } } peers { permanent_uuid: "6eb1d755e6cb48a7a36212e6dcdf7155" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 38813 } } peers { permanent_uuid: "a0916e4208f14bd8a51a53080d28caba" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 36645 } }
I20260811 05:10:48.654258 20426 leader_election.cc:288] T 1304279a21294224b581d62c9dd4e2d6 P 6eb1d755e6cb48a7a36212e6dcdf7155 [CANDIDATE]: Term 1 election: Requested vote from peers b9d8742784a64a76ad99371c0f72da2c (127.26.191.195:37069), a0916e4208f14bd8a51a53080d28caba (127.26.191.193:36645)
I20260811 05:10:48.654448 20310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1304279a21294224b581d62c9dd4e2d6" candidate_uuid: "6eb1d755e6cb48a7a36212e6dcdf7155" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d8742784a64a76ad99371c0f72da2c"
I20260811 05:10:48.654469 19861 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1304279a21294224b581d62c9dd4e2d6" candidate_uuid: "6eb1d755e6cb48a7a36212e6dcdf7155" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0916e4208f14bd8a51a53080d28caba"
I20260811 05:10:48.654543 19861 raft_consensus.cc:3037] T 1304279a21294224b581d62c9dd4e2d6 P a0916e4208f14bd8a51a53080d28caba [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:10:48.654541 20310 raft_consensus.cc:3037] T 1304279a21294224b581d62c9dd4e2d6 P b9d8742784a64a76ad99371c0f72da2c [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:10:48.655331 19861 raft_consensus.cc:2454] T 1304279a21294224b581d62c9dd4e2d6 P a0916e4208f14bd8a51a53080d28caba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6eb1d755e6cb48a7a36212e6dcdf7155 in term 1.
I20260811 05:10:48.655378 20310 raft_consensus.cc:2454] T 1304279a21294224b581d62c9dd4e2d6 P b9d8742784a64a76ad99371c0f72da2c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6eb1d755e6cb48a7a36212e6dcdf7155 in term 1.
I20260811 05:10:48.655555 19973 leader_election.cc:302] T 1304279a21294224b581d62c9dd4e2d6 P 6eb1d755e6cb48a7a36212e6dcdf7155 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 6eb1d755e6cb48a7a36212e6dcdf7155, a0916e4208f14bd8a51a53080d28caba, b9d8742784a64a76ad99371c0f72da2c; no voters:
I20260811 05:10:48.655680 20426 raft_consensus.cc:2781] T 1304279a21294224b581d62c9dd4e2d6 P 6eb1d755e6cb48a7a36212e6dcdf7155 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:10:48.655925 20426 raft_consensus.cc:686] T 1304279a21294224b581d62c9dd4e2d6 P 6eb1d755e6cb48a7a36212e6dcdf7155 [term 1 LEADER]: Becoming Leader. State: Replica: 6eb1d755e6cb48a7a36212e6dcdf7155, State: Running, Role: LEADER
I20260811 05:10:48.656060 20426 consensus_queue.cc:237] T 1304279a21294224b581d62c9dd4e2d6 P 6eb1d755e6cb48a7a36212e6dcdf7155 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d8742784a64a76ad99371c0f72da2c" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 37069 } } peers { permanent_uuid: "6eb1d755e6cb48a7a36212e6dcdf7155" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 38813 } } peers { permanent_uuid: "a0916e4208f14bd8a51a53080d28caba" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 36645 } }
I20260811 05:10:48.657109 19614 catalog_manager.cc:5495] T 1304279a21294224b581d62c9dd4e2d6 P 6eb1d755e6cb48a7a36212e6dcdf7155 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6eb1d755e6cb48a7a36212e6dcdf7155 (127.26.191.194). New cstate: current_term: 1 leader_uuid: "6eb1d755e6cb48a7a36212e6dcdf7155" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d8742784a64a76ad99371c0f72da2c" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 37069 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6eb1d755e6cb48a7a36212e6dcdf7155" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 38813 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0916e4208f14bd8a51a53080d28caba" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 36645 } health_report { overall_health: UNKNOWN } } }
W20260811 05:10:48.695690 20392 tablet.cc:2369] T 1304279a21294224b581d62c9dd4e2d6 P b9d8742784a64a76ad99371c0f72da2c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 05:10:48.707087 20413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:48.704563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55530 (local address 127.26.191.194:38813)
0811 05:10:48.704693 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0811 05:10:48.704695 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:10:48.704706 (+ 11us) server_negotiation.cc:407] Connection header received
0811 05:10:48.704766 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:10:48.704767 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:10:48.704789 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:10:48.704890 (+ 101us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:10:48.705013 (+ 123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:48.705538 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:48.706322 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:10:48.706538 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:10:48.706605 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:10:48.706779 (+ 174us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:10:48.706892 (+ 113us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:10:48.706962 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 05:10:48.706998 (+ 36us) server_negotiation.cc:299] Negotiation successful
0811 05:10:48.707021 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100}
I20260811 05:10:48.709244 19861 raft_consensus.cc:1261] T 1304279a21294224b581d62c9dd4e2d6 P a0916e4208f14bd8a51a53080d28caba [term 1 FOLLOWER]: Refusing update from remote peer 6eb1d755e6cb48a7a36212e6dcdf7155: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:10:48.709354 20310 raft_consensus.cc:1261] T 1304279a21294224b581d62c9dd4e2d6 P b9d8742784a64a76ad99371c0f72da2c [term 1 FOLLOWER]: Refusing update from remote peer 6eb1d755e6cb48a7a36212e6dcdf7155: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:10:48.709715 20429 consensus_queue.cc:1035] T 1304279a21294224b581d62c9dd4e2d6 P 6eb1d755e6cb48a7a36212e6dcdf7155 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0916e4208f14bd8a51a53080d28caba" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 36645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:10:48.709910 20426 consensus_queue.cc:1035] T 1304279a21294224b581d62c9dd4e2d6 P 6eb1d755e6cb48a7a36212e6dcdf7155 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d8742784a64a76ad99371c0f72da2c" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 37069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:10:48.713116 20439 mvcc.cc:205] Tried to move back new op lower bound from 7317196999509594112 to 7317196999295873024. Current Snapshot: MvccSnapshot[applied={T|T < 7317196999509594112}]
I20260811 05:10:48.713267 20440 mvcc.cc:205] Tried to move back new op lower bound from 7317196999509594112 to 7317196999295873024. Current Snapshot: MvccSnapshot[applied={T|T < 7317196999509594112}]
I20260811 05:10:48.714617 19615 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:32868:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:10:48.714741 19615 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:32868:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:10:48.715610 19615 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ea8d771dbb754fa395a9c28a383f0178: Sending DeleteTablet for 3 replicas of tablet 1304279a21294224b581d62c9dd4e2d6
I20260811 05:10:48.716053 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 19713
I20260811 05:10:48.716051 19831 tablet_service.cc:1514] Processing DeleteTablet for tablet 1304279a21294224b581d62c9dd4e2d6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:10:48 UTC) from {username='kudu', principal='kudu/127.26.191.254@KRBTEST.COM'} at 127.0.0.1:42888
I20260811 05:10:48.716075 20053 tablet_service.cc:1514] Processing DeleteTablet for tablet 1304279a21294224b581d62c9dd4e2d6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:10:48 UTC) from {username='kudu', principal='kudu/127.26.191.254@KRBTEST.COM'} at 127.0.0.1:55514
I20260811 05:10:48.718954 20272 tablet_service.cc:1514] Processing DeleteTablet for tablet 1304279a21294224b581d62c9dd4e2d6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:10:48 UTC) from {username='kudu', principal='kudu/127.26.191.254@KRBTEST.COM'} at 127.0.0.1:54682
I20260811 05:10:48.728665 20461 tablet_replica.cc:330] T 1304279a21294224b581d62c9dd4e2d6 P b9d8742784a64a76ad99371c0f72da2c: stopping tablet replica
I20260811 05:10:48.728767 20460 tablet_replica.cc:330] T 1304279a21294224b581d62c9dd4e2d6 P 6eb1d755e6cb48a7a36212e6dcdf7155: stopping tablet replica
I20260811 05:10:48.728933 20460 raft_consensus.cc:2229] T 1304279a21294224b581d62c9dd4e2d6 P 6eb1d755e6cb48a7a36212e6dcdf7155 [term 1 LEADER]: Raft consensus shutting down.
I20260811 05:10:48.729077 20460 raft_consensus.cc:2258] T 1304279a21294224b581d62c9dd4e2d6 P 6eb1d755e6cb48a7a36212e6dcdf7155 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:10:48.728968 20461 raft_consensus.cc:2229] T 1304279a21294224b581d62c9dd4e2d6 P b9d8742784a64a76ad99371c0f72da2c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 05:10:48.729409 20461 raft_consensus.cc:2258] T 1304279a21294224b581d62c9dd4e2d6 P b9d8742784a64a76ad99371c0f72da2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:10:48.730161 20460 ts_tablet_manager.cc:1905] T 1304279a21294224b581d62c9dd4e2d6 P 6eb1d755e6cb48a7a36212e6dcdf7155: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 05:10:48.730590 19585 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.191.193:36645 (error 108)
I20260811 05:10:48.731043 20461 ts_tablet_manager.cc:1905] T 1304279a21294224b581d62c9dd4e2d6 P b9d8742784a64a76ad99371c0f72da2c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:10:48.731280 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 19946
I20260811 05:10:48.734125 20412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:48.731429 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.193:36645 (local address 127.0.0.1:42894)
0811 05:10:48.734040 (+ 2611us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:48.734089 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.193:36645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2586}
W20260811 05:10:48.734283 19585 catalog_manager.cc:4584] TS a0916e4208f14bd8a51a53080d28caba (127.26.191.193:36645): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 1304279a21294224b581d62c9dd4e2d6: Network error: Client connection negotiation failed: client connection to 127.26.191.193:36645: connect: Connection refused (error 111)
I20260811 05:10:48.736142 20461 ts_tablet_manager.cc:1918] T 1304279a21294224b581d62c9dd4e2d6 P b9d8742784a64a76ad99371c0f72da2c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 05:10:48.736222 20461 log.cc:1196] T 1304279a21294224b581d62c9dd4e2d6 P b9d8742784a64a76ad99371c0f72da2c: Deleting WAL directory at /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-2/wal/wals/1304279a21294224b581d62c9dd4e2d6
I20260811 05:10:48.736495 20461 ts_tablet_manager.cc:1939] T 1304279a21294224b581d62c9dd4e2d6 P b9d8742784a64a76ad99371c0f72da2c: Deleting consensus metadata
I20260811 05:10:48.737083 19586 catalog_manager.cc:4841] TS b9d8742784a64a76ad99371c0f72da2c (127.26.191.195:37069): tablet 1304279a21294224b581d62c9dd4e2d6 (table test-table [id=e391ca4624964ab88e8d54acc4ce6567]) successfully deleted
I20260811 05:10:48.741931 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 20177
I20260811 05:10:48.742053 20412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:10:48.741897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.194:38813 (local address 127.0.0.1:55534)
0811 05:10:48.741968 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0811 05:10:48.742007 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.194:38813: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260811 05:10:48.751893 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 19559
I20260811 05:11:08.766358 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.254:35153
--webserver_interface=127.26.191.254
--webserver_port=42835
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab
--principal=kudu/127.26.191.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:36843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.191.254:35153
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:11:08.853205 20464 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:11:08.853425 20464 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:11:08.853447 20464 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:11:08.854617 20464 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260811 05:11:08.854660 20464 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260811 05:11:08.854673 20464 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260811 05:11:08.854686 20464 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:11:08.854699 20464 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:11:08.854748 20464 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:11:08.854768 20464 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:11:08.854790 20464 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:11:08.856308 20464 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:36843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.26.191.254:35153
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab
--principal=kudu/127.26.191.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.254:35153
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.191.254
--webserver_port=42835
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20464
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:11:08.856587 20464 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:11:08.856868 20464 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 05:11:08.867650 20464 server_base.cc:1034] running on GCE node
W20260811 05:11:08.867609 20476 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:11:08.867610 20477 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:11:08.867609 20479 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:11:08.868247 20464 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:11:08.868618 20464 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:11:08.869807 20464 hybrid_clock.cc:648] HybridClock initialized: now 1786425068869801 us; error 44 us; skew 500 ppm
Aug 11 05:11:08 dist-test-slave-x5fp krb5kdc[19536](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425068, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:11:08.878072 20464 init.cc:377] Logged in from keytab as kudu/127.26.191.254@KRBTEST.COM (short username kudu)
I20260811 05:11:08.878633 20464 webserver.cc:460] Webserver started at http://127.26.191.254:42835/ using document root <none> and password file <none>
I20260811 05:11:08.878918 20464 fs_manager.cc:359] Metadata directory not provided
I20260811 05:11:08.879014 20464 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:11:08.880513 20464 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 05:11:08.881319 20490 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:11:08.881516 20464 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 05:11:08.881633 20464 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/master-0/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/master-0/wal
uuid: "ea8d771dbb754fa395a9c28a383f0178"
format_stamp: "Formatted at 2026-08-11 05:10:47 on dist-test-slave-x5fp"
server_key: "b4215ce217a7be6d831df908706b72fc"
server_key_iv: "1aedcdb52a6b5d1d6183dbd00bd4fa9e"
server_key_version: "encryptionkey@0"
I20260811 05:11:08.882094 20464 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:11:08.920352 20464 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:11:08.922834 20464 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:11:08.923025 20464 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:11:08.927719 20464 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.254:35153
I20260811 05:11:08.927750 20581 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.254:35153 every 8 connection(s)
I20260811 05:11:08.928175 20464 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
I20260811 05:11:08.929877 20582 sys_catalog.cc:263] Verifying existing consensus state
I20260811 05:11:08.930517 20582 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ea8d771dbb754fa395a9c28a383f0178: Bootstrap starting.
I20260811 05:11:08.933328 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 20464
I20260811 05:11:08.933620 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.191.193:36645
--local_ip_for_outbound_sockets=127.26.191.193
--tserver_master_addrs=127.26.191.254:35153
--webserver_port=44643
--webserver_interface=127.26.191.193
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.193.keytab
--principal=kudu/127.26.191.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:36843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 05:11:08.940171 20582 log.cc:824] T 00000000000000000000000000000000 P ea8d771dbb754fa395a9c28a383f0178: Log is configured to *not* fsync() on all Append() calls
I20260811 05:11:08.942231 20582 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ea8d771dbb754fa395a9c28a383f0178: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 05:11:08.942569 20582 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ea8d771dbb754fa395a9c28a383f0178: Bootstrap complete.
I20260811 05:11:08.945164 20582 raft_consensus.cc:348] T 00000000000000000000000000000000 P ea8d771dbb754fa395a9c28a383f0178 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea8d771dbb754fa395a9c28a383f0178" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 35153 } }
I20260811 05:11:08.945442 20582 raft_consensus.cc:729] T 00000000000000000000000000000000 P ea8d771dbb754fa395a9c28a383f0178 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea8d771dbb754fa395a9c28a383f0178, State: Initialized, Role: FOLLOWER
I20260811 05:11:08.945637 20582 consensus_queue.cc:260] T 00000000000000000000000000000000 P ea8d771dbb754fa395a9c28a383f0178 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea8d771dbb754fa395a9c28a383f0178" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 35153 } }
I20260811 05:11:08.945722 20582 raft_consensus.cc:388] T 00000000000000000000000000000000 P ea8d771dbb754fa395a9c28a383f0178 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:11:08.945812 20582 raft_consensus.cc:482] T 00000000000000000000000000000000 P ea8d771dbb754fa395a9c28a383f0178 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:11:08.945871 20582 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ea8d771dbb754fa395a9c28a383f0178 [term 1 FOLLOWER]: Advancing to term 2
I20260811 05:11:08.946915 20582 raft_consensus.cc:504] T 00000000000000000000000000000000 P ea8d771dbb754fa395a9c28a383f0178 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea8d771dbb754fa395a9c28a383f0178" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 35153 } }
I20260811 05:11:08.947042 20582 leader_election.cc:302] T 00000000000000000000000000000000 P ea8d771dbb754fa395a9c28a383f0178 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ea8d771dbb754fa395a9c28a383f0178; no voters:
I20260811 05:11:08.947292 20582 leader_election.cc:288] T 00000000000000000000000000000000 P ea8d771dbb754fa395a9c28a383f0178 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 05:11:08.947343 20593 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ea8d771dbb754fa395a9c28a383f0178 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 05:11:08.947475 20593 raft_consensus.cc:686] T 00000000000000000000000000000000 P ea8d771dbb754fa395a9c28a383f0178 [term 2 LEADER]: Becoming Leader. State: Replica: ea8d771dbb754fa395a9c28a383f0178, State: Running, Role: LEADER
I20260811 05:11:08.947567 20593 consensus_queue.cc:237] T 00000000000000000000000000000000 P ea8d771dbb754fa395a9c28a383f0178 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea8d771dbb754fa395a9c28a383f0178" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 35153 } }
I20260811 05:11:08.947597 20582 sys_catalog.cc:564] T 00000000000000000000000000000000 P ea8d771dbb754fa395a9c28a383f0178 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:11:08.947888 20593 sys_catalog.cc:455] T 00000000000000000000000000000000 P ea8d771dbb754fa395a9c28a383f0178 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ea8d771dbb754fa395a9c28a383f0178. Latest consensus state: current_term: 2 leader_uuid: "ea8d771dbb754fa395a9c28a383f0178" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea8d771dbb754fa395a9c28a383f0178" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 35153 } } }
I20260811 05:11:08.947957 20593 sys_catalog.cc:458] T 00000000000000000000000000000000 P ea8d771dbb754fa395a9c28a383f0178 [sys.catalog]: This master's current role is: LEADER
I20260811 05:11:08.948158 20594 sys_catalog.cc:455] T 00000000000000000000000000000000 P ea8d771dbb754fa395a9c28a383f0178 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "ea8d771dbb754fa395a9c28a383f0178" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea8d771dbb754fa395a9c28a383f0178" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 35153 } } }
I20260811 05:11:08.948277 20594 sys_catalog.cc:458] T 00000000000000000000000000000000 P ea8d771dbb754fa395a9c28a383f0178 [sys.catalog]: This master's current role is: LEADER
I20260811 05:11:08.948309 20598 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:11:08.949213 20598 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:11:08.949347 20598 catalog_manager.cc:1259] Loaded cluster ID: a9cf77d6ad6b4c549accd9844fb2dcab
I20260811 05:11:08.949399 20598 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:11:08.954093 20598 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:11:08.954351 20598 catalog_manager.cc:5879] T 00000000000000000000000000000000 P ea8d771dbb754fa395a9c28a383f0178: Loaded TSK: 0
I20260811 05:11:08.964653 20598 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ea8d771dbb754fa395a9c28a383f0178: Generated new TSK 1
I20260811 05:11:08.964794 20598 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 05:11:09.027310 20586 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:11:09.027582 20586 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:11:09.027630 20586 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:11:09.028847 20586 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:11:09.028923 20586 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:11:09.028972 20586 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.191.193
I20260811 05:11:09.030550 20586 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:36843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.193.keytab
--principal=kudu/127.26.191.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.191.193:36645
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.191.193
--webserver_port=44643
--tserver_master_addrs=127.26.191.254:35153
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20586
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.191.193
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:11:09.030854 20586 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:11:09.031102 20586 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:11:09.037436 20641 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:11:09.037433 20646 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:11:09.037446 20640 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:11:09.038184 20586 server_base.cc:1034] running on GCE node
I20260811 05:11:09.038498 20586 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:11:09.038767 20586 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:11:09.039980 20586 hybrid_clock.cc:648] HybridClock initialized: now 1786425069039967 us; error 36 us; skew 500 ppm
Aug 11 05:11:09 dist-test-slave-x5fp krb5kdc[19536](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425069, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:11:09.042943 20586 init.cc:377] Logged in from keytab as kudu/127.26.191.193@KRBTEST.COM (short username kudu)
I20260811 05:11:09.043511 20586 webserver.cc:460] Webserver started at http://127.26.191.193:44643/ using document root <none> and password file <none>
I20260811 05:11:09.043819 20586 fs_manager.cc:359] Metadata directory not provided
I20260811 05:11:09.043917 20586 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:11:09.045608 20586 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 05:11:09.046461 20655 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:11:09.046661 20586 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:11:09.046820 20586 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-0/wal
uuid: "a0916e4208f14bd8a51a53080d28caba"
format_stamp: "Formatted at 2026-08-11 05:10:48 on dist-test-slave-x5fp"
server_key: "c02dbf53b00f159dc70028e7b3b48d2c"
server_key_iv: "e89fd6caa536e0ef2d903330b9dd1ae2"
server_key_version: "encryptionkey@0"
I20260811 05:11:09.047238 20586 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:11:09.063822 20586 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:11:09.066298 20586 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:11:09.066493 20586 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:11:09.066774 20586 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:11:09.067381 20670 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 05:11:09.069224 20586 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 05:11:09.069288 20586 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260811 05:11:09.069319 20586 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 05:11:09.070124 20586 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 05:11:09.070176 20586 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260811 05:11:09.070235 20670 tablet_bootstrap.cc:492] T 1304279a21294224b581d62c9dd4e2d6 P a0916e4208f14bd8a51a53080d28caba: Bootstrap starting.
I20260811 05:11:09.079085 20586 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.193:36645
I20260811 05:11:09.079238 20851 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.193:36645 every 8 connection(s)
I20260811 05:11:09.079682 20586 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-0/data/info.pb
I20260811 05:11:09.083484 20670 log.cc:824] T 1304279a21294224b581d62c9dd4e2d6 P a0916e4208f14bd8a51a53080d28caba: Log is configured to *not* fsync() on all Append() calls
I20260811 05:11:09.084342 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 20586
I20260811 05:11:09.084633 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.191.194:38813
--local_ip_for_outbound_sockets=127.26.191.194
--tserver_master_addrs=127.26.191.254:35153
--webserver_port=35331
--webserver_interface=127.26.191.194
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.194.keytab
--principal=kudu/127.26.191.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:36843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 05:11:09.087623 20670 tablet_bootstrap.cc:492] T 1304279a21294224b581d62c9dd4e2d6 P a0916e4208f14bd8a51a53080d28caba: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 05:11:09.088050 20670 tablet_bootstrap.cc:492] T 1304279a21294224b581d62c9dd4e2d6 P a0916e4208f14bd8a51a53080d28caba: Bootstrap complete.
I20260811 05:11:09.089417 20670 ts_tablet_manager.cc:1397] T 1304279a21294224b581d62c9dd4e2d6 P a0916e4208f14bd8a51a53080d28caba: Time spent bootstrapping tablet: real 0.019s user 0.011s sys 0.006s
Aug 11 05:11:09 dist-test-slave-x5fp krb5kdc[19536](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425069, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.193@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
I20260811 05:11:09.090914 20670 raft_consensus.cc:348] T 1304279a21294224b581d62c9dd4e2d6 P a0916e4208f14bd8a51a53080d28caba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d8742784a64a76ad99371c0f72da2c" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 37069 } } peers { permanent_uuid: "6eb1d755e6cb48a7a36212e6dcdf7155" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 38813 } } peers { permanent_uuid: "a0916e4208f14bd8a51a53080d28caba" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 36645 } }
I20260811 05:11:09.091385 20670 raft_consensus.cc:729] T 1304279a21294224b581d62c9dd4e2d6 P a0916e4208f14bd8a51a53080d28caba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0916e4208f14bd8a51a53080d28caba, State: Initialized, Role: FOLLOWER
I20260811 05:11:09.091583 20670 consensus_queue.cc:260] T 1304279a21294224b581d62c9dd4e2d6 P a0916e4208f14bd8a51a53080d28caba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d8742784a64a76ad99371c0f72da2c" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 37069 } } peers { permanent_uuid: "6eb1d755e6cb48a7a36212e6dcdf7155" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 38813 } } peers { permanent_uuid: "a0916e4208f14bd8a51a53080d28caba" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 36645 } }
I20260811 05:11:09.091970 20670 ts_tablet_manager.cc:1428] T 1304279a21294224b581d62c9dd4e2d6 P a0916e4208f14bd8a51a53080d28caba: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260811 05:11:09.095084 20857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:09.080620 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:35153 (local address 127.26.191.193:37623)
0811 05:11:09.081011 (+ 391us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:09.081058 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 05:11:09.081690 (+ 632us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:11:09.082346 (+ 656us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:11:09.082351 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:11:09.082789 (+ 438us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:11:09.083076 (+ 287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:09.083083 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:09.084945 (+ 1862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:09.084947 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:09.086472 (+ 1525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:09.086476 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:09.087448 (+ 972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:09.087450 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:09.087620 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:09.088362 (+ 742us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:11:09.088377 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:11:09.090428 (+ 2051us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:11:09.093280 (+ 2852us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:11:09.093287 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:11:09.093290 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:11:09.093534 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:11:09.093856 (+ 322us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:11:09.093857 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:11:09.093857 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:11:09.093989 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:11:09.094521 (+ 532us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:11:09.094528 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:11:09.094654 (+ 126us) client_negotiation.cc:769] Sending connection context
0811 05:11:09.094746 (+ 92us) client_negotiation.cc:240] Negotiation successful
0811 05:11:09.094886 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":332,"thread_start_us":163,"threads_started":1}
I20260811 05:11:09.095278 20855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:09.080678 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.193:37623 (local address 127.26.191.254:35153)
0811 05:11:09.080914 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0811 05:11:09.080925 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 05:11:09.081216 (+ 291us) server_negotiation.cc:407] Connection header received
0811 05:11:09.082005 (+ 789us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:11:09.082014 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:11:09.082088 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:11:09.082284 (+ 196us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:11:09.083199 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:09.084715 (+ 1516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:09.086589 (+ 1874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:09.087301 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:09.087451 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:09.090587 (+ 3136us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:11:09.090593 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:11:09.090593 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:11:09.090608 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:11:09.093157 (+ 2549us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:11:09.093630 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:11:09.093635 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:11:09.093635 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:11:09.093777 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:11:09.094064 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:11:09.094065 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:11:09.094066 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:11:09.094438 (+ 372us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:11:09.094540 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0811 05:11:09.094848 (+ 308us) server_negotiation.cc:299] Negotiation successful
0811 05:11:09.095017 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":192,"thread_start_us":121,"threads_started":1}
I20260811 05:11:09.095983 20853 heartbeater.cc:347] Connected to a master server at 127.26.191.254:35153
I20260811 05:11:09.096104 20853 heartbeater.cc:464] Registering TS with master...
I20260811 05:11:09.096321 20853 heartbeater.cc:511] Master 127.26.191.254:35153 requested a full tablet report, sending...
I20260811 05:11:09.097344 20520 ts_manager.cc:194] Registered new tserver with Master: a0916e4208f14bd8a51a53080d28caba (127.26.191.193:36645)
I20260811 05:11:09.098727 20520 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.191.193@KRBTEST.COM'} at 127.26.191.193:37623
I20260811 05:11:09.099826 20853 heartbeater.cc:503] Master 127.26.191.254:35153 was elected leader, sending a full tablet report...
Aug 11 05:11:09 dist-test-slave-x5fp krb5kdc[19536](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425068, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.254@KRBTEST.COM for kudu/127.26.191.193@KRBTEST.COM
I20260811 05:11:09.107838 20862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:09.098398 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38434 (local address 127.26.191.193:36645)
0811 05:11:09.098603 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0811 05:11:09.098607 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:11:09.098616 (+ 9us) server_negotiation.cc:407] Connection header received
0811 05:11:09.098648 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:11:09.098650 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:11:09.098671 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:11:09.098760 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:11:09.099424 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:09.100391 (+ 967us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:09.101605 (+ 1214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:09.101991 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:09.102075 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:09.104592 (+ 2517us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:11:09.104603 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:11:09.104604 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:11:09.104614 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:11:09.106402 (+ 1788us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:11:09.106850 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:11:09.106854 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:11:09.106854 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:11:09.106923 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:11:09.107139 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:11:09.107139 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:11:09.107140 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:11:09.107315 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:11:09.107429 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0811 05:11:09.107627 (+ 198us) server_negotiation.cc:299] Negotiation successful
0811 05:11:09.107728 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":181,"thread_start_us":103,"threads_started":1}
I20260811 05:11:09.107838 20861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:09.098086 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.193:36645 (local address 127.0.0.1:38434)
0811 05:11:09.098306 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:09.098346 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 05:11:09.098436 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:11:09.098780 (+ 344us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:11:09.098819 (+ 39us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:11:09.099249 (+ 430us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:11:09.099322 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:09.099325 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:09.100509 (+ 1184us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:09.100510 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:09.101493 (+ 983us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:09.101496 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:09.102085 (+ 589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:09.102086 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:09.102172 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:09.102743 (+ 571us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:11:09.102748 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:11:09.104481 (+ 1733us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:11:09.106516 (+ 2035us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:11:09.106525 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:11:09.106528 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:11:09.106750 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:11:09.106997 (+ 247us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:11:09.106999 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:11:09.106999 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:11:09.107071 (+ 72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:11:09.107406 (+ 335us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:11:09.107414 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:11:09.107473 (+ 59us) client_negotiation.cc:769] Sending connection context
0811 05:11:09.107579 (+ 106us) client_negotiation.cc:240] Negotiation successful
0811 05:11:09.107728 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":143,"threads_started":1}
I20260811 05:11:09.108311 20746 tablet_service.cc:1514] Processing DeleteTablet for tablet 1304279a21294224b581d62c9dd4e2d6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:10:48 UTC) from {username='kudu', principal='kudu/127.26.191.254@KRBTEST.COM'} at 127.0.0.1:38434
I20260811 05:11:09.109011 20863 tablet_replica.cc:330] stopping tablet replica
I20260811 05:11:09.109143 20863 raft_consensus.cc:2229] T 1304279a21294224b581d62c9dd4e2d6 P a0916e4208f14bd8a51a53080d28caba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 05:11:09.109220 20863 raft_consensus.cc:2258] T 1304279a21294224b581d62c9dd4e2d6 P a0916e4208f14bd8a51a53080d28caba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:11:09.109608 20863 ts_tablet_manager.cc:1905] T 1304279a21294224b581d62c9dd4e2d6 P a0916e4208f14bd8a51a53080d28caba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:11:09.112365 20863 ts_tablet_manager.cc:1918] T 1304279a21294224b581d62c9dd4e2d6 P a0916e4208f14bd8a51a53080d28caba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 05:11:09.112462 20863 log.cc:1196] T 1304279a21294224b581d62c9dd4e2d6 P a0916e4208f14bd8a51a53080d28caba: Deleting WAL directory at /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-0/wal/wals/1304279a21294224b581d62c9dd4e2d6
I20260811 05:11:09.112699 20863 ts_tablet_manager.cc:1939] T 1304279a21294224b581d62c9dd4e2d6 P a0916e4208f14bd8a51a53080d28caba: Deleting consensus metadata
I20260811 05:11:09.113380 20492 catalog_manager.cc:4841] TS a0916e4208f14bd8a51a53080d28caba (127.26.191.193:36645): tablet 1304279a21294224b581d62c9dd4e2d6 (table test-table [id=e391ca4624964ab88e8d54acc4ce6567]) successfully deleted
W20260811 05:11:09.178076 20859 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:11:09.178315 20859 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:11:09.178341 20859 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:11:09.179560 20859 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:11:09.179607 20859 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:11:09.179636 20859 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.191.194
I20260811 05:11:09.181243 20859 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:36843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.194.keytab
--principal=kudu/127.26.191.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.191.194:38813
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.191.194
--webserver_port=35331
--tserver_master_addrs=127.26.191.254:35153
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20859
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.191.194
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:11:09.181517 20859 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:11:09.181775 20859 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:11:09.187785 20870 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:11:09.187948 20869 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:11:09.188084 20872 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:11:09.188054 20859 server_base.cc:1034] running on GCE node
I20260811 05:11:09.188413 20859 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:11:09.188670 20859 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:11:09.189872 20859 hybrid_clock.cc:648] HybridClock initialized: now 1786425069189850 us; error 43 us; skew 500 ppm
Aug 11 05:11:09 dist-test-slave-x5fp krb5kdc[19536](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425069, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:11:09.192853 20859 init.cc:377] Logged in from keytab as kudu/127.26.191.194@KRBTEST.COM (short username kudu)
I20260811 05:11:09.193377 20859 webserver.cc:460] Webserver started at http://127.26.191.194:35331/ using document root <none> and password file <none>
I20260811 05:11:09.193651 20859 fs_manager.cc:359] Metadata directory not provided
I20260811 05:11:09.193742 20859 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:11:09.195350 20859 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 05:11:09.196147 20885 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:11:09.196362 20859 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:11:09.196487 20859 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-1/wal
uuid: "6eb1d755e6cb48a7a36212e6dcdf7155"
format_stamp: "Formatted at 2026-08-11 05:10:48 on dist-test-slave-x5fp"
server_key: "5c56ab43652dbb991c79e466e2879dad"
server_key_iv: "71bb3d65dea196d2e7f8a8967e8cfad9"
server_key_version: "encryptionkey@0"
I20260811 05:11:09.196959 20859 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:11:09.213764 20859 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:11:09.216394 20859 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:11:09.216566 20859 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:11:09.216876 20859 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:11:09.217367 20898 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 05:11:09.219055 20859 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 05:11:09.219125 20859 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260811 05:11:09.219177 20859 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 05:11:09.219870 20859 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 05:11:09.219930 20859 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260811 05:11:09.220018 20898 tablet_bootstrap.cc:492] T 1304279a21294224b581d62c9dd4e2d6 P 6eb1d755e6cb48a7a36212e6dcdf7155: Bootstrap starting.
I20260811 05:11:09.222174 20898 log.cc:824] T 1304279a21294224b581d62c9dd4e2d6 P 6eb1d755e6cb48a7a36212e6dcdf7155: Log is configured to *not* fsync() on all Append() calls
I20260811 05:11:09.225823 20898 tablet_bootstrap.cc:492] T 1304279a21294224b581d62c9dd4e2d6 P 6eb1d755e6cb48a7a36212e6dcdf7155: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 05:11:09.226212 20898 tablet_bootstrap.cc:492] T 1304279a21294224b581d62c9dd4e2d6 P 6eb1d755e6cb48a7a36212e6dcdf7155: Bootstrap complete.
I20260811 05:11:09.226406 20898 ts_tablet_manager.cc:1397] T 1304279a21294224b581d62c9dd4e2d6 P 6eb1d755e6cb48a7a36212e6dcdf7155: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.003s
I20260811 05:11:09.226950 20859 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.194:38813
I20260811 05:11:09.227058 21083 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.194:38813 every 8 connection(s)
I20260811 05:11:09.227358 20859 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-1/data/info.pb
I20260811 05:11:09.228546 20898 raft_consensus.cc:348] T 1304279a21294224b581d62c9dd4e2d6 P 6eb1d755e6cb48a7a36212e6dcdf7155 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d8742784a64a76ad99371c0f72da2c" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 37069 } } peers { permanent_uuid: "6eb1d755e6cb48a7a36212e6dcdf7155" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 38813 } } peers { permanent_uuid: "a0916e4208f14bd8a51a53080d28caba" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 36645 } }
I20260811 05:11:09.228953 20898 raft_consensus.cc:729] T 1304279a21294224b581d62c9dd4e2d6 P 6eb1d755e6cb48a7a36212e6dcdf7155 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6eb1d755e6cb48a7a36212e6dcdf7155, State: Initialized, Role: FOLLOWER
I20260811 05:11:09.229101 20898 consensus_queue.cc:260] T 1304279a21294224b581d62c9dd4e2d6 P 6eb1d755e6cb48a7a36212e6dcdf7155 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d8742784a64a76ad99371c0f72da2c" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 37069 } } peers { permanent_uuid: "6eb1d755e6cb48a7a36212e6dcdf7155" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 38813 } } peers { permanent_uuid: "a0916e4208f14bd8a51a53080d28caba" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 36645 } }
I20260811 05:11:09.229375 20898 ts_tablet_manager.cc:1428] T 1304279a21294224b581d62c9dd4e2d6 P 6eb1d755e6cb48a7a36212e6dcdf7155: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260811 05:11:09.232780 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 20859
I20260811 05:11:09.233072 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.191.195:37069
--local_ip_for_outbound_sockets=127.26.191.195
--tserver_master_addrs=127.26.191.254:35153
--webserver_port=35075
--webserver_interface=127.26.191.195
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.195.keytab
--principal=kudu/127.26.191.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:36843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 05:11:09 dist-test-slave-x5fp krb5kdc[19536](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425069, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.194@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
I20260811 05:11:09.238353 20855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:09.228241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.194:50011 (local address 127.26.191.254:35153)
0811 05:11:09.228293 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 05:11:09.228296 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:11:09.228581 (+ 285us) server_negotiation.cc:407] Connection header received
0811 05:11:09.228929 (+ 348us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:11:09.228930 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:11:09.228958 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:11:09.229026 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:11:09.229858 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:09.230418 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:09.231435 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:09.231652 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:09.231727 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:09.235053 (+ 3326us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:11:09.235055 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:11:09.235056 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:11:09.235064 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:11:09.236610 (+ 1546us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:11:09.237176 (+ 566us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:11:09.237177 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:11:09.237178 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:11:09.237246 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:11:09.237565 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:11:09.237566 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:11:09.237567 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:11:09.237702 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:11:09.237788 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0811 05:11:09.238113 (+ 325us) server_negotiation.cc:299] Negotiation successful
0811 05:11:09.238227 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 05:11:09.238565 21087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:09.228183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:35153 (local address 127.26.191.194:50011)
0811 05:11:09.228439 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:09.228483 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 05:11:09.228793 (+ 310us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:11:09.229149 (+ 356us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:11:09.229153 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:11:09.229551 (+ 398us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:11:09.229746 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:09.229751 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:09.230523 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:09.230524 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:09.231327 (+ 803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:09.231329 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:09.231736 (+ 407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:09.231737 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:09.231838 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:09.232460 (+ 622us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:11:09.232469 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:11:09.234931 (+ 2462us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:11:09.236770 (+ 1839us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:11:09.236779 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:11:09.236781 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:11:09.237062 (+ 281us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:11:09.237352 (+ 290us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:11:09.237353 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:11:09.237353 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:11:09.237479 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:11:09.237778 (+ 299us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:11:09.237795 (+ 17us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:11:09.237951 (+ 156us) client_negotiation.cc:769] Sending connection context
0811 05:11:09.238064 (+ 113us) client_negotiation.cc:240] Negotiation successful
0811 05:11:09.238250 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":94,"threads_started":1}
I20260811 05:11:09.239171 21084 heartbeater.cc:347] Connected to a master server at 127.26.191.254:35153
I20260811 05:11:09.239297 21084 heartbeater.cc:464] Registering TS with master...
I20260811 05:11:09.239496 21084 heartbeater.cc:511] Master 127.26.191.254:35153 requested a full tablet report, sending...
I20260811 05:11:09.240144 20520 ts_manager.cc:194] Registered new tserver with Master: 6eb1d755e6cb48a7a36212e6dcdf7155 (127.26.191.194:38813)
I20260811 05:11:09.240869 20520 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.191.194@KRBTEST.COM'} at 127.26.191.194:50011
I20260811 05:11:09.241830 21084 heartbeater.cc:503] Master 127.26.191.254:35153 was elected leader, sending a full tablet report...
Aug 11 05:11:09 dist-test-slave-x5fp krb5kdc[19536](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425068, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.254@KRBTEST.COM for kudu/127.26.191.194@KRBTEST.COM
I20260811 05:11:09.249066 20861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:09.240515 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.194:38813 (local address 127.0.0.1:32950)
0811 05:11:09.240571 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:09.240582 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 05:11:09.240625 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:11:09.241020 (+ 395us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:11:09.241021 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:11:09.241187 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:11:09.241268 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:09.241270 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:09.242473 (+ 1203us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:09.242474 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:09.243009 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:09.243010 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:09.243523 (+ 513us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:09.243524 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:09.243597 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:09.244112 (+ 515us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:11:09.244116 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:11:09.245684 (+ 1568us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:11:09.247674 (+ 1990us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:11:09.247675 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:11:09.247676 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:11:09.247941 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:11:09.248234 (+ 293us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:11:09.248235 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:11:09.248235 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:11:09.248304 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:11:09.248660 (+ 356us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:11:09.248661 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:11:09.248710 (+ 49us) client_negotiation.cc:769] Sending connection context
0811 05:11:09.248820 (+ 110us) client_negotiation.cc:240] Negotiation successful
0811 05:11:09.248948 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40}
I20260811 05:11:09.249085 21090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:09.240578 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32950 (local address 127.26.191.194:38813)
0811 05:11:09.240805 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0811 05:11:09.240810 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:11:09.240819 (+ 9us) server_negotiation.cc:407] Connection header received
0811 05:11:09.240859 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:11:09.240861 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:11:09.240872 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:11:09.241018 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:11:09.241363 (+ 345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:09.242408 (+ 1045us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:09.243111 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:09.243441 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:09.243524 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:09.245788 (+ 2264us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:11:09.245797 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:11:09.245797 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:11:09.245805 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:11:09.247559 (+ 1754us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:11:09.248083 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:11:09.248087 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:11:09.248087 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:11:09.248158 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:11:09.248375 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:11:09.248376 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:11:09.248376 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:11:09.248560 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:11:09.248667 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0811 05:11:09.248871 (+ 204us) server_negotiation.cc:299] Negotiation successful
0811 05:11:09.248972 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":28,"server-negotiator.queue_time_us":198,"thread_start_us":83,"threads_started":1}
I20260811 05:11:09.249538 20964 tablet_service.cc:1514] Processing DeleteTablet for tablet 1304279a21294224b581d62c9dd4e2d6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:10:48 UTC) from {username='kudu', principal='kudu/127.26.191.254@KRBTEST.COM'} at 127.0.0.1:32950
I20260811 05:11:09.250200 21091 tablet_replica.cc:330] stopping tablet replica
I20260811 05:11:09.250317 21091 raft_consensus.cc:2229] T 1304279a21294224b581d62c9dd4e2d6 P 6eb1d755e6cb48a7a36212e6dcdf7155 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 05:11:09.250399 21091 raft_consensus.cc:2258] T 1304279a21294224b581d62c9dd4e2d6 P 6eb1d755e6cb48a7a36212e6dcdf7155 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:11:09.250764 21091 ts_tablet_manager.cc:1905] T 1304279a21294224b581d62c9dd4e2d6 P 6eb1d755e6cb48a7a36212e6dcdf7155: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:11:09.253477 21091 ts_tablet_manager.cc:1918] T 1304279a21294224b581d62c9dd4e2d6 P 6eb1d755e6cb48a7a36212e6dcdf7155: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 05:11:09.253564 21091 log.cc:1196] T 1304279a21294224b581d62c9dd4e2d6 P 6eb1d755e6cb48a7a36212e6dcdf7155: Deleting WAL directory at /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-1/wal/wals/1304279a21294224b581d62c9dd4e2d6
I20260811 05:11:09.253806 21091 ts_tablet_manager.cc:1939] T 1304279a21294224b581d62c9dd4e2d6 P 6eb1d755e6cb48a7a36212e6dcdf7155: Deleting consensus metadata
I20260811 05:11:09.254374 20493 catalog_manager.cc:4841] TS 6eb1d755e6cb48a7a36212e6dcdf7155 (127.26.191.194:38813): tablet 1304279a21294224b581d62c9dd4e2d6 (table test-table [id=e391ca4624964ab88e8d54acc4ce6567]) successfully deleted
W20260811 05:11:09.323338 21089 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:11:09.323565 21089 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:11:09.323590 21089 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:11:09.324807 21089 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:11:09.324859 21089 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:11:09.324888 21089 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.191.195
I20260811 05:11:09.326411 21089 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:36843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.195.keytab
--principal=kudu/127.26.191.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.191.195:37069
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.191.195
--webserver_port=35075
--tserver_master_addrs=127.26.191.254:35153
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21089
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.191.195
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:11:09.326686 21089 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:11:09.326951 21089 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:11:09.332425 21102 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:11:09.332489 21104 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:11:09.332424 21101 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:11:09.332697 21089 server_base.cc:1034] running on GCE node
I20260811 05:11:09.333009 21089 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:11:09.333279 21089 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:11:09.334473 21089 hybrid_clock.cc:648] HybridClock initialized: now 1786425069334460 us; error 33 us; skew 500 ppm
Aug 11 05:11:09 dist-test-slave-x5fp krb5kdc[19536](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425069, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:11:09.337286 21089 init.cc:377] Logged in from keytab as kudu/127.26.191.195@KRBTEST.COM (short username kudu)
I20260811 05:11:09.337790 21089 webserver.cc:460] Webserver started at http://127.26.191.195:35075/ using document root <none> and password file <none>
I20260811 05:11:09.338060 21089 fs_manager.cc:359] Metadata directory not provided
I20260811 05:11:09.338122 21089 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:11:09.339579 21089 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.001s
I20260811 05:11:09.340277 21115 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:11:09.340483 21089 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 05:11:09.340596 21089 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-2/wal
uuid: "b9d8742784a64a76ad99371c0f72da2c"
format_stamp: "Formatted at 2026-08-11 05:10:48 on dist-test-slave-x5fp"
server_key: "2bba353c97da7dc11dc022b8833b0c22"
server_key_iv: "552dc03385f07064afd938f5ff593dc3"
server_key_version: "encryptionkey@0"
I20260811 05:11:09.341044 21089 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:11:09.368386 21089 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:11:09.370952 21089 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:11:09.371134 21089 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:11:09.371413 21089 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:11:09.371742 21089 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:11:09.371798 21089 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:11:09.371843 21089 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:11:09.371874 21089 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:11:09.377954 21089 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.195:37069
I20260811 05:11:09.377998 21319 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.195:37069 every 8 connection(s)
I20260811 05:11:09.378351 21089 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-2/data/info.pb
I20260811 05:11:09.379968 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 21089
Aug 11 05:11:09 dist-test-slave-x5fp krb5kdc[19536](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425069, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.195@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
I20260811 05:11:09.388365 21328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:09.380416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48458 (local address 127.26.191.254:35153)
0811 05:11:09.380553 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0811 05:11:09.380556 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:11:09.380606 (+ 50us) server_negotiation.cc:407] Connection header received
0811 05:11:09.380679 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:11:09.380680 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:11:09.380691 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:11:09.380783 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:11:09.382043 (+ 1260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:09.382473 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:09.383472 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:09.383708 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:09.383780 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:09.385149 (+ 1369us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:11:09.385151 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:11:09.385152 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:11:09.385160 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:11:09.387078 (+ 1918us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:11:09.387501 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:11:09.387503 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:11:09.387503 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:11:09.387571 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:11:09.387818 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:11:09.387819 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:11:09.387819 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:11:09.387944 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:11:09.388120 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0811 05:11:09.388160 (+ 40us) server_negotiation.cc:299] Negotiation successful
0811 05:11:09.388248 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115,"thread_start_us":86,"threads_started":1}
I20260811 05:11:09.389411 20855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:09.379155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.195:44003 (local address 127.26.191.254:35153)
0811 05:11:09.379235 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0811 05:11:09.379238 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:11:09.379495 (+ 257us) server_negotiation.cc:407] Connection header received
0811 05:11:09.379990 (+ 495us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:11:09.379992 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:11:09.380006 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:11:09.380084 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:11:09.381441 (+ 1357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:09.381968 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:09.382936 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:09.383237 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:09.383311 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:09.386042 (+ 2731us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:11:09.386043 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:11:09.386044 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:11:09.386051 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:11:09.387612 (+ 1561us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:11:09.388141 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:11:09.388142 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:11:09.388143 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:11:09.388216 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:11:09.388540 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:11:09.388542 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:11:09.388542 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:11:09.388687 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:11:09.388802 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0811 05:11:09.389201 (+ 399us) server_negotiation.cc:299] Negotiation successful
0811 05:11:09.389302 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 05:11:09.389640 21324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:09.379148 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:35153 (local address 127.26.191.195:44003)
0811 05:11:09.379349 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:09.379402 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 05:11:09.379877 (+ 475us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:11:09.380204 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:11:09.380208 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:11:09.381060 (+ 852us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:11:09.381340 (+ 280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:09.381346 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:09.382048 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:09.382049 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:09.382846 (+ 797us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:09.382848 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:09.383330 (+ 482us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:09.383331 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:09.383484 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:09.384022 (+ 538us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:11:09.384032 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:11:09.385946 (+ 1914us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:11:09.387749 (+ 1803us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:11:09.387757 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:11:09.387760 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:11:09.388033 (+ 273us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:11:09.388295 (+ 262us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:11:09.388296 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:11:09.388296 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:11:09.388466 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:11:09.388794 (+ 328us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:11:09.388801 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:11:09.388996 (+ 195us) client_negotiation.cc:769] Sending connection context
0811 05:11:09.389131 (+ 135us) client_negotiation.cc:240] Negotiation successful
0811 05:11:09.389355 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":118,"threads_started":1}
I20260811 05:11:09.390194 21320 heartbeater.cc:347] Connected to a master server at 127.26.191.254:35153
I20260811 05:11:09.390314 21320 heartbeater.cc:464] Registering TS with master...
I20260811 05:11:09.390543 21320 heartbeater.cc:511] Master 127.26.191.254:35153 requested a full tablet report, sending...
I20260811 05:11:09.391032 20520 ts_manager.cc:194] Registered new tserver with Master: b9d8742784a64a76ad99371c0f72da2c (127.26.191.195:37069)
I20260811 05:11:09.391461 20520 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.191.195@KRBTEST.COM'} at 127.26.191.195:44003
I20260811 05:11:09.400305 27391 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 05:11:09.403406 20855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:09.400807 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48464 (local address 127.26.191.254:35153)
0811 05:11:09.400868 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0811 05:11:09.400871 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:11:09.401093 (+ 222us) server_negotiation.cc:407] Connection header received
0811 05:11:09.401167 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:11:09.401168 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:11:09.401254 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:11:09.401320 (+ 66us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:11:09.401443 (+ 123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:09.401936 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:09.402738 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:09.402944 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:09.403003 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:09.403163 (+ 160us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:11:09.403213 (+ 50us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0811 05:11:09.403348 (+ 135us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:48464: token expired
Metrics: {"server-negotiator.queue_time_us":29}
W20260811 05:11:09.403497 20855 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:48464: token expired
W20260811 05:11:09.403734 20396 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.26.191.254:35153)
I20260811 05:11:09.410166 20855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:09.404005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48468 (local address 127.26.191.254:35153)
0811 05:11:09.404049 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 05:11:09.404051 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:11:09.404060 (+ 9us) server_negotiation.cc:407] Connection header received
0811 05:11:09.404102 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:11:09.404103 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:11:09.404111 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:11:09.404157 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:11:09.404703 (+ 546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:09.405228 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:09.405935 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:09.406127 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:09.406201 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:09.407460 (+ 1259us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:11:09.407462 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:11:09.407462 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:11:09.407470 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:11:09.408965 (+ 1495us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:11:09.409346 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:11:09.409347 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:11:09.409348 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:11:09.409413 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:11:09.409635 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:11:09.409635 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:11:09.409636 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:11:09.409753 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:11:09.409872 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0811 05:11:09.409973 (+ 101us) server_negotiation.cc:299] Negotiation successful
0811 05:11:09.410057 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 05:11:09.411688 20520 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48468:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 05:11:09.413461 20520 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 05:11:09.415899 20746 tablet_service.cc:1467] Processing CreateTablet for tablet 033c8b6907eb4f0ca7ec2714090f6328 (DEFAULT_TABLE table=test-table [id=2bed9ee6f57643ef8b17f70170d73308]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:11:09.416059 20964 tablet_service.cc:1467] Processing CreateTablet for tablet 033c8b6907eb4f0ca7ec2714090f6328 (DEFAULT_TABLE table=test-table [id=2bed9ee6f57643ef8b17f70170d73308]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:11:09.416168 20746 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 033c8b6907eb4f0ca7ec2714090f6328. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:11:09.416251 20964 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 033c8b6907eb4f0ca7ec2714090f6328. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:11:09.417726 20898 tablet_bootstrap.cc:492] T 033c8b6907eb4f0ca7ec2714090f6328 P 6eb1d755e6cb48a7a36212e6dcdf7155: Bootstrap starting.
I20260811 05:11:09.418059 20670 tablet_bootstrap.cc:492] T 033c8b6907eb4f0ca7ec2714090f6328 P a0916e4208f14bd8a51a53080d28caba: Bootstrap starting.
I20260811 05:11:09.418195 20898 tablet_bootstrap.cc:654] T 033c8b6907eb4f0ca7ec2714090f6328 P 6eb1d755e6cb48a7a36212e6dcdf7155: Neither blocks nor log segments found. Creating new log.
I20260811 05:11:09.418524 20670 tablet_bootstrap.cc:654] T 033c8b6907eb4f0ca7ec2714090f6328 P a0916e4208f14bd8a51a53080d28caba: Neither blocks nor log segments found. Creating new log.
I20260811 05:11:09.418977 20898 tablet_bootstrap.cc:492] T 033c8b6907eb4f0ca7ec2714090f6328 P 6eb1d755e6cb48a7a36212e6dcdf7155: No bootstrap required, opened a new log
I20260811 05:11:09.419044 20898 ts_tablet_manager.cc:1397] T 033c8b6907eb4f0ca7ec2714090f6328 P 6eb1d755e6cb48a7a36212e6dcdf7155: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 05:11:09.419317 20898 raft_consensus.cc:348] T 033c8b6907eb4f0ca7ec2714090f6328 P 6eb1d755e6cb48a7a36212e6dcdf7155 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d8742784a64a76ad99371c0f72da2c" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 37069 } } peers { permanent_uuid: "6eb1d755e6cb48a7a36212e6dcdf7155" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 38813 } } peers { permanent_uuid: "a0916e4208f14bd8a51a53080d28caba" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 36645 } }
I20260811 05:11:09.419426 20898 raft_consensus.cc:374] T 033c8b6907eb4f0ca7ec2714090f6328 P 6eb1d755e6cb48a7a36212e6dcdf7155 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:11:09.419492 20898 raft_consensus.cc:729] T 033c8b6907eb4f0ca7ec2714090f6328 P 6eb1d755e6cb48a7a36212e6dcdf7155 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6eb1d755e6cb48a7a36212e6dcdf7155, State: Initialized, Role: FOLLOWER
I20260811 05:11:09.419543 20670 tablet_bootstrap.cc:492] T 033c8b6907eb4f0ca7ec2714090f6328 P a0916e4208f14bd8a51a53080d28caba: No bootstrap required, opened a new log
I20260811 05:11:09.419555 20898 consensus_queue.cc:260] T 033c8b6907eb4f0ca7ec2714090f6328 P 6eb1d755e6cb48a7a36212e6dcdf7155 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d8742784a64a76ad99371c0f72da2c" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 37069 } } peers { permanent_uuid: "6eb1d755e6cb48a7a36212e6dcdf7155" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 38813 } } peers { permanent_uuid: "a0916e4208f14bd8a51a53080d28caba" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 36645 } }
I20260811 05:11:09.419595 20670 ts_tablet_manager.cc:1397] T 033c8b6907eb4f0ca7ec2714090f6328 P a0916e4208f14bd8a51a53080d28caba: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 05:11:09.419683 20898 ts_tablet_manager.cc:1428] T 033c8b6907eb4f0ca7ec2714090f6328 P 6eb1d755e6cb48a7a36212e6dcdf7155: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 05:11:09.419751 20670 raft_consensus.cc:348] T 033c8b6907eb4f0ca7ec2714090f6328 P a0916e4208f14bd8a51a53080d28caba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d8742784a64a76ad99371c0f72da2c" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 37069 } } peers { permanent_uuid: "6eb1d755e6cb48a7a36212e6dcdf7155" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 38813 } } peers { permanent_uuid: "a0916e4208f14bd8a51a53080d28caba" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 36645 } }
I20260811 05:11:09.419821 20670 raft_consensus.cc:374] T 033c8b6907eb4f0ca7ec2714090f6328 P a0916e4208f14bd8a51a53080d28caba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:11:09.419867 20670 raft_consensus.cc:729] T 033c8b6907eb4f0ca7ec2714090f6328 P a0916e4208f14bd8a51a53080d28caba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0916e4208f14bd8a51a53080d28caba, State: Initialized, Role: FOLLOWER
I20260811 05:11:09.419921 20670 consensus_queue.cc:260] T 033c8b6907eb4f0ca7ec2714090f6328 P a0916e4208f14bd8a51a53080d28caba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d8742784a64a76ad99371c0f72da2c" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 37069 } } peers { permanent_uuid: "6eb1d755e6cb48a7a36212e6dcdf7155" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 38813 } } peers { permanent_uuid: "a0916e4208f14bd8a51a53080d28caba" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 36645 } }
I20260811 05:11:09.420023 20670 ts_tablet_manager.cc:1428] T 033c8b6907eb4f0ca7ec2714090f6328 P a0916e4208f14bd8a51a53080d28caba: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 05:11:09.420074 20861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:09.415674 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.195:37069 (local address 127.0.0.1:37820)
0811 05:11:09.415739 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:09.415752 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 05:11:09.415795 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:11:09.416396 (+ 601us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:11:09.416397 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:11:09.416400 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:11:09.416457 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:09.416458 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:09.417770 (+ 1312us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:09.417772 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:09.418781 (+ 1009us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:09.418785 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:09.419754 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:09.419756 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:09.419825 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:09.419861 (+ 36us) client_negotiation.cc:769] Sending connection context
0811 05:11:09.419946 (+ 85us) client_negotiation.cc:240] Negotiation successful
0811 05:11:09.419993 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44}
I20260811 05:11:09.420279 21332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:09.415895 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37820 (local address 127.26.191.195:37069)
0811 05:11:09.416208 (+ 313us) server_negotiation.cc:206] Beginning negotiation
0811 05:11:09.416214 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 05:11:09.416226 (+ 12us) server_negotiation.cc:407] Connection header received
0811 05:11:09.416273 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:11:09.416275 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:11:09.416292 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:11:09.416385 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:11:09.416551 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:09.417639 (+ 1088us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:09.418885 (+ 1246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:09.419650 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:09.419742 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:09.419813 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 05:11:09.419968 (+ 155us) server_negotiation.cc:299] Negotiation successful
0811 05:11:09.420179 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":277,"thread_start_us":170,"threads_started":1}
I20260811 05:11:09.421118 21200 tablet_service.cc:1467] Processing CreateTablet for tablet 033c8b6907eb4f0ca7ec2714090f6328 (DEFAULT_TABLE table=test-table [id=2bed9ee6f57643ef8b17f70170d73308]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:11:09.421504 21200 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 033c8b6907eb4f0ca7ec2714090f6328. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:11:09.424440 21336 tablet_bootstrap.cc:492] T 033c8b6907eb4f0ca7ec2714090f6328 P b9d8742784a64a76ad99371c0f72da2c: Bootstrap starting.
I20260811 05:11:09.425302 21336 tablet_bootstrap.cc:654] T 033c8b6907eb4f0ca7ec2714090f6328 P b9d8742784a64a76ad99371c0f72da2c: Neither blocks nor log segments found. Creating new log.
I20260811 05:11:09.425825 21336 log.cc:824] T 033c8b6907eb4f0ca7ec2714090f6328 P b9d8742784a64a76ad99371c0f72da2c: Log is configured to *not* fsync() on all Append() calls
I20260811 05:11:09.426578 21336 tablet_bootstrap.cc:492] T 033c8b6907eb4f0ca7ec2714090f6328 P b9d8742784a64a76ad99371c0f72da2c: No bootstrap required, opened a new log
I20260811 05:11:09.426640 21336 ts_tablet_manager.cc:1397] T 033c8b6907eb4f0ca7ec2714090f6328 P b9d8742784a64a76ad99371c0f72da2c: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 05:11:09.428311 21336 raft_consensus.cc:348] T 033c8b6907eb4f0ca7ec2714090f6328 P b9d8742784a64a76ad99371c0f72da2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d8742784a64a76ad99371c0f72da2c" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 37069 } } peers { permanent_uuid: "6eb1d755e6cb48a7a36212e6dcdf7155" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 38813 } } peers { permanent_uuid: "a0916e4208f14bd8a51a53080d28caba" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 36645 } }
I20260811 05:11:09.428459 21336 raft_consensus.cc:374] T 033c8b6907eb4f0ca7ec2714090f6328 P b9d8742784a64a76ad99371c0f72da2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:11:09.428481 21336 raft_consensus.cc:729] T 033c8b6907eb4f0ca7ec2714090f6328 P b9d8742784a64a76ad99371c0f72da2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9d8742784a64a76ad99371c0f72da2c, State: Initialized, Role: FOLLOWER
I20260811 05:11:09.428608 21336 consensus_queue.cc:260] T 033c8b6907eb4f0ca7ec2714090f6328 P b9d8742784a64a76ad99371c0f72da2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d8742784a64a76ad99371c0f72da2c" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 37069 } } peers { permanent_uuid: "6eb1d755e6cb48a7a36212e6dcdf7155" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 38813 } } peers { permanent_uuid: "a0916e4208f14bd8a51a53080d28caba" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 36645 } }
I20260811 05:11:09.428953 21336 ts_tablet_manager.cc:1428] T 033c8b6907eb4f0ca7ec2714090f6328 P b9d8742784a64a76ad99371c0f72da2c: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260811 05:11:09.429088 21320 heartbeater.cc:503] Master 127.26.191.254:35153 was elected leader, sending a full tablet report...
W20260811 05:11:09.478044 21085 tablet.cc:2369] T 033c8b6907eb4f0ca7ec2714090f6328 P 6eb1d755e6cb48a7a36212e6dcdf7155: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 05:11:09.514494 21088 raft_consensus.cc:482] T 033c8b6907eb4f0ca7ec2714090f6328 P 6eb1d755e6cb48a7a36212e6dcdf7155 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 05:11:09.514649 21088 raft_consensus.cc:504] T 033c8b6907eb4f0ca7ec2714090f6328 P 6eb1d755e6cb48a7a36212e6dcdf7155 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d8742784a64a76ad99371c0f72da2c" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 37069 } } peers { permanent_uuid: "6eb1d755e6cb48a7a36212e6dcdf7155" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 38813 } } peers { permanent_uuid: "a0916e4208f14bd8a51a53080d28caba" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 36645 } }
I20260811 05:11:09.515015 21088 leader_election.cc:288] T 033c8b6907eb4f0ca7ec2714090f6328 P 6eb1d755e6cb48a7a36212e6dcdf7155 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9d8742784a64a76ad99371c0f72da2c (127.26.191.195:37069), a0916e4208f14bd8a51a53080d28caba (127.26.191.193:36645)
I20260811 05:11:09.519345 21332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:09.515283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.194:54605 (local address 127.26.191.195:37069)
0811 05:11:09.515413 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0811 05:11:09.515415 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:11:09.515468 (+ 53us) server_negotiation.cc:407] Connection header received
0811 05:11:09.515528 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:11:09.515529 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:11:09.515538 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:11:09.515593 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:11:09.515850 (+ 257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:09.516627 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:09.518233 (+ 1606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:09.518856 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:09.518951 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:09.518962 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0811 05:11:09.519214 (+ 252us) server_negotiation.cc:299] Negotiation successful
0811 05:11:09.519265 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":106}
I20260811 05:11:09.519364 20862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:09.515298 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.194:49273 (local address 127.26.191.193:36645)
0811 05:11:09.515371 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0811 05:11:09.515373 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:11:09.515386 (+ 13us) server_negotiation.cc:407] Connection header received
0811 05:11:09.515446 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:11:09.515448 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:11:09.515482 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:11:09.515562 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:11:09.515851 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:09.516639 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:09.518239 (+ 1600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:09.518890 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:09.518956 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:09.519057 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0811 05:11:09.519237 (+ 180us) server_negotiation.cc:299] Negotiation successful
0811 05:11:09.519283 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 05:11:09.519346 21087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:09.515212 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.193:36645 (local address 127.26.191.194:49273)
0811 05:11:09.515295 (+ 83us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:09.515308 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 05:11:09.515368 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:11:09.515611 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:11:09.515612 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:11:09.515614 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:11:09.515707 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:09.515709 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:09.516768 (+ 1059us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:09.516770 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:09.518112 (+ 1342us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:09.518115 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:09.518999 (+ 884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:09.519001 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:09.519090 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:09.519118 (+ 28us) client_negotiation.cc:769] Sending connection context
0811 05:11:09.519199 (+ 81us) client_negotiation.cc:240] Negotiation successful
0811 05:11:09.519233 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":63,"mutex_wait_us":63}
I20260811 05:11:09.519362 21342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:09.515234 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.195:37069 (local address 127.26.191.194:54605)
0811 05:11:09.515407 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:09.515418 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 05:11:09.515483 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:11:09.515611 (+ 128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:11:09.515612 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:11:09.515614 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:11:09.515708 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:09.515709 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:09.516789 (+ 1080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:09.516789 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:09.518112 (+ 1323us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:09.518115 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:09.519015 (+ 900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:09.519016 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:09.519087 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:09.519118 (+ 31us) client_negotiation.cc:769] Sending connection context
0811 05:11:09.519190 (+ 72us) client_negotiation.cc:240] Negotiation successful
0811 05:11:09.519233 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"mutex_wait_us":44,"thread_start_us":111,"threads_started":1}
I20260811 05:11:09.519815 21238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "033c8b6907eb4f0ca7ec2714090f6328" candidate_uuid: "6eb1d755e6cb48a7a36212e6dcdf7155" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d8742784a64a76ad99371c0f72da2c" is_pre_election: true
I20260811 05:11:09.519856 20779 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "033c8b6907eb4f0ca7ec2714090f6328" candidate_uuid: "6eb1d755e6cb48a7a36212e6dcdf7155" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0916e4208f14bd8a51a53080d28caba" is_pre_election: true
I20260811 05:11:09.520037 21238 raft_consensus.cc:2454] T 033c8b6907eb4f0ca7ec2714090f6328 P b9d8742784a64a76ad99371c0f72da2c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6eb1d755e6cb48a7a36212e6dcdf7155 in term 0.
I20260811 05:11:09.520052 20779 raft_consensus.cc:2454] T 033c8b6907eb4f0ca7ec2714090f6328 P a0916e4208f14bd8a51a53080d28caba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6eb1d755e6cb48a7a36212e6dcdf7155 in term 0.
I20260811 05:11:09.520318 20890 leader_election.cc:302] T 033c8b6907eb4f0ca7ec2714090f6328 P 6eb1d755e6cb48a7a36212e6dcdf7155 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6eb1d755e6cb48a7a36212e6dcdf7155, b9d8742784a64a76ad99371c0f72da2c; no voters:
I20260811 05:11:09.520462 21088 raft_consensus.cc:2781] T 033c8b6907eb4f0ca7ec2714090f6328 P 6eb1d755e6cb48a7a36212e6dcdf7155 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 05:11:09.520525 21088 raft_consensus.cc:482] T 033c8b6907eb4f0ca7ec2714090f6328 P 6eb1d755e6cb48a7a36212e6dcdf7155 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 05:11:09.520548 21088 raft_consensus.cc:3037] T 033c8b6907eb4f0ca7ec2714090f6328 P 6eb1d755e6cb48a7a36212e6dcdf7155 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:11:09.521350 21088 raft_consensus.cc:504] T 033c8b6907eb4f0ca7ec2714090f6328 P 6eb1d755e6cb48a7a36212e6dcdf7155 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d8742784a64a76ad99371c0f72da2c" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 37069 } } peers { permanent_uuid: "6eb1d755e6cb48a7a36212e6dcdf7155" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 38813 } } peers { permanent_uuid: "a0916e4208f14bd8a51a53080d28caba" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 36645 } }
I20260811 05:11:09.521513 21088 leader_election.cc:288] T 033c8b6907eb4f0ca7ec2714090f6328 P 6eb1d755e6cb48a7a36212e6dcdf7155 [CANDIDATE]: Term 1 election: Requested vote from peers b9d8742784a64a76ad99371c0f72da2c (127.26.191.195:37069), a0916e4208f14bd8a51a53080d28caba (127.26.191.193:36645)
I20260811 05:11:09.521646 21238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "033c8b6907eb4f0ca7ec2714090f6328" candidate_uuid: "6eb1d755e6cb48a7a36212e6dcdf7155" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d8742784a64a76ad99371c0f72da2c"
I20260811 05:11:09.521673 20779 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "033c8b6907eb4f0ca7ec2714090f6328" candidate_uuid: "6eb1d755e6cb48a7a36212e6dcdf7155" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0916e4208f14bd8a51a53080d28caba"
I20260811 05:11:09.521759 21238 raft_consensus.cc:3037] T 033c8b6907eb4f0ca7ec2714090f6328 P b9d8742784a64a76ad99371c0f72da2c [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:11:09.521835 20779 raft_consensus.cc:3037] T 033c8b6907eb4f0ca7ec2714090f6328 P a0916e4208f14bd8a51a53080d28caba [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:11:09.522507 21238 raft_consensus.cc:2454] T 033c8b6907eb4f0ca7ec2714090f6328 P b9d8742784a64a76ad99371c0f72da2c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6eb1d755e6cb48a7a36212e6dcdf7155 in term 1.
I20260811 05:11:09.522650 20779 raft_consensus.cc:2454] T 033c8b6907eb4f0ca7ec2714090f6328 P a0916e4208f14bd8a51a53080d28caba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6eb1d755e6cb48a7a36212e6dcdf7155 in term 1.
I20260811 05:11:09.522679 20890 leader_election.cc:302] T 033c8b6907eb4f0ca7ec2714090f6328 P 6eb1d755e6cb48a7a36212e6dcdf7155 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6eb1d755e6cb48a7a36212e6dcdf7155, b9d8742784a64a76ad99371c0f72da2c; no voters:
I20260811 05:11:09.522799 21088 raft_consensus.cc:2781] T 033c8b6907eb4f0ca7ec2714090f6328 P 6eb1d755e6cb48a7a36212e6dcdf7155 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:11:09.523000 21088 raft_consensus.cc:686] T 033c8b6907eb4f0ca7ec2714090f6328 P 6eb1d755e6cb48a7a36212e6dcdf7155 [term 1 LEADER]: Becoming Leader. State: Replica: 6eb1d755e6cb48a7a36212e6dcdf7155, State: Running, Role: LEADER
I20260811 05:11:09.523100 21088 consensus_queue.cc:237] T 033c8b6907eb4f0ca7ec2714090f6328 P 6eb1d755e6cb48a7a36212e6dcdf7155 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d8742784a64a76ad99371c0f72da2c" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 37069 } } peers { permanent_uuid: "6eb1d755e6cb48a7a36212e6dcdf7155" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 38813 } } peers { permanent_uuid: "a0916e4208f14bd8a51a53080d28caba" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 36645 } }
I20260811 05:11:09.523999 20520 catalog_manager.cc:5495] T 033c8b6907eb4f0ca7ec2714090f6328 P 6eb1d755e6cb48a7a36212e6dcdf7155 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6eb1d755e6cb48a7a36212e6dcdf7155 (127.26.191.194). New cstate: current_term: 1 leader_uuid: "6eb1d755e6cb48a7a36212e6dcdf7155" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d8742784a64a76ad99371c0f72da2c" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 37069 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6eb1d755e6cb48a7a36212e6dcdf7155" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 38813 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0916e4208f14bd8a51a53080d28caba" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 36645 } health_report { overall_health: UNKNOWN } } }
I20260811 05:11:09.541244 21090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:09.538605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32966 (local address 127.26.191.194:38813)
0811 05:11:09.538670 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 05:11:09.538672 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:11:09.538683 (+ 11us) server_negotiation.cc:407] Connection header received
0811 05:11:09.538768 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:11:09.538769 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:11:09.538790 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:11:09.538872 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:11:09.539015 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:09.539546 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:09.540345 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:09.540553 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:09.540631 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:09.540878 (+ 247us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:11:09.540990 (+ 112us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:11:09.541081 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 05:11:09.541122 (+ 41us) server_negotiation.cc:299] Negotiation successful
0811 05:11:09.541146 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 05:11:09.543025 21238 raft_consensus.cc:1261] T 033c8b6907eb4f0ca7ec2714090f6328 P b9d8742784a64a76ad99371c0f72da2c [term 1 FOLLOWER]: Refusing update from remote peer 6eb1d755e6cb48a7a36212e6dcdf7155: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:11:09.543025 20779 raft_consensus.cc:1261] T 033c8b6907eb4f0ca7ec2714090f6328 P a0916e4208f14bd8a51a53080d28caba [term 1 FOLLOWER]: Refusing update from remote peer 6eb1d755e6cb48a7a36212e6dcdf7155: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:11:09.543440 21088 consensus_queue.cc:1035] T 033c8b6907eb4f0ca7ec2714090f6328 P 6eb1d755e6cb48a7a36212e6dcdf7155 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d8742784a64a76ad99371c0f72da2c" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 37069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:11:09.543587 21343 consensus_queue.cc:1035] T 033c8b6907eb4f0ca7ec2714090f6328 P 6eb1d755e6cb48a7a36212e6dcdf7155 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0916e4208f14bd8a51a53080d28caba" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 36645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:11:09.546051 21349 mvcc.cc:205] Tried to move back new op lower bound from 7317197084844961792 to 7317197084767293440. Current Snapshot: MvccSnapshot[applied={T|T < 7317197084844961792}]
I20260811 05:11:09.546571 21350 mvcc.cc:205] Tried to move back new op lower bound from 7317197084844961792 to 7317197084767293440. Current Snapshot: MvccSnapshot[applied={T|T < 7317197084844961792}]
I20260811 05:11:09.549240 20520 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48468:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:11:09.549330 20520 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48468:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:11:09.550086 20520 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ea8d771dbb754fa395a9c28a383f0178: Sending DeleteTablet for 3 replicas of tablet 033c8b6907eb4f0ca7ec2714090f6328
I20260811 05:11:09.550432 20746 tablet_service.cc:1514] Processing DeleteTablet for tablet 033c8b6907eb4f0ca7ec2714090f6328 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:11:09 UTC) from {username='kudu', principal='kudu/127.26.191.254@KRBTEST.COM'} at 127.0.0.1:38434
I20260811 05:11:09.550427 20964 tablet_service.cc:1514] Processing DeleteTablet for tablet 033c8b6907eb4f0ca7ec2714090f6328 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:11:09 UTC) from {username='kudu', principal='kudu/127.26.191.254@KRBTEST.COM'} at 127.0.0.1:32950
I20260811 05:11:09.550443 21200 tablet_service.cc:1514] Processing DeleteTablet for tablet 033c8b6907eb4f0ca7ec2714090f6328 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:11:09 UTC) from {username='kudu', principal='kudu/127.26.191.254@KRBTEST.COM'} at 127.0.0.1:37820
I20260811 05:11:09.550526 20863 tablet_replica.cc:330] T 033c8b6907eb4f0ca7ec2714090f6328 P a0916e4208f14bd8a51a53080d28caba: stopping tablet replica
I20260811 05:11:09.550570 20863 raft_consensus.cc:2229] T 033c8b6907eb4f0ca7ec2714090f6328 P a0916e4208f14bd8a51a53080d28caba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 05:11:09.550592 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 20586
I20260811 05:11:09.550616 20863 raft_consensus.cc:2258] T 033c8b6907eb4f0ca7ec2714090f6328 P a0916e4208f14bd8a51a53080d28caba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:11:09.550686 21091 tablet_replica.cc:330] T 033c8b6907eb4f0ca7ec2714090f6328 P 6eb1d755e6cb48a7a36212e6dcdf7155: stopping tablet replica
I20260811 05:11:09.550756 21091 raft_consensus.cc:2229] T 033c8b6907eb4f0ca7ec2714090f6328 P 6eb1d755e6cb48a7a36212e6dcdf7155 [term 1 LEADER]: Raft consensus shutting down.
I20260811 05:11:09.550845 21091 raft_consensus.cc:2258] T 033c8b6907eb4f0ca7ec2714090f6328 P 6eb1d755e6cb48a7a36212e6dcdf7155 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:11:09.551203 21091 ts_tablet_manager.cc:1905] T 033c8b6907eb4f0ca7ec2714090f6328 P 6eb1d755e6cb48a7a36212e6dcdf7155: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:11:09.552923 21091 ts_tablet_manager.cc:1918] T 033c8b6907eb4f0ca7ec2714090f6328 P 6eb1d755e6cb48a7a36212e6dcdf7155: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 05:11:09.552976 21091 log.cc:1196] T 033c8b6907eb4f0ca7ec2714090f6328 P 6eb1d755e6cb48a7a36212e6dcdf7155: Deleting WAL directory at /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-1/wal/wals/033c8b6907eb4f0ca7ec2714090f6328
I20260811 05:11:09.553179 21091 ts_tablet_manager.cc:1939] T 033c8b6907eb4f0ca7ec2714090f6328 P 6eb1d755e6cb48a7a36212e6dcdf7155: Deleting consensus metadata
I20260811 05:11:09.555171 20493 catalog_manager.cc:4841] TS 6eb1d755e6cb48a7a36212e6dcdf7155 (127.26.191.194:38813): tablet 033c8b6907eb4f0ca7ec2714090f6328 (table test-table [id=2bed9ee6f57643ef8b17f70170d73308]) successfully deleted
I20260811 05:11:09.556210 21365 tablet_replica.cc:330] T 033c8b6907eb4f0ca7ec2714090f6328 P b9d8742784a64a76ad99371c0f72da2c: stopping tablet replica
I20260811 05:11:09.556383 21365 raft_consensus.cc:2229] T 033c8b6907eb4f0ca7ec2714090f6328 P b9d8742784a64a76ad99371c0f72da2c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 05:11:09.556566 21365 raft_consensus.cc:2258] T 033c8b6907eb4f0ca7ec2714090f6328 P b9d8742784a64a76ad99371c0f72da2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:11:09.557696 21365 ts_tablet_manager.cc:1905] T 033c8b6907eb4f0ca7ec2714090f6328 P b9d8742784a64a76ad99371c0f72da2c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:11:09.560075 21365 ts_tablet_manager.cc:1918] T 033c8b6907eb4f0ca7ec2714090f6328 P b9d8742784a64a76ad99371c0f72da2c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 05:11:09.560189 21365 log.cc:1196] T 033c8b6907eb4f0ca7ec2714090f6328 P b9d8742784a64a76ad99371c0f72da2c: Deleting WAL directory at /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-2/wal/wals/033c8b6907eb4f0ca7ec2714090f6328
I20260811 05:11:09.560580 21365 ts_tablet_manager.cc:1939] T 033c8b6907eb4f0ca7ec2714090f6328 P b9d8742784a64a76ad99371c0f72da2c: Deleting consensus metadata
I20260811 05:11:09.564168 20493 catalog_manager.cc:4841] TS b9d8742784a64a76ad99371c0f72da2c (127.26.191.195:37069): tablet 033c8b6907eb4f0ca7ec2714090f6328 (table test-table [id=2bed9ee6f57643ef8b17f70170d73308]) successfully deleted
W20260811 05:11:09.571605 20492 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.191.193:36645 (error 108)
I20260811 05:11:09.571919 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 20859
I20260811 05:11:09.574719 20861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:09.574548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.193:36645 (local address 127.0.0.1:38450)
0811 05:11:09.574617 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:09.574670 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.193:36645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260811 05:11:09.574860 20492 catalog_manager.cc:4584] TS a0916e4208f14bd8a51a53080d28caba (127.26.191.193:36645): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 033c8b6907eb4f0ca7ec2714090f6328: Network error: Client connection negotiation failed: client connection to 127.26.191.193:36645: connect: Connection refused (error 111)
I20260811 05:11:09.584676 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 21089
I20260811 05:11:09.598423 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 20464
I20260811 05:11:29.610293 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.254:35153
--webserver_interface=127.26.191.254
--webserver_port=42835
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab
--principal=kudu/127.26.191.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:36843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.191.254:35153
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:11:29.700054 21367 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:11:29.700321 21367 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:11:29.700367 21367 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:11:29.701644 21367 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260811 05:11:29.701717 21367 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260811 05:11:29.701740 21367 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260811 05:11:29.701758 21367 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:11:29.701800 21367 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:11:29.701830 21367 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:11:29.701854 21367 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:11:29.701880 21367 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:11:29.703426 21367 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:36843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.26.191.254:35153
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab
--principal=kudu/127.26.191.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.254:35153
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.191.254
--webserver_port=42835
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21367
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:11:29.703732 21367 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:11:29.704007 21367 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:11:29.710201 21383 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:11:29.710253 21377 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:11:29.710299 21386 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:11:29.710204 21367 server_base.cc:1034] running on GCE node
I20260811 05:11:29.710732 21367 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:11:29.711119 21367 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:11:29.712324 21367 hybrid_clock.cc:648] HybridClock initialized: now 1786425089712306 us; error 49 us; skew 500 ppm
Aug 11 05:11:29 dist-test-slave-x5fp krb5kdc[19536](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425089, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:11:29.719146 21367 init.cc:377] Logged in from keytab as kudu/127.26.191.254@KRBTEST.COM (short username kudu)
I20260811 05:11:29.719659 21367 webserver.cc:460] Webserver started at http://127.26.191.254:42835/ using document root <none> and password file <none>
I20260811 05:11:29.719921 21367 fs_manager.cc:359] Metadata directory not provided
I20260811 05:11:29.719997 21367 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:11:29.721598 21367 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.000s
I20260811 05:11:29.722537 21397 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:11:29.723052 21367 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 05:11:29.723186 21367 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/master-0/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/master-0/wal
uuid: "ea8d771dbb754fa395a9c28a383f0178"
format_stamp: "Formatted at 2026-08-11 05:10:47 on dist-test-slave-x5fp"
server_key: "b4215ce217a7be6d831df908706b72fc"
server_key_iv: "1aedcdb52a6b5d1d6183dbd00bd4fa9e"
server_key_version: "encryptionkey@0"
I20260811 05:11:29.723577 21367 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:11:29.743873 21367 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:11:29.746589 21367 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:11:29.746815 21367 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:11:29.751458 21367 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.254:35153
I20260811 05:11:29.751498 21490 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.254:35153 every 8 connection(s)
I20260811 05:11:29.751900 21367 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
I20260811 05:11:29.753559 21492 sys_catalog.cc:263] Verifying existing consensus state
I20260811 05:11:29.754328 21492 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ea8d771dbb754fa395a9c28a383f0178: Bootstrap starting.
I20260811 05:11:29.757715 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 21367
I20260811 05:11:29.758062 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.191.193:36645
--local_ip_for_outbound_sockets=127.26.191.193
--tserver_master_addrs=127.26.191.254:35153
--webserver_port=44643
--webserver_interface=127.26.191.193
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.193.keytab
--principal=kudu/127.26.191.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:36843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 05:11:29.765476 21492 log.cc:824] T 00000000000000000000000000000000 P ea8d771dbb754fa395a9c28a383f0178: Log is configured to *not* fsync() on all Append() calls
I20260811 05:11:29.768036 21492 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ea8d771dbb754fa395a9c28a383f0178: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 05:11:29.768405 21492 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ea8d771dbb754fa395a9c28a383f0178: Bootstrap complete.
I20260811 05:11:29.770968 21492 raft_consensus.cc:348] T 00000000000000000000000000000000 P ea8d771dbb754fa395a9c28a383f0178 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea8d771dbb754fa395a9c28a383f0178" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 35153 } }
I20260811 05:11:29.771216 21492 raft_consensus.cc:729] T 00000000000000000000000000000000 P ea8d771dbb754fa395a9c28a383f0178 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea8d771dbb754fa395a9c28a383f0178, State: Initialized, Role: FOLLOWER
I20260811 05:11:29.771400 21492 consensus_queue.cc:260] T 00000000000000000000000000000000 P ea8d771dbb754fa395a9c28a383f0178 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea8d771dbb754fa395a9c28a383f0178" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 35153 } }
I20260811 05:11:29.771481 21492 raft_consensus.cc:388] T 00000000000000000000000000000000 P ea8d771dbb754fa395a9c28a383f0178 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:11:29.771538 21492 raft_consensus.cc:482] T 00000000000000000000000000000000 P ea8d771dbb754fa395a9c28a383f0178 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:11:29.771591 21492 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ea8d771dbb754fa395a9c28a383f0178 [term 2 FOLLOWER]: Advancing to term 3
I20260811 05:11:29.772686 21492 raft_consensus.cc:504] T 00000000000000000000000000000000 P ea8d771dbb754fa395a9c28a383f0178 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea8d771dbb754fa395a9c28a383f0178" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 35153 } }
I20260811 05:11:29.772871 21492 leader_election.cc:302] T 00000000000000000000000000000000 P ea8d771dbb754fa395a9c28a383f0178 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ea8d771dbb754fa395a9c28a383f0178; no voters:
I20260811 05:11:29.773104 21492 leader_election.cc:288] T 00000000000000000000000000000000 P ea8d771dbb754fa395a9c28a383f0178 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260811 05:11:29.773145 21497 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ea8d771dbb754fa395a9c28a383f0178 [term 3 FOLLOWER]: Leader election won for term 3
I20260811 05:11:29.773269 21497 raft_consensus.cc:686] T 00000000000000000000000000000000 P ea8d771dbb754fa395a9c28a383f0178 [term 3 LEADER]: Becoming Leader. State: Replica: ea8d771dbb754fa395a9c28a383f0178, State: Running, Role: LEADER
I20260811 05:11:29.773372 21497 consensus_queue.cc:237] T 00000000000000000000000000000000 P ea8d771dbb754fa395a9c28a383f0178 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea8d771dbb754fa395a9c28a383f0178" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 35153 } }
I20260811 05:11:29.773442 21492 sys_catalog.cc:564] T 00000000000000000000000000000000 P ea8d771dbb754fa395a9c28a383f0178 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:11:29.773638 21497 sys_catalog.cc:455] T 00000000000000000000000000000000 P ea8d771dbb754fa395a9c28a383f0178 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ea8d771dbb754fa395a9c28a383f0178. Latest consensus state: current_term: 3 leader_uuid: "ea8d771dbb754fa395a9c28a383f0178" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea8d771dbb754fa395a9c28a383f0178" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 35153 } } }
I20260811 05:11:29.773717 21497 sys_catalog.cc:458] T 00000000000000000000000000000000 P ea8d771dbb754fa395a9c28a383f0178 [sys.catalog]: This master's current role is: LEADER
I20260811 05:11:29.773659 21501 sys_catalog.cc:455] T 00000000000000000000000000000000 P ea8d771dbb754fa395a9c28a383f0178 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "ea8d771dbb754fa395a9c28a383f0178" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea8d771dbb754fa395a9c28a383f0178" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 35153 } } }
I20260811 05:11:29.773886 21501 sys_catalog.cc:458] T 00000000000000000000000000000000 P ea8d771dbb754fa395a9c28a383f0178 [sys.catalog]: This master's current role is: LEADER
I20260811 05:11:29.774868 21508 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:11:29.775604 21508 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:11:29.775734 21508 catalog_manager.cc:1259] Loaded cluster ID: a9cf77d6ad6b4c549accd9844fb2dcab
I20260811 05:11:29.775791 21508 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:11:29.776569 21508 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:11:29.776821 21508 catalog_manager.cc:5879] T 00000000000000000000000000000000 P ea8d771dbb754fa395a9c28a383f0178: Loaded TSK: 0
I20260811 05:11:29.776882 21508 catalog_manager.cc:5879] T 00000000000000000000000000000000 P ea8d771dbb754fa395a9c28a383f0178: Loaded TSK: 1
F20260811 05:11:29.777091 21508 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7ff85a94f9ad google::LogMessage::Fail() at ??:0
@ 0x7ff85a95288a google::LogMessage::SendToLog() at ??:0
@ 0x7ff85a94f4de google::LogMessage::Flush() at ??:0
@ 0x7ff85a950a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7ff85d0bc104 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7ff85d0b9d41 kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7ff8628a91cd kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7ff8628a948e kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7ff8628a9594 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7ff86286fc48 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7ff862879ad0 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7ff85c81d0d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7ff85c812954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7ff85d6766db start_thread at ??:0
@ 0x7ff85944d61f clone at ??:0
W20260811 05:11:29.861598 21495 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:11:29.861833 21495 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:11:29.861871 21495 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:11:29.863049 21495 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:11:29.863116 21495 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:11:29.863160 21495 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.191.193
I20260811 05:11:29.864665 21495 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:36843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.193.keytab
--principal=kudu/127.26.191.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.191.193:36645
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.191.193
--webserver_port=44643
--tserver_master_addrs=127.26.191.254:35153
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21495
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.191.193
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:11:29.864975 21495 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:11:29.865255 21495 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:11:29.870857 21552 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:11:29.870865 21553 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:11:29.870867 21558 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:11:29.871261 21495 server_base.cc:1034] running on GCE node
I20260811 05:11:29.871513 21495 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:11:29.871827 21495 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:11:29.873001 21495 hybrid_clock.cc:648] HybridClock initialized: now 1786425089872988 us; error 30 us; skew 500 ppm
Aug 11 05:11:29 dist-test-slave-x5fp krb5kdc[19536](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425089, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:11:29.876295 21495 init.cc:377] Logged in from keytab as kudu/127.26.191.193@KRBTEST.COM (short username kudu)
I20260811 05:11:29.876919 21495 webserver.cc:460] Webserver started at http://127.26.191.193:44643/ using document root <none> and password file <none>
I20260811 05:11:29.877213 21495 fs_manager.cc:359] Metadata directory not provided
I20260811 05:11:29.877262 21495 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:11:29.878751 21495 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 05:11:29.879539 21569 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:11:29.879787 21495 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:11:29.879908 21495 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-0/wal
uuid: "a0916e4208f14bd8a51a53080d28caba"
format_stamp: "Formatted at 2026-08-11 05:10:48 on dist-test-slave-x5fp"
server_key: "c02dbf53b00f159dc70028e7b3b48d2c"
server_key_iv: "e89fd6caa536e0ef2d903330b9dd1ae2"
server_key_version: "encryptionkey@0"
I20260811 05:11:29.880326 21495 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:11:29.901160 21495 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:11:29.903816 21495 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:11:29.904011 21495 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:11:29.904289 21495 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:11:29.904843 21580 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 05:11:29.907063 21495 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 05:11:29.907157 21495 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.003s user 0.000s sys 0.000s
I20260811 05:11:29.907202 21495 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 05:11:29.908178 21495 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 05:11:29.908262 21495 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260811 05:11:29.908347 21580 tablet_bootstrap.cc:492] T 033c8b6907eb4f0ca7ec2714090f6328 P a0916e4208f14bd8a51a53080d28caba: Bootstrap starting.
I20260811 05:11:29.916384 21495 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.193:36645
I20260811 05:11:29.916558 21765 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.193:36645 every 8 connection(s)
I20260811 05:11:29.916921 21495 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-0/data/info.pb
I20260811 05:11:29.920076 21580 log.cc:824] T 033c8b6907eb4f0ca7ec2714090f6328 P a0916e4208f14bd8a51a53080d28caba: Log is configured to *not* fsync() on all Append() calls
I20260811 05:11:29.923287 21580 tablet_bootstrap.cc:492] T 033c8b6907eb4f0ca7ec2714090f6328 P a0916e4208f14bd8a51a53080d28caba: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 05:11:29.923636 21580 tablet_bootstrap.cc:492] T 033c8b6907eb4f0ca7ec2714090f6328 P a0916e4208f14bd8a51a53080d28caba: Bootstrap complete.
I20260811 05:11:29.925007 21580 ts_tablet_manager.cc:1397] T 033c8b6907eb4f0ca7ec2714090f6328 P a0916e4208f14bd8a51a53080d28caba: Time spent bootstrapping tablet: real 0.017s user 0.009s sys 0.007s
I20260811 05:11:29.926230 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 21495
I20260811 05:11:29.926601 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.191.194:38813
--local_ip_for_outbound_sockets=127.26.191.194
--tserver_master_addrs=127.26.191.254:35153
--webserver_port=35331
--webserver_interface=127.26.191.194
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.194.keytab
--principal=kudu/127.26.191.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:36843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 05:11:29.926564 21580 raft_consensus.cc:348] T 033c8b6907eb4f0ca7ec2714090f6328 P a0916e4208f14bd8a51a53080d28caba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d8742784a64a76ad99371c0f72da2c" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 37069 } } peers { permanent_uuid: "6eb1d755e6cb48a7a36212e6dcdf7155" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 38813 } } peers { permanent_uuid: "a0916e4208f14bd8a51a53080d28caba" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 36645 } }
I20260811 05:11:29.926924 21580 raft_consensus.cc:729] T 033c8b6907eb4f0ca7ec2714090f6328 P a0916e4208f14bd8a51a53080d28caba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0916e4208f14bd8a51a53080d28caba, State: Initialized, Role: FOLLOWER
I20260811 05:11:29.927116 21580 consensus_queue.cc:260] T 033c8b6907eb4f0ca7ec2714090f6328 P a0916e4208f14bd8a51a53080d28caba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d8742784a64a76ad99371c0f72da2c" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 37069 } } peers { permanent_uuid: "6eb1d755e6cb48a7a36212e6dcdf7155" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 38813 } } peers { permanent_uuid: "a0916e4208f14bd8a51a53080d28caba" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 36645 } }
I20260811 05:11:29.927469 21580 ts_tablet_manager.cc:1428] T 033c8b6907eb4f0ca7ec2714090f6328 P a0916e4208f14bd8a51a53080d28caba: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
W20260811 05:11:30.005119 21768 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:11:29.917703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:35153 (local address 127.26.191.193:35529)
0811 05:11:29.917897 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:29.917945 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 05:11:29.918460 (+ 515us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:11:30.004851 (+ 86391us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:35153: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":113,"threads_started":1}
W20260811 05:11:30.005461 21766 heartbeater.cc:644] Failed to heartbeat to 127.26.191.254:35153 (0 consecutive failures): Network error: Failed to ping master at 127.26.191.254:35153: Client connection negotiation failed: client connection to 127.26.191.254:35153: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 05:11:30.005915 21768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:30.005763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:35153 (local address 127.26.191.193:54287)
0811 05:11:30.005829 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:30.005890 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:35153: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260811 05:11:30.006337 21768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:30.006224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:35153 (local address 127.26.191.193:36349)
0811 05:11:30.006279 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:30.006308 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:35153: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260811 05:11:30.006489 21766 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 05:11:30.021196 21773 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:11:30.021433 21773 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:11:30.021474 21773 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:11:30.022673 21773 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:11:30.022746 21773 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:11:30.022792 21773 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.191.194
I20260811 05:11:30.024279 21773 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:36843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.194.keytab
--principal=kudu/127.26.191.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.191.194:38813
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.191.194
--webserver_port=35331
--tserver_master_addrs=127.26.191.254:35153
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21773
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.191.194
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:11:30.024549 21773 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:11:30.024850 21773 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:11:30.030620 21785 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:11:30.030613 21788 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:11:30.030613 21782 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:11:30.031136 21773 server_base.cc:1034] running on GCE node
I20260811 05:11:30.031400 21773 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:11:30.031607 21773 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:11:30.032833 21773 hybrid_clock.cc:648] HybridClock initialized: now 1786425090032811 us; error 27 us; skew 500 ppm
Aug 11 05:11:30 dist-test-slave-x5fp krb5kdc[19536](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425090, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:11:30.035563 21773 init.cc:377] Logged in from keytab as kudu/127.26.191.194@KRBTEST.COM (short username kudu)
I20260811 05:11:30.036082 21773 webserver.cc:460] Webserver started at http://127.26.191.194:35331/ using document root <none> and password file <none>
I20260811 05:11:30.036343 21773 fs_manager.cc:359] Metadata directory not provided
I20260811 05:11:30.036397 21773 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:11:30.038051 21773 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:11:30.038831 21799 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:11:30.039117 21773 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:11:30.039258 21773 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-1/wal
uuid: "6eb1d755e6cb48a7a36212e6dcdf7155"
format_stamp: "Formatted at 2026-08-11 05:10:48 on dist-test-slave-x5fp"
server_key: "5c56ab43652dbb991c79e466e2879dad"
server_key_iv: "71bb3d65dea196d2e7f8a8967e8cfad9"
server_key_version: "encryptionkey@0"
I20260811 05:11:30.039688 21773 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:11:30.052484 21773 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:11:30.054905 21773 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:11:30.055100 21773 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:11:30.055385 21773 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:11:30.055744 21773 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:11:30.055792 21773 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:11:30.055819 21773 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:11:30.055858 21773 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:11:30.063136 21773 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.194:38813
I20260811 05:11:30.063195 22000 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.194:38813 every 8 connection(s)
I20260811 05:11:30.063591 21773 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-1/data/info.pb
I20260811 05:11:30.065089 22006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:30.064430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:35153 (local address 127.26.191.194:57867)
0811 05:11:30.064841 (+ 411us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:30.064930 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:35153: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":348,"thread_start_us":76,"threads_started":1}
W20260811 05:11:30.065585 22002 heartbeater.cc:644] Failed to heartbeat to 127.26.191.254:35153 (0 consecutive failures): Network error: Failed to ping master at 127.26.191.254:35153: Client connection negotiation failed: client connection to 127.26.191.254:35153: connect: Connection refused (error 111)
I20260811 05:11:30.066000 22006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:30.065862 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:35153 (local address 127.26.191.194:37529)
0811 05:11:30.065942 (+ 80us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:30.065975 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:35153: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260811 05:11:30.066352 22006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:30.066265 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:35153 (local address 127.26.191.194:48485)
0811 05:11:30.066308 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:30.066334 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:35153: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260811 05:11:30.066498 22002 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 05:11:30.069574 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 21773
I20260811 05:11:30.069885 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.191.195:37069
--local_ip_for_outbound_sockets=127.26.191.195
--tserver_master_addrs=127.26.191.254:35153
--webserver_port=35075
--webserver_interface=127.26.191.195
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.195.keytab
--principal=kudu/127.26.191.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:36843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:11:30.160105 22007 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:11:30.160394 22007 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:11:30.160437 22007 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:11:30.161674 22007 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:11:30.161756 22007 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:11:30.161803 22007 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.191.195
I20260811 05:11:30.163286 22007 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:36843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.195.keytab
--principal=kudu/127.26.191.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.191.195:37069
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.191.195
--webserver_port=35075
--tserver_master_addrs=127.26.191.254:35153
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22007
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.191.195
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:11:30.163560 22007 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:11:30.163820 22007 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:11:30.169122 22012 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:11:30.169267 22007 server_base.cc:1034] running on GCE node
W20260811 05:11:30.169134 22013 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:11:30.169122 22017 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:11:30.169637 22007 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:11:30.169871 22007 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:11:30.171041 22007 hybrid_clock.cc:648] HybridClock initialized: now 1786425090171029 us; error 27 us; skew 500 ppm
Aug 11 05:11:30 dist-test-slave-x5fp krb5kdc[19536](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425090, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:11:30.178788 22007 init.cc:377] Logged in from keytab as kudu/127.26.191.195@KRBTEST.COM (short username kudu)
I20260811 05:11:30.179291 22007 webserver.cc:460] Webserver started at http://127.26.191.195:35075/ using document root <none> and password file <none>
I20260811 05:11:30.179488 22007 fs_manager.cc:359] Metadata directory not provided
I20260811 05:11:30.179533 22007 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:11:30.181030 22007 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.001s
I20260811 05:11:30.181656 22037 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:11:30.181859 22007 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 05:11:30.181985 22007 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-2/wal
uuid: "b9d8742784a64a76ad99371c0f72da2c"
format_stamp: "Formatted at 2026-08-11 05:10:48 on dist-test-slave-x5fp"
server_key: "2bba353c97da7dc11dc022b8833b0c22"
server_key_iv: "552dc03385f07064afd938f5ff593dc3"
server_key_version: "encryptionkey@0"
I20260811 05:11:30.182382 22007 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:11:30.191915 22007 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:11:30.194423 22007 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:11:30.194545 22007 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:11:30.194746 22007 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:11:30.195076 22007 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:11:30.195117 22007 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:11:30.195142 22007 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:11:30.195153 22007 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:11:30.201794 22007 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.195:37069
I20260811 05:11:30.201843 22221 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.195:37069 every 8 connection(s)
I20260811 05:11:30.202216 22007 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424853995437-27391-0/minicluster-data/ts-2/data/info.pb
I20260811 05:11:30.203418 22225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:30.202961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:35153 (local address 127.26.191.195:49583)
0811 05:11:30.203153 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:30.203251 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:35153: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":77,"threads_started":1}
W20260811 05:11:30.203874 22223 heartbeater.cc:644] Failed to heartbeat to 127.26.191.254:35153 (0 consecutive failures): Network error: Failed to ping master at 127.26.191.254:35153: Client connection negotiation failed: client connection to 127.26.191.254:35153: connect: Connection refused (error 111)
I20260811 05:11:30.204241 22225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:30.204117 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:35153 (local address 127.26.191.195:57107)
0811 05:11:30.204170 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:30.204201 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:35153: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260811 05:11:30.204527 22225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:30.204471 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:35153 (local address 127.26.191.195:58793)
0811 05:11:30.204494 (+ 23us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:30.204514 (+ 20us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:35153: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":13}
W20260811 05:11:30.204640 22223 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 05:11:30.206872 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 22007
I20260811 05:11:31.007236 22227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:31.006938 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:35153 (local address 127.26.191.193:35833)
0811 05:11:31.007097 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:31.007144 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:35153: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":73,"threads_started":1}
I20260811 05:11:31.067106 22228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:31.066870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:35153 (local address 127.26.191.194:47339)
0811 05:11:31.067012 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:31.067052 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:35153: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":65,"threads_started":1}
I20260811 05:11:31.205204 22232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:31.204994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:35153 (local address 127.26.191.195:51853)
0811 05:11:31.205112 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:31.205149 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:35153: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":57,"threads_started":1}
I20260811 05:11:31.421367 22233 raft_consensus.cc:482] T 033c8b6907eb4f0ca7ec2714090f6328 P a0916e4208f14bd8a51a53080d28caba [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 05:11:31.421514 22233 raft_consensus.cc:504] T 033c8b6907eb4f0ca7ec2714090f6328 P a0916e4208f14bd8a51a53080d28caba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d8742784a64a76ad99371c0f72da2c" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 37069 } } peers { permanent_uuid: "6eb1d755e6cb48a7a36212e6dcdf7155" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 38813 } } peers { permanent_uuid: "a0916e4208f14bd8a51a53080d28caba" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 36645 } }
I20260811 05:11:31.421967 22233 leader_election.cc:288] T 033c8b6907eb4f0ca7ec2714090f6328 P a0916e4208f14bd8a51a53080d28caba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d8742784a64a76ad99371c0f72da2c (127.26.191.195:37069), 6eb1d755e6cb48a7a36212e6dcdf7155 (127.26.191.194:38813)
Aug 11 05:11:31 dist-test-slave-x5fp krb5kdc[19536](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425089, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.193@KRBTEST.COM for kudu/127.26.191.194@KRBTEST.COM
Aug 11 05:11:31 dist-test-slave-x5fp krb5kdc[19536](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425089, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.193@KRBTEST.COM for kudu/127.26.191.195@KRBTEST.COM
I20260811 05:11:31.434238 22235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:31.422451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.194:38813 (local address 127.26.191.193:36719)
0811 05:11:31.422658 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:31.422672 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 05:11:31.422707 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:11:31.423793 (+ 1086us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:11:31.423795 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:11:31.424094 (+ 299us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:11:31.424293 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:31.424299 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:31.425569 (+ 1270us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:31.425571 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:31.426442 (+ 871us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:31.426445 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:31.427384 (+ 939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:31.427385 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:31.427545 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:31.428314 (+ 769us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:11:31.428323 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:11:31.430236 (+ 1913us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:11:31.432394 (+ 2158us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:11:31.432402 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:11:31.432405 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:11:31.432656 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:11:31.432983 (+ 327us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:11:31.432983 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:11:31.432984 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:11:31.433127 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:11:31.433690 (+ 563us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:11:31.433699 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:11:31.433859 (+ 160us) client_negotiation.cc:769] Sending connection context
0811 05:11:31.433950 (+ 91us) client_negotiation.cc:240] Negotiation successful
0811 05:11:31.434106 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":196,"mutex_wait_us":9,"thread_start_us":70,"threads_started":1}
I20260811 05:11:31.434363 22238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:31.422551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.193:36719 (local address 127.26.191.194:38813)
0811 05:11:31.422747 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0811 05:11:31.422755 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 05:11:31.422825 (+ 70us) server_negotiation.cc:407] Connection header received
0811 05:11:31.423403 (+ 578us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:11:31.423406 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:11:31.423470 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:11:31.423648 (+ 178us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:11:31.424436 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:31.425445 (+ 1009us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:31.426603 (+ 1158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:31.427253 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:31.427388 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:31.430422 (+ 3034us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:11:31.430428 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:11:31.430429 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:11:31.430442 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:11:31.432295 (+ 1853us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:11:31.432773 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:11:31.432777 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:11:31.432777 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:11:31.432884 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:11:31.433233 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:11:31.433235 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:11:31.433235 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:11:31.433598 (+ 363us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:11:31.433706 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0811 05:11:31.434048 (+ 342us) server_negotiation.cc:299] Negotiation successful
0811 05:11:31.434235 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":167,"thread_start_us":86,"threads_started":1}
I20260811 05:11:31.434605 22237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:31.422481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.193:49213 (local address 127.26.191.195:37069)
0811 05:11:31.422643 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0811 05:11:31.422657 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 05:11:31.422698 (+ 41us) server_negotiation.cc:407] Connection header received
0811 05:11:31.423403 (+ 705us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:11:31.423407 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:11:31.423470 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:11:31.423647 (+ 177us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:11:31.424427 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:31.425463 (+ 1036us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:31.426549 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:31.427253 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:31.427388 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:31.430717 (+ 3329us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:11:31.430721 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:11:31.430722 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:11:31.430732 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:11:31.432862 (+ 2130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:11:31.433255 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:11:31.433259 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:11:31.433259 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:11:31.433399 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:11:31.433697 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:11:31.433698 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:11:31.433698 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:11:31.434026 (+ 328us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:11:31.434120 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0811 05:11:31.434329 (+ 209us) server_negotiation.cc:299] Negotiation successful
0811 05:11:31.434484 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":107,"thread_start_us":63,"threads_started":1}
I20260811 05:11:31.434446 22227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:31.422240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.195:37069 (local address 127.26.191.193:49213)
0811 05:11:31.422444 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:31.422460 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 05:11:31.422541 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:11:31.423689 (+ 1148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:11:31.423692 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:11:31.424090 (+ 398us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:11:31.424292 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:31.424298 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:31.425587 (+ 1289us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:31.425588 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:31.426442 (+ 854us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:31.426445 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:31.427384 (+ 939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:31.427385 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:31.427545 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:31.428402 (+ 857us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:11:31.428407 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:11:31.430595 (+ 2188us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:11:31.432946 (+ 2351us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:11:31.432947 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:11:31.432948 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:11:31.433167 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:11:31.433528 (+ 361us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:11:31.433529 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:11:31.433529 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:11:31.433595 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:11:31.434115 (+ 520us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:11:31.434116 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:11:31.434158 (+ 42us) client_negotiation.cc:769] Sending connection context
0811 05:11:31.434230 (+ 72us) client_negotiation.cc:240] Negotiation successful
0811 05:11:31.434324 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":175,"mutex_wait_us":63}
W20260811 05:11:31.435425 21573 leader_election.cc:341] T 033c8b6907eb4f0ca7ec2714090f6328 P a0916e4208f14bd8a51a53080d28caba [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6eb1d755e6cb48a7a36212e6dcdf7155 (127.26.191.194:38813): Not found: Tablet not found: 033c8b6907eb4f0ca7ec2714090f6328
W20260811 05:11:31.435590 21573 leader_election.cc:341] T 033c8b6907eb4f0ca7ec2714090f6328 P a0916e4208f14bd8a51a53080d28caba [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b9d8742784a64a76ad99371c0f72da2c (127.26.191.195:37069): Not found: Tablet not found: 033c8b6907eb4f0ca7ec2714090f6328
I20260811 05:11:31.435612 21573 leader_election.cc:302] T 033c8b6907eb4f0ca7ec2714090f6328 P a0916e4208f14bd8a51a53080d28caba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0916e4208f14bd8a51a53080d28caba; no voters: 6eb1d755e6cb48a7a36212e6dcdf7155, b9d8742784a64a76ad99371c0f72da2c
I20260811 05:11:31.435714 22233 raft_consensus.cc:2726] T 033c8b6907eb4f0ca7ec2714090f6328 P a0916e4208f14bd8a51a53080d28caba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 05:11:32.008183 22241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:32.007927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:35153 (local address 127.26.191.193:56195)
0811 05:11:32.008074 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:32.008122 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:35153: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":66,"threads_started":1}
I20260811 05:11:32.067970 22244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:32.067648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:35153 (local address 127.26.191.194:50699)
0811 05:11:32.067865 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:32.067909 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:35153: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":100,"threads_started":1}
I20260811 05:11:32.205881 22249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:32.205674 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:35153 (local address 127.26.191.195:42229)
0811 05:11:32.205792 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:32.205838 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:35153: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":64,"threads_started":1}
I20260811 05:11:33.009104 22250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:33.008848 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:35153 (local address 127.26.191.193:59347)
0811 05:11:33.008999 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:33.009049 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:35153: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":71,"threads_started":1}
I20260811 05:11:33.068950 22252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:33.068600 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:35153 (local address 127.26.191.194:60057)
0811 05:11:33.068854 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:33.068899 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:35153: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":233,"thread_start_us":84,"threads_started":1}
I20260811 05:11:33.206637 22253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:33.206365 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:35153 (local address 127.26.191.195:55499)
0811 05:11:33.206551 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:33.206592 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:35153: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":80,"threads_started":1}
I20260811 05:11:33.400836 22254 raft_consensus.cc:482] T 033c8b6907eb4f0ca7ec2714090f6328 P a0916e4208f14bd8a51a53080d28caba [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 05:11:33.400951 22254 raft_consensus.cc:504] T 033c8b6907eb4f0ca7ec2714090f6328 P a0916e4208f14bd8a51a53080d28caba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d8742784a64a76ad99371c0f72da2c" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 37069 } } peers { permanent_uuid: "6eb1d755e6cb48a7a36212e6dcdf7155" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 38813 } } peers { permanent_uuid: "a0916e4208f14bd8a51a53080d28caba" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 36645 } }
I20260811 05:11:33.401121 22254 leader_election.cc:288] T 033c8b6907eb4f0ca7ec2714090f6328 P a0916e4208f14bd8a51a53080d28caba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d8742784a64a76ad99371c0f72da2c (127.26.191.195:37069), 6eb1d755e6cb48a7a36212e6dcdf7155 (127.26.191.194:38813)
W20260811 05:11:33.401623 21573 leader_election.cc:341] T 033c8b6907eb4f0ca7ec2714090f6328 P a0916e4208f14bd8a51a53080d28caba [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b9d8742784a64a76ad99371c0f72da2c (127.26.191.195:37069): Not found: Tablet not found: 033c8b6907eb4f0ca7ec2714090f6328
W20260811 05:11:33.401710 21573 leader_election.cc:341] T 033c8b6907eb4f0ca7ec2714090f6328 P a0916e4208f14bd8a51a53080d28caba [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6eb1d755e6cb48a7a36212e6dcdf7155 (127.26.191.194:38813): Not found: Tablet not found: 033c8b6907eb4f0ca7ec2714090f6328
I20260811 05:11:33.401729 21573 leader_election.cc:302] T 033c8b6907eb4f0ca7ec2714090f6328 P a0916e4208f14bd8a51a53080d28caba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0916e4208f14bd8a51a53080d28caba; no voters: 6eb1d755e6cb48a7a36212e6dcdf7155, b9d8742784a64a76ad99371c0f72da2c
I20260811 05:11:33.401813 22254 raft_consensus.cc:2726] T 033c8b6907eb4f0ca7ec2714090f6328 P a0916e4208f14bd8a51a53080d28caba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 05:11:34.010037 22258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:34.009724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:35153 (local address 127.26.191.193:52493)
0811 05:11:34.009936 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:34.009984 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:35153: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":130,"threads_started":1}
I20260811 05:11:34.069763 22259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:34.069479 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:35153 (local address 127.26.191.194:58323)
0811 05:11:34.069635 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:34.069681 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:35153: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":65,"threads_started":1}
I20260811 05:11:34.207461 22262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:34.207215 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:35153 (local address 127.26.191.195:41807)
0811 05:11:34.207367 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:34.207411 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:35153: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":85,"threads_started":1}
I20260811 05:11:35.010890 22266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:35.010622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:35153 (local address 127.26.191.193:52887)
0811 05:11:35.010786 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:35.010835 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:35153: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":67,"threads_started":1}
I20260811 05:11:35.070576 22267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:35.070337 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:35153 (local address 127.26.191.194:59691)
0811 05:11:35.070481 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:35.070524 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:35153: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":61,"threads_started":1}
I20260811 05:11:35.208276 22269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:35.207994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:35153 (local address 127.26.191.195:40087)
0811 05:11:35.208156 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:35.208224 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:35153: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":74,"threads_started":1}
I20260811 05:11:36.011790 22273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:36.011494 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:35153 (local address 127.26.191.193:55387)
0811 05:11:36.011648 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:36.011693 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:35153: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":72,"threads_started":1}
I20260811 05:11:36.069335 22274 raft_consensus.cc:482] T 033c8b6907eb4f0ca7ec2714090f6328 P a0916e4208f14bd8a51a53080d28caba [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 05:11:36.069443 22274 raft_consensus.cc:504] T 033c8b6907eb4f0ca7ec2714090f6328 P a0916e4208f14bd8a51a53080d28caba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d8742784a64a76ad99371c0f72da2c" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 37069 } } peers { permanent_uuid: "6eb1d755e6cb48a7a36212e6dcdf7155" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 38813 } } peers { permanent_uuid: "a0916e4208f14bd8a51a53080d28caba" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 36645 } }
I20260811 05:11:36.069574 22274 leader_election.cc:288] T 033c8b6907eb4f0ca7ec2714090f6328 P a0916e4208f14bd8a51a53080d28caba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d8742784a64a76ad99371c0f72da2c (127.26.191.195:37069), 6eb1d755e6cb48a7a36212e6dcdf7155 (127.26.191.194:38813)
W20260811 05:11:36.070137 21573 leader_election.cc:341] T 033c8b6907eb4f0ca7ec2714090f6328 P a0916e4208f14bd8a51a53080d28caba [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b9d8742784a64a76ad99371c0f72da2c (127.26.191.195:37069): Not found: Tablet not found: 033c8b6907eb4f0ca7ec2714090f6328
W20260811 05:11:36.070231 21573 leader_election.cc:341] T 033c8b6907eb4f0ca7ec2714090f6328 P a0916e4208f14bd8a51a53080d28caba [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6eb1d755e6cb48a7a36212e6dcdf7155 (127.26.191.194:38813): Not found: Tablet not found: 033c8b6907eb4f0ca7ec2714090f6328
I20260811 05:11:36.070282 21573 leader_election.cc:302] T 033c8b6907eb4f0ca7ec2714090f6328 P a0916e4208f14bd8a51a53080d28caba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0916e4208f14bd8a51a53080d28caba; no voters: 6eb1d755e6cb48a7a36212e6dcdf7155, b9d8742784a64a76ad99371c0f72da2c
I20260811 05:11:36.070384 22274 raft_consensus.cc:2726] T 033c8b6907eb4f0ca7ec2714090f6328 P a0916e4208f14bd8a51a53080d28caba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 05:11:36.071322 22277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:36.071089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:35153 (local address 127.26.191.194:48297)
0811 05:11:36.071233 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:36.071276 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:35153: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":54,"threads_started":1}
I20260811 05:11:36.209275 22279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:36.208954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:35153 (local address 127.26.191.195:45247)
0811 05:11:36.209147 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:36.209204 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:35153: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":108,"threads_started":1}
I20260811 05:11:37.012678 22280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:37.012372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:35153 (local address 127.26.191.193:40671)
0811 05:11:37.012578 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:37.012625 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:35153: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":104,"threads_started":1}
I20260811 05:11:37.072109 22283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:37.071820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:35153 (local address 127.26.191.194:33005)
0811 05:11:37.072007 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:37.072057 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:35153: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":67,"threads_started":1}
I20260811 05:11:37.210119 22284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:37.209810 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:35153 (local address 127.26.191.195:37835)
0811 05:11:37.210000 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:37.210061 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:35153: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":89,"threads_started":1}
I20260811 05:11:38.013602 22285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:38.013323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:35153 (local address 127.26.191.193:50369)
0811 05:11:38.013500 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:38.013544 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:35153: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":74,"threads_started":1}
I20260811 05:11:38.073004 22287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:38.072691 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:35153 (local address 127.26.191.194:59587)
0811 05:11:38.072904 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:38.072950 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:35153: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":138,"threads_started":1}
I20260811 05:11:38.211024 22289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:38.210716 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:35153 (local address 127.26.191.195:43339)
0811 05:11:38.210921 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:38.210970 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:35153: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":114,"threads_started":1}
I20260811 05:11:39.014484 22291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:39.014246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:35153 (local address 127.26.191.193:39787)
0811 05:11:39.014386 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:39.014432 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:35153: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":69,"threads_started":1}
I20260811 05:11:39.073899 22292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:39.073618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:35153 (local address 127.26.191.194:56299)
0811 05:11:39.073794 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:39.073844 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:35153: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":68,"threads_started":1}
I20260811 05:11:39.211891 22293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:39.211614 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:35153 (local address 127.26.191.195:56387)
0811 05:11:39.211760 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:39.211837 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:35153: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":73,"threads_started":1}
I20260811 05:11:39.334764 22300 raft_consensus.cc:482] T 033c8b6907eb4f0ca7ec2714090f6328 P a0916e4208f14bd8a51a53080d28caba [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 05:11:39.334937 22300 raft_consensus.cc:504] T 033c8b6907eb4f0ca7ec2714090f6328 P a0916e4208f14bd8a51a53080d28caba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d8742784a64a76ad99371c0f72da2c" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 37069 } } peers { permanent_uuid: "6eb1d755e6cb48a7a36212e6dcdf7155" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 38813 } } peers { permanent_uuid: "a0916e4208f14bd8a51a53080d28caba" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 36645 } }
I20260811 05:11:39.335177 22300 leader_election.cc:288] T 033c8b6907eb4f0ca7ec2714090f6328 P a0916e4208f14bd8a51a53080d28caba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d8742784a64a76ad99371c0f72da2c (127.26.191.195:37069), 6eb1d755e6cb48a7a36212e6dcdf7155 (127.26.191.194:38813)
W20260811 05:11:39.335640 21573 leader_election.cc:341] T 033c8b6907eb4f0ca7ec2714090f6328 P a0916e4208f14bd8a51a53080d28caba [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6eb1d755e6cb48a7a36212e6dcdf7155 (127.26.191.194:38813): Not found: Tablet not found: 033c8b6907eb4f0ca7ec2714090f6328
W20260811 05:11:39.335764 21573 leader_election.cc:341] T 033c8b6907eb4f0ca7ec2714090f6328 P a0916e4208f14bd8a51a53080d28caba [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b9d8742784a64a76ad99371c0f72da2c (127.26.191.195:37069): Not found: Tablet not found: 033c8b6907eb4f0ca7ec2714090f6328
I20260811 05:11:39.335785 21573 leader_election.cc:302] T 033c8b6907eb4f0ca7ec2714090f6328 P a0916e4208f14bd8a51a53080d28caba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0916e4208f14bd8a51a53080d28caba; no voters: 6eb1d755e6cb48a7a36212e6dcdf7155, b9d8742784a64a76ad99371c0f72da2c
I20260811 05:11:39.335868 22300 raft_consensus.cc:2726] T 033c8b6907eb4f0ca7ec2714090f6328 P a0916e4208f14bd8a51a53080d28caba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 05:11:40.015281 22301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:40.015039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:35153 (local address 127.26.191.193:47779)
0811 05:11:40.015185 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:40.015228 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:35153: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":79,"threads_started":1}
I20260811 05:11:40.074786 22303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:40.074518 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:35153 (local address 127.26.191.194:42721)
0811 05:11:40.074674 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:40.074728 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:35153: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":76,"threads_started":1}
I20260811 05:11:40.212968 22307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:40.212602 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:35153 (local address 127.26.191.195:45459)
0811 05:11:40.212860 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:40.212912 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:35153: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":129,"threads_started":1}
I20260811 05:11:41.016086 22309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:41.015815 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:35153 (local address 127.26.191.193:46485)
0811 05:11:41.015987 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:41.016034 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:35153: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":72,"threads_started":1}
I20260811 05:11:41.075744 22310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:41.075446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:35153 (local address 127.26.191.194:59961)
0811 05:11:41.075643 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:41.075692 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:35153: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":102,"threads_started":1}
I20260811 05:11:41.213869 22312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:41.213571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:35153 (local address 127.26.191.195:39425)
0811 05:11:41.213723 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:41.213815 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:35153: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":69,"threads_started":1}
I20260811 05:11:42.017019 22313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:42.016697 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:35153 (local address 127.26.191.193:46911)
0811 05:11:42.016907 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:42.016965 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:35153: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":134,"threads_started":1}
I20260811 05:11:42.076694 22315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:42.076422 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:35153 (local address 127.26.191.194:36257)
0811 05:11:42.076587 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:42.076637 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:35153: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":75,"threads_started":1}
I20260811 05:11:42.214844 22316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:42.214556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:35153 (local address 127.26.191.195:35869)
0811 05:11:42.214713 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:42.214789 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:35153: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":69,"threads_started":1}
I20260811 05:11:43.017853 22319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:43.017589 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:35153 (local address 127.26.191.193:44213)
0811 05:11:43.017739 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:43.017787 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:35153: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":69,"threads_started":1}
I20260811 05:11:43.077610 22320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:43.077344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:35153 (local address 127.26.191.194:57129)
0811 05:11:43.077501 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:43.077554 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:35153: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":76,"threads_started":1}
I20260811 05:11:43.215790 22321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:43.215509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:35153 (local address 127.26.191.195:44137)
0811 05:11:43.215679 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:43.215736 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:35153: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":74,"threads_started":1}
I20260811 05:11:44.018635 22322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:44.018406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:35153 (local address 127.26.191.193:42871)
0811 05:11:44.018544 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:44.018583 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:35153: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":72,"threads_started":1}
I20260811 05:11:44.078660 22324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:44.078348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:35153 (local address 127.26.191.194:55259)
0811 05:11:44.078556 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:44.078605 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:35153: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":105,"threads_started":1}
I20260811 05:11:44.162140 22329 raft_consensus.cc:482] T 033c8b6907eb4f0ca7ec2714090f6328 P a0916e4208f14bd8a51a53080d28caba [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 05:11:44.162263 22329 raft_consensus.cc:504] T 033c8b6907eb4f0ca7ec2714090f6328 P a0916e4208f14bd8a51a53080d28caba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d8742784a64a76ad99371c0f72da2c" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 37069 } } peers { permanent_uuid: "6eb1d755e6cb48a7a36212e6dcdf7155" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 38813 } } peers { permanent_uuid: "a0916e4208f14bd8a51a53080d28caba" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 36645 } }
I20260811 05:11:44.162431 22329 leader_election.cc:288] T 033c8b6907eb4f0ca7ec2714090f6328 P a0916e4208f14bd8a51a53080d28caba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d8742784a64a76ad99371c0f72da2c (127.26.191.195:37069), 6eb1d755e6cb48a7a36212e6dcdf7155 (127.26.191.194:38813)
W20260811 05:11:44.162999 21573 leader_election.cc:341] T 033c8b6907eb4f0ca7ec2714090f6328 P a0916e4208f14bd8a51a53080d28caba [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b9d8742784a64a76ad99371c0f72da2c (127.26.191.195:37069): Not found: Tablet not found: 033c8b6907eb4f0ca7ec2714090f6328
W20260811 05:11:44.163097 21573 leader_election.cc:341] T 033c8b6907eb4f0ca7ec2714090f6328 P a0916e4208f14bd8a51a53080d28caba [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6eb1d755e6cb48a7a36212e6dcdf7155 (127.26.191.194:38813): Not found: Tablet not found: 033c8b6907eb4f0ca7ec2714090f6328
I20260811 05:11:44.163149 21573 leader_election.cc:302] T 033c8b6907eb4f0ca7ec2714090f6328 P a0916e4208f14bd8a51a53080d28caba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0916e4208f14bd8a51a53080d28caba; no voters: 6eb1d755e6cb48a7a36212e6dcdf7155, b9d8742784a64a76ad99371c0f72da2c
I20260811 05:11:44.163230 22329 raft_consensus.cc:2726] T 033c8b6907eb4f0ca7ec2714090f6328 P a0916e4208f14bd8a51a53080d28caba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 05:11:44.216658 22332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:44.216368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:35153 (local address 127.26.191.195:46851)
0811 05:11:44.216543 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:44.216594 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:35153: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":82,"threads_started":1}
I20260811 05:11:45.019593 22334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:45.019335 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:35153 (local address 127.26.191.193:54855)
0811 05:11:45.019494 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:45.019541 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:35153: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":73,"threads_started":1}
I20260811 05:11:45.079981 22335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:45.079504 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:35153 (local address 127.26.191.194:33341)
0811 05:11:45.079888 (+ 384us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:45.079928 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:35153: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":359,"thread_start_us":315,"threads_started":1}
I20260811 05:11:45.207861 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 21495
I20260811 05:11:45.219166 22336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:45.217705 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:35153 (local address 127.26.191.195:57391)
0811 05:11:45.219036 (+ 1331us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:45.219092 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.254:35153: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1307,"thread_start_us":1249,"threads_started":1}
I20260811 05:11:45.224154 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 21773
I20260811 05:11:45.236020 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 22007
2026-08-11T05:11:45Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (58973 ms)
[----------] 30 tests from SecurityITest (251256 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424853995437-27391-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 05:11:45 dist-test-slave-x5fp krb5kdc[22346](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 05:11:45 dist-test-slave-x5fp krb5kdc[22346](info): set up 2 sockets
Aug 11 05:11:45 dist-test-slave-x5fp krb5kdc[22346](info): commencing operation
krb5kdc: starting...
W20260811 05:11:46.609001 27391 mini_kdc.cc:121] Time spent starting KDC: real 1.338s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424853995437-27391-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424853995437-27391-0/krb5kdc/test-user.keytab.
Aug 11 05:11:46 dist-test-slave-x5fp krb5kdc[22346](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425106, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T05:11:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:11:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.191.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.191.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.191.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab.
Entry for principal kudu/127.26.191.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab.
I20260811 05:11:46.739869 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424853995437-27391-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424853995437-27391-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424853995437-27391-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.254:40439
--webserver_interface=127.26.191.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab
--principal=kudu/127.26.191.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:32899
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.191.254:40439
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:11:46.824183 22368 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:11:46.824426 22368 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:11:46.824450 22368 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:11:46.825593 22368 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:11:46.825631 22368 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:11:46.825646 22368 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:11:46.825659 22368 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:11:46.825671 22368 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:11:46.827096 22368 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:32899
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424853995437-27391-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424853995437-27391-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.191.254:40439
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab
--principal=kudu/127.26.191.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.254:40439
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.191.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22368
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424853995437-27391-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:11:46.827312 22368 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:11:46.827493 22368 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 05:11:46.832691 22368 server_base.cc:1034] running on GCE node
W20260811 05:11:46.832656 22379 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:11:46.832806 22381 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:11:46.832681 22378 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:11:46.833233 22368 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:11:46.833546 22368 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:11:46.834739 22368 hybrid_clock.cc:648] HybridClock initialized: now 1786425106834722 us; error 51 us; skew 500 ppm
Aug 11 05:11:46 dist-test-slave-x5fp krb5kdc[22346](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425106, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:11:46.842304 22368 init.cc:377] Logged in from keytab as kudu/127.26.191.254@KRBTEST.COM (short username kudu)
I20260811 05:11:46.842840 22368 webserver.cc:460] Webserver started at http://127.26.191.254:37391/ using document root <none> and password file <none>
I20260811 05:11:46.843080 22368 fs_manager.cc:359] Metadata directory not provided
I20260811 05:11:46.843153 22368 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:11:46.843313 22368 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:11:46.844442 22368 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424853995437-27391-0/minicluster-data/master-0/data/instance:
uuid: "7590907fb0894b428438111bb1c3458e"
format_stamp: "Formatted at 2026-08-11 05:11:46 on dist-test-slave-x5fp"
server_key: "2fbca3c5228e7486daece4ff9684b46b"
server_key_iv: "9b62f3e50f814799eb28feeaa92b0f6b"
server_key_version: "encryptionkey@0"
I20260811 05:11:46.844903 22368 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424853995437-27391-0/minicluster-data/master-0/wal/instance:
uuid: "7590907fb0894b428438111bb1c3458e"
format_stamp: "Formatted at 2026-08-11 05:11:46 on dist-test-slave-x5fp"
server_key: "2fbca3c5228e7486daece4ff9684b46b"
server_key_iv: "9b62f3e50f814799eb28feeaa92b0f6b"
server_key_version: "encryptionkey@0"
I20260811 05:11:46.846371 22368 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 05:11:46.847242 22391 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:11:46.847474 22368 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 05:11:46.847590 22368 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424853995437-27391-0/minicluster-data/master-0/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424853995437-27391-0/minicluster-data/master-0/wal
uuid: "7590907fb0894b428438111bb1c3458e"
format_stamp: "Formatted at 2026-08-11 05:11:46 on dist-test-slave-x5fp"
server_key: "2fbca3c5228e7486daece4ff9684b46b"
server_key_iv: "9b62f3e50f814799eb28feeaa92b0f6b"
server_key_version: "encryptionkey@0"
I20260811 05:11:46.847669 22368 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424853995437-27391-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424853995437-27391-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424853995437-27391-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:11:46.861516 22368 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:11:46.863804 22368 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:11:46.863986 22368 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:11:46.868630 22368 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.254:40439
I20260811 05:11:46.868670 22472 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.254:40439 every 8 connection(s)
I20260811 05:11:46.869135 22368 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
I20260811 05:11:46.870204 22476 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:11:46.873042 22476 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7590907fb0894b428438111bb1c3458e: Bootstrap starting.
I20260811 05:11:46.873795 22476 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7590907fb0894b428438111bb1c3458e: Neither blocks nor log segments found. Creating new log.
I20260811 05:11:46.874174 22476 log.cc:824] T 00000000000000000000000000000000 P 7590907fb0894b428438111bb1c3458e: Log is configured to *not* fsync() on all Append() calls
I20260811 05:11:46.875078 22476 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7590907fb0894b428438111bb1c3458e: No bootstrap required, opened a new log
I20260811 05:11:46.876108 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 22368
I20260811 05:11:46.876225 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424853995437-27391-0/minicluster-data/master-0/wal/instance
I20260811 05:11:46.876446 27391 external_mini_cluster.cc:1428] Setting key 059689ef08a45eacf0c6ced5bcae9e41
I20260811 05:11:46.877550 22476 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7590907fb0894b428438111bb1c3458e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7590907fb0894b428438111bb1c3458e" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 40439 } }
I20260811 05:11:46.877754 22476 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7590907fb0894b428438111bb1c3458e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:11:46.877800 22476 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7590907fb0894b428438111bb1c3458e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7590907fb0894b428438111bb1c3458e, State: Initialized, Role: FOLLOWER
I20260811 05:11:46.877954 22476 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7590907fb0894b428438111bb1c3458e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7590907fb0894b428438111bb1c3458e" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 40439 } }
I20260811 05:11:46.878053 22476 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7590907fb0894b428438111bb1c3458e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:11:46.878093 22476 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7590907fb0894b428438111bb1c3458e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:11:46.878139 22476 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7590907fb0894b428438111bb1c3458e [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:11:46.879215 22476 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7590907fb0894b428438111bb1c3458e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7590907fb0894b428438111bb1c3458e" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 40439 } }
I20260811 05:11:46.879324 22476 leader_election.cc:302] T 00000000000000000000000000000000 P 7590907fb0894b428438111bb1c3458e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7590907fb0894b428438111bb1c3458e; no voters:
I20260811 05:11:46.879508 22476 leader_election.cc:288] T 00000000000000000000000000000000 P 7590907fb0894b428438111bb1c3458e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 05:11:46.879570 22486 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7590907fb0894b428438111bb1c3458e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:11:46.879750 22486 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7590907fb0894b428438111bb1c3458e [term 1 LEADER]: Becoming Leader. State: Replica: 7590907fb0894b428438111bb1c3458e, State: Running, Role: LEADER
I20260811 05:11:46.879823 22476 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7590907fb0894b428438111bb1c3458e [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:11:46.879890 22486 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7590907fb0894b428438111bb1c3458e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7590907fb0894b428438111bb1c3458e" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 40439 } }
I20260811 05:11:46.880357 22487 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7590907fb0894b428438111bb1c3458e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7590907fb0894b428438111bb1c3458e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7590907fb0894b428438111bb1c3458e" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 40439 } } }
I20260811 05:11:46.880439 22487 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7590907fb0894b428438111bb1c3458e [sys.catalog]: This master's current role is: LEADER
I20260811 05:11:46.880713 22488 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7590907fb0894b428438111bb1c3458e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7590907fb0894b428438111bb1c3458e. Latest consensus state: current_term: 1 leader_uuid: "7590907fb0894b428438111bb1c3458e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7590907fb0894b428438111bb1c3458e" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 40439 } } }
I20260811 05:11:46.880868 22488 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7590907fb0894b428438111bb1c3458e [sys.catalog]: This master's current role is: LEADER
I20260811 05:11:46.881057 22496 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:11:46.881580 22496 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:11:46.883579 22496 catalog_manager.cc:1347] Generated new cluster ID: b7decb844f8a4c648fcbc7f6205f0aa4
I20260811 05:11:46.883634 22496 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 05:11:46 dist-test-slave-x5fp krb5kdc[22346](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425106, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
I20260811 05:11:46.888880 22485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:46.877132 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39076 (local address 127.26.191.254:40439)
0811 05:11:46.877333 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0811 05:11:46.877341 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 05:11:46.877374 (+ 33us) server_negotiation.cc:407] Connection header received
0811 05:11:46.877501 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:11:46.877507 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:11:46.877553 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:11:46.877670 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:11:46.878711 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:46.880026 (+ 1315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:46.881238 (+ 1212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:46.881882 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:46.881995 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:46.884972 (+ 2977us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:11:46.884976 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:11:46.884977 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:11:46.884990 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:11:46.887040 (+ 2050us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:11:46.887492 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:11:46.887495 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:11:46.887496 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:11:46.887634 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:11:46.887896 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:11:46.887897 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:11:46.887897 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:11:46.888213 (+ 316us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:11:46.888360 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0811 05:11:46.888492 (+ 132us) server_negotiation.cc:299] Negotiation successful
0811 05:11:46.888633 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":74,"threads_started":1}
I20260811 05:11:46.913805 22496 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:11:46.914762 22496 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:11:46.918406 22496 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7590907fb0894b428438111bb1c3458e: Generated new TSK 0
I20260811 05:11:46.918632 22496 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.191.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.191.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.191.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.193.keytab.
Entry for principal kudu/127.26.191.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.193.keytab.
I20260811 05:11:46.948628 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424853995437-27391-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424853995437-27391-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424853995437-27391-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424853995437-27391-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.191.193:0
--local_ip_for_outbound_sockets=127.26.191.193
--webserver_interface=127.26.191.193
--webserver_port=0
--tserver_master_addrs=127.26.191.254:40439
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.193.keytab
--principal=kudu/127.26.191.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:32899
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:11:47.041079 22519 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:11:47.041365 22519 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:11:47.041414 22519 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:11:47.042645 22519 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:11:47.042729 22519 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:11:47.042778 22519 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.191.193
I20260811 05:11:47.044387 22519 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:32899
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424853995437-27391-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424853995437-27391-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.193.keytab
--principal=kudu/127.26.191.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.191.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424853995437-27391-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.191.193
--webserver_port=0
--tserver_master_addrs=127.26.191.254:40439
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22519
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.191.193
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424853995437-27391-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:11:47.044699 22519 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:11:47.045012 22519 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:11:47.050752 22530 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:11:47.050803 22529 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:11:47.050752 22534 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:11:47.051012 22519 server_base.cc:1034] running on GCE node
I20260811 05:11:47.051298 22519 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:11:47.051568 22519 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:11:47.052831 22519 hybrid_clock.cc:648] HybridClock initialized: now 1786425107052808 us; error 39 us; skew 500 ppm
Aug 11 05:11:47 dist-test-slave-x5fp krb5kdc[22346](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425107, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:11:47.055730 22519 init.cc:377] Logged in from keytab as kudu/127.26.191.193@KRBTEST.COM (short username kudu)
I20260811 05:11:47.056263 22519 webserver.cc:460] Webserver started at http://127.26.191.193:32925/ using document root <none> and password file <none>
I20260811 05:11:47.056540 22519 fs_manager.cc:359] Metadata directory not provided
I20260811 05:11:47.056588 22519 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:11:47.056790 22519 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:11:47.057955 22519 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424853995437-27391-0/minicluster-data/ts-0/data/instance:
uuid: "3ce7637ba68145d7998cffcc6cb56ad2"
format_stamp: "Formatted at 2026-08-11 05:11:47 on dist-test-slave-x5fp"
server_key: "d6dfdcfe497174ca30c0cf46d1e54022"
server_key_iv: "53ff24faeeca4dc640b5c8dfc13b40de"
server_key_version: "encryptionkey@0"
I20260811 05:11:47.058346 22519 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424853995437-27391-0/minicluster-data/ts-0/wal/instance:
uuid: "3ce7637ba68145d7998cffcc6cb56ad2"
format_stamp: "Formatted at 2026-08-11 05:11:47 on dist-test-slave-x5fp"
server_key: "d6dfdcfe497174ca30c0cf46d1e54022"
server_key_iv: "53ff24faeeca4dc640b5c8dfc13b40de"
server_key_version: "encryptionkey@0"
I20260811 05:11:47.059845 22519 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 05:11:47.060997 22543 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:11:47.061357 22519 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 05:11:47.061503 22519 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424853995437-27391-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424853995437-27391-0/minicluster-data/ts-0/wal
uuid: "3ce7637ba68145d7998cffcc6cb56ad2"
format_stamp: "Formatted at 2026-08-11 05:11:47 on dist-test-slave-x5fp"
server_key: "d6dfdcfe497174ca30c0cf46d1e54022"
server_key_iv: "53ff24faeeca4dc640b5c8dfc13b40de"
server_key_version: "encryptionkey@0"
I20260811 05:11:47.061596 22519 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424853995437-27391-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424853995437-27391-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424853995437-27391-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:11:47.093107 22519 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:11:47.095672 22519 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:11:47.095886 22519 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:11:47.096184 22519 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:11:47.096601 22519 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:11:47.096666 22519 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:11:47.096715 22519 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:11:47.096805 22519 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:11:47.104038 22519 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.193:38365
I20260811 05:11:47.104162 22741 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.193:38365 every 8 connection(s)
I20260811 05:11:47.104564 22519 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424853995437-27391-0/minicluster-data/ts-0/data/info.pb
I20260811 05:11:47.106192 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 22519
I20260811 05:11:47.106323 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424853995437-27391-0/minicluster-data/ts-0/wal/instance
I20260811 05:11:47.106534 27391 external_mini_cluster.cc:1428] Setting key fcf5f6d4635b5ee01aeae56cfbcf6a08
Aug 11 05:11:47 dist-test-slave-x5fp krb5kdc[22346](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425107, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.193@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.26.191.194@KRBTEST.COM; defaulting to no policy
I20260811 05:11:47.117178 22485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:47.105571 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.193:38847 (local address 127.26.191.254:40439)
0811 05:11:47.105749 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0811 05:11:47.105751 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:11:47.105840 (+ 89us) server_negotiation.cc:407] Connection header received
0811 05:11:47.106652 (+ 812us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:11:47.106654 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:11:47.106669 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:11:47.106828 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:11:47.108410 (+ 1582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:47.109160 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:47.110272 (+ 1112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:47.110500 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:47.110584 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:47.113460 (+ 2876us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:11:47.113462 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:11:47.113462 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:11:47.113475 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:11:47.115453 (+ 1978us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:11:47.115900 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:11:47.115901 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:11:47.115901 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:11:47.115972 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:11:47.116299 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:11:47.116300 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:11:47.116300 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:11:47.116471 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:11:47.116556 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0811 05:11:47.116921 (+ 365us) server_negotiation.cc:299] Negotiation successful
0811 05:11:47.117053 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145}
I20260811 05:11:47.117332 22749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:47.105501 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:40439 (local address 127.26.191.193:38847)
0811 05:11:47.105697 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:47.105752 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0811 05:11:47.106515 (+ 763us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:11:47.107018 (+ 503us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:11:47.107022 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:11:47.107942 (+ 920us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:11:47.108254 (+ 312us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:47.108262 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:47.109299 (+ 1037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:47.109300 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:47.110143 (+ 843us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:47.110146 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:47.110599 (+ 453us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:47.110600 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:47.110745 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:47.111475 (+ 730us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:11:47.111495 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:11:47.113333 (+ 1838us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:11:47.115551 (+ 2218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:11:47.115559 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:11:47.115561 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:11:47.115812 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:11:47.116077 (+ 265us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:11:47.116078 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:11:47.116078 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:11:47.116209 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:11:47.116550 (+ 341us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:11:47.116556 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:11:47.116700 (+ 144us) client_negotiation.cc:769] Sending connection context
0811 05:11:47.116875 (+ 175us) client_negotiation.cc:240] Negotiation successful
0811 05:11:47.117067 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":104,"threads_started":1}
I20260811 05:11:47.118089 22744 heartbeater.cc:347] Connected to a master server at 127.26.191.254:40439
I20260811 05:11:47.118251 22744 heartbeater.cc:464] Registering TS with master...
I20260811 05:11:47.118507 22744 heartbeater.cc:511] Master 127.26.191.254:40439 requested a full tablet report, sending...
I20260811 05:11:47.119171 22418 ts_manager.cc:194] Registered new tserver with Master: 3ce7637ba68145d7998cffcc6cb56ad2 (127.26.191.193:38365)
I20260811 05:11:47.119941 22418 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.191.193@KRBTEST.COM'} at 127.26.191.193:38847
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.191.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.191.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.194.keytab.
Entry for principal kudu/127.26.191.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.194.keytab.
I20260811 05:11:47.140187 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424853995437-27391-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424853995437-27391-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424853995437-27391-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424853995437-27391-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.191.194:0
--local_ip_for_outbound_sockets=127.26.191.194
--webserver_interface=127.26.191.194
--webserver_port=0
--tserver_master_addrs=127.26.191.254:40439
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.194.keytab
--principal=kudu/127.26.191.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:32899
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:11:47.229259 22756 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:11:47.229480 22756 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:11:47.229506 22756 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:11:47.230623 22756 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:11:47.230657 22756 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:11:47.230683 22756 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.191.194
I20260811 05:11:47.232105 22756 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:32899
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424853995437-27391-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424853995437-27391-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.194.keytab
--principal=kudu/127.26.191.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.191.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424853995437-27391-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.191.194
--webserver_port=0
--tserver_master_addrs=127.26.191.254:40439
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22756
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.191.194
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424853995437-27391-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:11:47.232321 22756 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:11:47.232525 22756 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:11:47.238086 22765 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:11:47.238323 22767 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:11:47.238250 22756 server_base.cc:1034] running on GCE node
W20260811 05:11:47.238137 22764 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:11:47.238654 22756 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:11:47.238955 22756 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:11:47.240119 22756 hybrid_clock.cc:648] HybridClock initialized: now 1786425107240094 us; error 40 us; skew 500 ppm
Aug 11 05:11:47 dist-test-slave-x5fp krb5kdc[22346](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425107, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:11:47.243016 22756 init.cc:377] Logged in from keytab as kudu/127.26.191.194@KRBTEST.COM (short username kudu)
I20260811 05:11:47.243499 22756 webserver.cc:460] Webserver started at http://127.26.191.194:44665/ using document root <none> and password file <none>
I20260811 05:11:47.243788 22756 fs_manager.cc:359] Metadata directory not provided
I20260811 05:11:47.243863 22756 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:11:47.244026 22756 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:11:47.245220 22756 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424853995437-27391-0/minicluster-data/ts-1/data/instance:
uuid: "af1f9605aab24d1db96cd475ea38c536"
format_stamp: "Formatted at 2026-08-11 05:11:47 on dist-test-slave-x5fp"
server_key: "7265eac0bead3630991442ba0defff08"
server_key_iv: "181edd2ca73bc384c0d7a16fd2e1a60e"
server_key_version: "encryptionkey@0"
I20260811 05:11:47.245606 22756 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424853995437-27391-0/minicluster-data/ts-1/wal/instance:
uuid: "af1f9605aab24d1db96cd475ea38c536"
format_stamp: "Formatted at 2026-08-11 05:11:47 on dist-test-slave-x5fp"
server_key: "7265eac0bead3630991442ba0defff08"
server_key_iv: "181edd2ca73bc384c0d7a16fd2e1a60e"
server_key_version: "encryptionkey@0"
I20260811 05:11:47.247159 22756 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 05:11:47.248037 22776 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:11:47.248265 22756 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:11:47.248382 22756 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424853995437-27391-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424853995437-27391-0/minicluster-data/ts-1/wal
uuid: "af1f9605aab24d1db96cd475ea38c536"
format_stamp: "Formatted at 2026-08-11 05:11:47 on dist-test-slave-x5fp"
server_key: "7265eac0bead3630991442ba0defff08"
server_key_iv: "181edd2ca73bc384c0d7a16fd2e1a60e"
server_key_version: "encryptionkey@0"
I20260811 05:11:47.248463 22756 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424853995437-27391-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424853995437-27391-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424853995437-27391-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:11:47.265446 22756 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:11:47.268004 22756 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:11:47.268183 22756 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:11:47.268440 22756 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:11:47.268851 22756 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:11:47.268913 22756 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:11:47.268956 22756 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:11:47.268985 22756 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:11:47.275315 22756 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.194:33225
I20260811 05:11:47.275436 22970 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.194:33225 every 8 connection(s)
I20260811 05:11:47.275769 22756 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424853995437-27391-0/minicluster-data/ts-1/data/info.pb
I20260811 05:11:47.277033 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 22756
I20260811 05:11:47.277166 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424853995437-27391-0/minicluster-data/ts-1/wal/instance
I20260811 05:11:47.277390 27391 external_mini_cluster.cc:1428] Setting key 584fc0ea94871c1ab33e689027c5d522
Aug 11 05:11:47 dist-test-slave-x5fp krb5kdc[22346](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425107, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.194@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
I20260811 05:11:47.286737 22485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:47.276633 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.194:60969 (local address 127.26.191.254:40439)
0811 05:11:47.276708 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0811 05:11:47.276710 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:11:47.276941 (+ 231us) server_negotiation.cc:407] Connection header received
0811 05:11:47.277615 (+ 674us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:11:47.277617 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:11:47.277629 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:11:47.277686 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:11:47.278883 (+ 1197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:47.279408 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:47.280746 (+ 1338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:47.280964 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:47.281060 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:47.283449 (+ 2389us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:11:47.283451 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:11:47.283452 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:11:47.283459 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:11:47.285237 (+ 1778us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:11:47.285689 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:11:47.285690 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:11:47.285691 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:11:47.285765 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:11:47.286032 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:11:47.286033 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:11:47.286033 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:11:47.286159 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:11:47.286234 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 05:11:47.286544 (+ 310us) server_negotiation.cc:299] Negotiation successful
0811 05:11:47.286642 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 05:11:47.286931 22975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:47.276590 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:40439 (local address 127.26.191.194:60969)
0811 05:11:47.276792 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:47.276838 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 05:11:47.277498 (+ 660us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:11:47.277775 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:11:47.277779 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:11:47.278514 (+ 735us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:11:47.278764 (+ 250us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:47.278770 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:47.279521 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:47.279522 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:47.280582 (+ 1060us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:47.280585 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:47.281075 (+ 490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:47.281076 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:47.281250 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:47.281904 (+ 654us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:11:47.281914 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:11:47.283343 (+ 1429us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:11:47.285351 (+ 2008us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:11:47.285361 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:11:47.285363 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:11:47.285606 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:11:47.285836 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:11:47.285837 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:11:47.285837 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:11:47.285959 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:11:47.286237 (+ 278us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:11:47.286245 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:11:47.286401 (+ 156us) client_negotiation.cc:769] Sending connection context
0811 05:11:47.286511 (+ 110us) client_negotiation.cc:240] Negotiation successful
0811 05:11:47.286680 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":88,"threads_started":1}
I20260811 05:11:47.287489 22971 heartbeater.cc:347] Connected to a master server at 127.26.191.254:40439
I20260811 05:11:47.287619 22971 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.26.191.195@KRBTEST.COM; defaulting to no policy
I20260811 05:11:47.287832 22971 heartbeater.cc:511] Master 127.26.191.254:40439 requested a full tablet report, sending...
I20260811 05:11:47.288259 22418 ts_manager.cc:194] Registered new tserver with Master: af1f9605aab24d1db96cd475ea38c536 (127.26.191.194:33225)
I20260811 05:11:47.288700 22418 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.191.194@KRBTEST.COM'} at 127.26.191.194:60969
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.191.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.191.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.195.keytab.
Entry for principal kudu/127.26.191.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.195.keytab.
I20260811 05:11:47.308501 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424853995437-27391-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424853995437-27391-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424853995437-27391-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424853995437-27391-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.191.195:0
--local_ip_for_outbound_sockets=127.26.191.195
--webserver_interface=127.26.191.195
--webserver_port=0
--tserver_master_addrs=127.26.191.254:40439
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.195.keytab
--principal=kudu/127.26.191.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:32899
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:11:47.395220 22979 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:11:47.395440 22979 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:11:47.395464 22979 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:11:47.396646 22979 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:11:47.396688 22979 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:11:47.396770 22979 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.191.195
I20260811 05:11:47.398307 22979 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:32899
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424853995437-27391-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424853995437-27391-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.195.keytab
--principal=kudu/127.26.191.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.191.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424853995437-27391-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.191.195
--webserver_port=0
--tserver_master_addrs=127.26.191.254:40439
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22979
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.191.195
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424853995437-27391-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:11:47.398557 22979 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:11:47.398815 22979 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:11:47.404549 22984 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:11:47.404570 22987 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:11:47.404558 22989 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:11:47.404558 22979 server_base.cc:1034] running on GCE node
I20260811 05:11:47.405002 22979 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:11:47.405265 22979 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:11:47.406443 22979 hybrid_clock.cc:648] HybridClock initialized: now 1786425107406430 us; error 35 us; skew 500 ppm
Aug 11 05:11:47 dist-test-slave-x5fp krb5kdc[22346](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425107, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:11:47.409492 22979 init.cc:377] Logged in from keytab as kudu/127.26.191.195@KRBTEST.COM (short username kudu)
I20260811 05:11:47.409958 22979 webserver.cc:460] Webserver started at http://127.26.191.195:36743/ using document root <none> and password file <none>
I20260811 05:11:47.410197 22979 fs_manager.cc:359] Metadata directory not provided
I20260811 05:11:47.410302 22979 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:11:47.410454 22979 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:11:47.411543 22979 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424853995437-27391-0/minicluster-data/ts-2/data/instance:
uuid: "f1d84b392b3046e2b1f0eb194b16fa72"
format_stamp: "Formatted at 2026-08-11 05:11:47 on dist-test-slave-x5fp"
server_key: "c986a45c31b90550db7324bcf7688002"
server_key_iv: "051c2aec5908cdf9307715b14060289e"
server_key_version: "encryptionkey@0"
I20260811 05:11:47.411927 22979 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424853995437-27391-0/minicluster-data/ts-2/wal/instance:
uuid: "f1d84b392b3046e2b1f0eb194b16fa72"
format_stamp: "Formatted at 2026-08-11 05:11:47 on dist-test-slave-x5fp"
server_key: "c986a45c31b90550db7324bcf7688002"
server_key_iv: "051c2aec5908cdf9307715b14060289e"
server_key_version: "encryptionkey@0"
I20260811 05:11:47.413465 22979 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 05:11:47.414232 22998 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:11:47.414434 22979 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 05:11:47.414547 22979 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424853995437-27391-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424853995437-27391-0/minicluster-data/ts-2/wal
uuid: "f1d84b392b3046e2b1f0eb194b16fa72"
format_stamp: "Formatted at 2026-08-11 05:11:47 on dist-test-slave-x5fp"
server_key: "c986a45c31b90550db7324bcf7688002"
server_key_iv: "051c2aec5908cdf9307715b14060289e"
server_key_version: "encryptionkey@0"
I20260811 05:11:47.414628 22979 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424853995437-27391-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424853995437-27391-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424853995437-27391-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:11:47.425164 22979 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:11:47.427508 22979 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:11:47.427690 22979 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:11:47.427965 22979 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:11:47.428295 22979 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:11:47.428359 22979 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:11:47.428406 22979 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:11:47.428429 22979 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:11:47.434676 22979 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.195:33747
I20260811 05:11:47.434723 23184 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.195:33747 every 8 connection(s)
I20260811 05:11:47.435065 22979 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424853995437-27391-0/minicluster-data/ts-2/data/info.pb
Aug 11 05:11:47 dist-test-slave-x5fp krb5kdc[22346](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425107, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.195@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
I20260811 05:11:47.444655 22485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:47.435871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.195:45499 (local address 127.26.191.254:40439)
0811 05:11:47.435918 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 05:11:47.435920 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:11:47.436128 (+ 208us) server_negotiation.cc:407] Connection header received
0811 05:11:47.436620 (+ 492us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:11:47.436621 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:11:47.436632 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:11:47.436686 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:11:47.437727 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:47.438235 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:47.439246 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:47.439437 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:47.439497 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:47.441888 (+ 2391us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:11:47.441890 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:11:47.441890 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:11:47.441898 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:11:47.443253 (+ 1355us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:11:47.443661 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:11:47.443661 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:11:47.443662 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:11:47.443728 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:11:47.444034 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:11:47.444035 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:11:47.444035 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:11:47.444161 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:11:47.444252 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 05:11:47.444517 (+ 265us) server_negotiation.cc:299] Negotiation successful
0811 05:11:47.444587 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 05:11:47.444831 23188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:47.435867 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:40439 (local address 127.26.191.195:45499)
0811 05:11:47.436022 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:47.436059 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 05:11:47.436520 (+ 461us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:11:47.436832 (+ 312us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:11:47.436836 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:11:47.437429 (+ 593us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:11:47.437629 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:47.437634 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:47.438338 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:47.438339 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:47.439150 (+ 811us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:47.439152 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:47.439517 (+ 365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:47.439517 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:47.439624 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:47.440174 (+ 550us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:11:47.440183 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:11:47.441776 (+ 1593us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:11:47.443330 (+ 1554us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:11:47.443337 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:11:47.443345 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:11:47.443566 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:11:47.443793 (+ 227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:11:47.443793 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:11:47.443794 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:11:47.443935 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:11:47.444250 (+ 315us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:11:47.444255 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:11:47.444390 (+ 135us) client_negotiation.cc:769] Sending connection context
0811 05:11:47.444477 (+ 87us) client_negotiation.cc:240] Negotiation successful
0811 05:11:47.444600 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":94,"threads_started":1}
I20260811 05:11:47.445253 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 22979
I20260811 05:11:47.445343 23186 heartbeater.cc:347] Connected to a master server at 127.26.191.254:40439
I20260811 05:11:47.445382 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424853995437-27391-0/minicluster-data/ts-2/wal/instance
I20260811 05:11:47.445464 23186 heartbeater.cc:464] Registering TS with master...
I20260811 05:11:47.445605 27391 external_mini_cluster.cc:1428] Setting key e3ac8e761b932f7af1590e96dd42aa28
I20260811 05:11:47.445652 23186 heartbeater.cc:511] Master 127.26.191.254:40439 requested a full tablet report, sending...
I20260811 05:11:47.446025 22418 ts_manager.cc:194] Registered new tserver with Master: f1d84b392b3046e2b1f0eb194b16fa72 (127.26.191.195:33747)
I20260811 05:11:47.446502 22418 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.191.195@KRBTEST.COM'} at 127.26.191.195:45499
I20260811 05:11:47.446590 27391 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 05:11:47.454489 22485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:47.448027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39078 (local address 127.26.191.254:40439)
0811 05:11:47.448099 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0811 05:11:47.448102 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:11:47.448222 (+ 120us) server_negotiation.cc:407] Connection header received
0811 05:11:47.448303 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:11:47.448304 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:11:47.448324 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:11:47.448380 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:11:47.449038 (+ 658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:47.449522 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:47.450258 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:47.450516 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:47.450592 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:47.451879 (+ 1287us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:11:47.451880 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:11:47.451881 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:11:47.451888 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:11:47.453239 (+ 1351us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:11:47.453586 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:11:47.453587 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:11:47.453587 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:11:47.453646 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:11:47.453871 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:11:47.453872 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:11:47.453872 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:11:47.454027 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:11:47.454134 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0811 05:11:47.454305 (+ 171us) server_negotiation.cc:299] Negotiation successful
0811 05:11:47.454386 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 05:11:47.456015 22418 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39078:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 05:11:47.457683 22418 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 05:11:47.464489 23208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:47.459993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.193:38365 (local address 127.0.0.1:41520)
0811 05:11:47.460397 (+ 404us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:47.460440 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 05:11:47.460533 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:11:47.460886 (+ 353us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:11:47.460889 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:11:47.460891 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:11:47.460962 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:47.460964 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:47.462323 (+ 1359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:47.462324 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:47.463353 (+ 1029us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:47.463357 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:47.464105 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:47.464106 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:47.464221 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:47.464241 (+ 20us) client_negotiation.cc:769] Sending connection context
0811 05:11:47.464335 (+ 94us) client_negotiation.cc:240] Negotiation successful
0811 05:11:47.464393 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":368,"mutex_wait_us":4,"thread_start_us":60,"threads_started":1}
I20260811 05:11:47.464506 23205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:47.460109 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41520 (local address 127.26.191.193:38365)
0811 05:11:47.460327 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0811 05:11:47.460333 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 05:11:47.460505 (+ 172us) server_negotiation.cc:407] Connection header received
0811 05:11:47.460631 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:11:47.460633 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:11:47.460652 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:11:47.460711 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:11:47.461052 (+ 341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:47.462197 (+ 1145us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:47.463444 (+ 1247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:47.464008 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:47.464085 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:47.464143 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 05:11:47.464369 (+ 226us) server_negotiation.cc:299] Negotiation successful
0811 05:11:47.464415 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":183,"thread_start_us":92,"threads_started":1}
I20260811 05:11:47.465106 23209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:47.460319 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33506 (local address 127.26.191.194:33225)
0811 05:11:47.460571 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0811 05:11:47.460576 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:11:47.460590 (+ 14us) server_negotiation.cc:407] Connection header received
0811 05:11:47.460638 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:11:47.460641 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:11:47.460661 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:11:47.460920 (+ 259us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:11:47.461378 (+ 458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:47.462167 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:47.463923 (+ 1756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:47.464712 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:47.464830 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:47.464900 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 05:11:47.464984 (+ 84us) server_negotiation.cc:299] Negotiation successful
0811 05:11:47.465024 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":214,"thread_start_us":117,"threads_started":1}
I20260811 05:11:47.465248 23207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:47.460202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.195:33747 (local address 127.0.0.1:39102)
0811 05:11:47.460635 (+ 433us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:47.460644 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 05:11:47.460700 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:11:47.461021 (+ 321us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:11:47.461022 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:11:47.461024 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:11:47.461112 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:47.461115 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:47.462374 (+ 1259us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:47.462375 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:47.463817 (+ 1442us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:47.463820 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:47.464981 (+ 1161us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:47.464982 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:47.465063 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:47.465069 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 05:11:47.465109 (+ 40us) client_negotiation.cc:240] Negotiation successful
0811 05:11:47.465157 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":418,"mutex_wait_us":108,"thread_start_us":65,"threads_started":1}
I20260811 05:11:47.465090 23204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:47.460139 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.194:33225 (local address 127.0.0.1:33506)
0811 05:11:47.460409 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:47.460439 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0811 05:11:47.460508 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:11:47.461018 (+ 510us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:11:47.461019 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:11:47.461022 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:11:47.461289 (+ 267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:47.461291 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:47.462293 (+ 1002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:47.462294 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:47.463817 (+ 1523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:47.463820 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:47.464830 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:47.464831 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:47.464902 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:47.464907 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 05:11:47.464968 (+ 61us) client_negotiation.cc:240] Negotiation successful
0811 05:11:47.465015 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":259,"mutex_wait_us":94,"thread_start_us":94,"threads_started":1}
I20260811 05:11:47.465654 23211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:47.460445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39102 (local address 127.26.191.195:33747)
0811 05:11:47.460856 (+ 411us) server_negotiation.cc:206] Beginning negotiation
0811 05:11:47.460861 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:11:47.460870 (+ 9us) server_negotiation.cc:407] Connection header received
0811 05:11:47.460903 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:11:47.460905 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:11:47.460920 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:11:47.461059 (+ 139us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:11:47.461263 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:47.462280 (+ 1017us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:47.463968 (+ 1688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:47.464844 (+ 876us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:47.465393 (+ 549us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:47.465463 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 05:11:47.465493 (+ 30us) server_negotiation.cc:299] Negotiation successful
0811 05:11:47.465552 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":376,"thread_start_us":104,"threads_started":1}
I20260811 05:11:47.465847 22629 tablet_service.cc:1467] Processing CreateTablet for tablet fdf28a8d6b254c2195e6fa937b4a6610 (DEFAULT_TABLE table=test-table [id=e1b52059357d4888948a50135558e9d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:11:47.466207 22629 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fdf28a8d6b254c2195e6fa937b4a6610. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:11:47.466348 23076 tablet_service.cc:1467] Processing CreateTablet for tablet fdf28a8d6b254c2195e6fa937b4a6610 (DEFAULT_TABLE table=test-table [id=e1b52059357d4888948a50135558e9d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:11:47.466638 23076 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fdf28a8d6b254c2195e6fa937b4a6610. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:11:47.469112 23212 tablet_bootstrap.cc:492] T fdf28a8d6b254c2195e6fa937b4a6610 P 3ce7637ba68145d7998cffcc6cb56ad2: Bootstrap starting.
I20260811 05:11:47.469044 22854 tablet_service.cc:1467] Processing CreateTablet for tablet fdf28a8d6b254c2195e6fa937b4a6610 (DEFAULT_TABLE table=test-table [id=e1b52059357d4888948a50135558e9d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:11:47.469424 22854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fdf28a8d6b254c2195e6fa937b4a6610. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:11:47.469764 23212 tablet_bootstrap.cc:654] T fdf28a8d6b254c2195e6fa937b4a6610 P 3ce7637ba68145d7998cffcc6cb56ad2: Neither blocks nor log segments found. Creating new log.
I20260811 05:11:47.470099 23213 tablet_bootstrap.cc:492] T fdf28a8d6b254c2195e6fa937b4a6610 P f1d84b392b3046e2b1f0eb194b16fa72: Bootstrap starting.
I20260811 05:11:47.470371 23212 log.cc:824] T fdf28a8d6b254c2195e6fa937b4a6610 P 3ce7637ba68145d7998cffcc6cb56ad2: Log is configured to *not* fsync() on all Append() calls
I20260811 05:11:47.470763 23213 tablet_bootstrap.cc:654] T fdf28a8d6b254c2195e6fa937b4a6610 P f1d84b392b3046e2b1f0eb194b16fa72: Neither blocks nor log segments found. Creating new log.
I20260811 05:11:47.471274 23213 log.cc:824] T fdf28a8d6b254c2195e6fa937b4a6610 P f1d84b392b3046e2b1f0eb194b16fa72: Log is configured to *not* fsync() on all Append() calls
I20260811 05:11:47.471370 23212 tablet_bootstrap.cc:492] T fdf28a8d6b254c2195e6fa937b4a6610 P 3ce7637ba68145d7998cffcc6cb56ad2: No bootstrap required, opened a new log
I20260811 05:11:47.471436 23212 ts_tablet_manager.cc:1397] T fdf28a8d6b254c2195e6fa937b4a6610 P 3ce7637ba68145d7998cffcc6cb56ad2: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 05:11:47.472141 23213 tablet_bootstrap.cc:492] T fdf28a8d6b254c2195e6fa937b4a6610 P f1d84b392b3046e2b1f0eb194b16fa72: No bootstrap required, opened a new log
I20260811 05:11:47.472205 23213 ts_tablet_manager.cc:1397] T fdf28a8d6b254c2195e6fa937b4a6610 P f1d84b392b3046e2b1f0eb194b16fa72: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 05:11:47.472738 23217 tablet_bootstrap.cc:492] T fdf28a8d6b254c2195e6fa937b4a6610 P af1f9605aab24d1db96cd475ea38c536: Bootstrap starting.
I20260811 05:11:47.473456 23217 tablet_bootstrap.cc:654] T fdf28a8d6b254c2195e6fa937b4a6610 P af1f9605aab24d1db96cd475ea38c536: Neither blocks nor log segments found. Creating new log.
I20260811 05:11:47.473466 23212 raft_consensus.cc:348] T fdf28a8d6b254c2195e6fa937b4a6610 P 3ce7637ba68145d7998cffcc6cb56ad2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ce7637ba68145d7998cffcc6cb56ad2" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 38365 } } peers { permanent_uuid: "f1d84b392b3046e2b1f0eb194b16fa72" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 33747 } } peers { permanent_uuid: "af1f9605aab24d1db96cd475ea38c536" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 33225 } }
I20260811 05:11:47.473659 23212 raft_consensus.cc:374] T fdf28a8d6b254c2195e6fa937b4a6610 P 3ce7637ba68145d7998cffcc6cb56ad2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:11:47.473695 23212 raft_consensus.cc:729] T fdf28a8d6b254c2195e6fa937b4a6610 P 3ce7637ba68145d7998cffcc6cb56ad2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ce7637ba68145d7998cffcc6cb56ad2, State: Initialized, Role: FOLLOWER
I20260811 05:11:47.473853 23212 consensus_queue.cc:260] T fdf28a8d6b254c2195e6fa937b4a6610 P 3ce7637ba68145d7998cffcc6cb56ad2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ce7637ba68145d7998cffcc6cb56ad2" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 38365 } } peers { permanent_uuid: "f1d84b392b3046e2b1f0eb194b16fa72" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 33747 } } peers { permanent_uuid: "af1f9605aab24d1db96cd475ea38c536" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 33225 } }
I20260811 05:11:47.474169 23212 ts_tablet_manager.cc:1428] T fdf28a8d6b254c2195e6fa937b4a6610 P 3ce7637ba68145d7998cffcc6cb56ad2: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 05:11:47.474184 23217 log.cc:824] T fdf28a8d6b254c2195e6fa937b4a6610 P af1f9605aab24d1db96cd475ea38c536: Log is configured to *not* fsync() on all Append() calls
I20260811 05:11:47.474306 22744 heartbeater.cc:503] Master 127.26.191.254:40439 was elected leader, sending a full tablet report...
I20260811 05:11:47.474184 23213 raft_consensus.cc:348] T fdf28a8d6b254c2195e6fa937b4a6610 P f1d84b392b3046e2b1f0eb194b16fa72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ce7637ba68145d7998cffcc6cb56ad2" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 38365 } } peers { permanent_uuid: "f1d84b392b3046e2b1f0eb194b16fa72" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 33747 } } peers { permanent_uuid: "af1f9605aab24d1db96cd475ea38c536" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 33225 } }
I20260811 05:11:47.474360 23213 raft_consensus.cc:374] T fdf28a8d6b254c2195e6fa937b4a6610 P f1d84b392b3046e2b1f0eb194b16fa72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:11:47.474406 23213 raft_consensus.cc:729] T fdf28a8d6b254c2195e6fa937b4a6610 P f1d84b392b3046e2b1f0eb194b16fa72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1d84b392b3046e2b1f0eb194b16fa72, State: Initialized, Role: FOLLOWER
I20260811 05:11:47.474565 23213 consensus_queue.cc:260] T fdf28a8d6b254c2195e6fa937b4a6610 P f1d84b392b3046e2b1f0eb194b16fa72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ce7637ba68145d7998cffcc6cb56ad2" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 38365 } } peers { permanent_uuid: "f1d84b392b3046e2b1f0eb194b16fa72" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 33747 } } peers { permanent_uuid: "af1f9605aab24d1db96cd475ea38c536" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 33225 } }
I20260811 05:11:47.474876 23213 ts_tablet_manager.cc:1428] T fdf28a8d6b254c2195e6fa937b4a6610 P f1d84b392b3046e2b1f0eb194b16fa72: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 05:11:47.475052 23186 heartbeater.cc:503] Master 127.26.191.254:40439 was elected leader, sending a full tablet report...
I20260811 05:11:47.475157 23217 tablet_bootstrap.cc:492] T fdf28a8d6b254c2195e6fa937b4a6610 P af1f9605aab24d1db96cd475ea38c536: No bootstrap required, opened a new log
I20260811 05:11:47.475286 23217 ts_tablet_manager.cc:1397] T fdf28a8d6b254c2195e6fa937b4a6610 P af1f9605aab24d1db96cd475ea38c536: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 05:11:47.476148 23218 raft_consensus.cc:482] T fdf28a8d6b254c2195e6fa937b4a6610 P 3ce7637ba68145d7998cffcc6cb56ad2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 05:11:47.476225 23218 raft_consensus.cc:504] T fdf28a8d6b254c2195e6fa937b4a6610 P 3ce7637ba68145d7998cffcc6cb56ad2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ce7637ba68145d7998cffcc6cb56ad2" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 38365 } } peers { permanent_uuid: "f1d84b392b3046e2b1f0eb194b16fa72" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 33747 } } peers { permanent_uuid: "af1f9605aab24d1db96cd475ea38c536" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 33225 } }
I20260811 05:11:47.477219 23218 leader_election.cc:288] T fdf28a8d6b254c2195e6fa937b4a6610 P 3ce7637ba68145d7998cffcc6cb56ad2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1d84b392b3046e2b1f0eb194b16fa72 (127.26.191.195:33747), af1f9605aab24d1db96cd475ea38c536 (127.26.191.194:33225)
I20260811 05:11:47.477705 23217 raft_consensus.cc:348] T fdf28a8d6b254c2195e6fa937b4a6610 P af1f9605aab24d1db96cd475ea38c536 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ce7637ba68145d7998cffcc6cb56ad2" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 38365 } } peers { permanent_uuid: "f1d84b392b3046e2b1f0eb194b16fa72" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 33747 } } peers { permanent_uuid: "af1f9605aab24d1db96cd475ea38c536" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 33225 } }
I20260811 05:11:47.477903 23217 raft_consensus.cc:374] T fdf28a8d6b254c2195e6fa937b4a6610 P af1f9605aab24d1db96cd475ea38c536 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:11:47.477941 23217 raft_consensus.cc:729] T fdf28a8d6b254c2195e6fa937b4a6610 P af1f9605aab24d1db96cd475ea38c536 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af1f9605aab24d1db96cd475ea38c536, State: Initialized, Role: FOLLOWER
I20260811 05:11:47.478111 23217 consensus_queue.cc:260] T fdf28a8d6b254c2195e6fa937b4a6610 P af1f9605aab24d1db96cd475ea38c536 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ce7637ba68145d7998cffcc6cb56ad2" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 38365 } } peers { permanent_uuid: "f1d84b392b3046e2b1f0eb194b16fa72" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 33747 } } peers { permanent_uuid: "af1f9605aab24d1db96cd475ea38c536" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 33225 } }
I20260811 05:11:47.478538 23217 ts_tablet_manager.cc:1428] T fdf28a8d6b254c2195e6fa937b4a6610 P af1f9605aab24d1db96cd475ea38c536: Time spent starting tablet: real 0.003s user 0.001s sys 0.003s
I20260811 05:11:47.478564 22971 heartbeater.cc:503] Master 127.26.191.254:40439 was elected leader, sending a full tablet report...
I20260811 05:11:47.480427 23223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:47.476743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.195:33747 (local address 127.26.191.193:35989)
0811 05:11:47.477228 (+ 485us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:47.477239 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 05:11:47.477321 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:11:47.477470 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:11:47.477471 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:11:47.477472 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:11:47.477546 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:47.477547 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:47.478269 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:47.478270 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:47.479418 (+ 1148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:47.479421 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:47.480143 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:47.480144 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:47.480242 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:47.480246 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 05:11:47.480297 (+ 51us) client_negotiation.cc:240] Negotiation successful
0811 05:11:47.480343 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":469,"mutex_wait_us":329,"thread_start_us":109,"threads_started":1}
I20260811 05:11:47.480458 23211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:47.477021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.193:35989 (local address 127.26.191.195:33747)
0811 05:11:47.477059 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 05:11:47.477061 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:11:47.477294 (+ 233us) server_negotiation.cc:407] Connection header received
0811 05:11:47.477401 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:11:47.477401 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:11:47.477411 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:11:47.477466 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:11:47.477614 (+ 148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:47.478184 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:47.479550 (+ 1366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:47.480072 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:47.480143 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:47.480152 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 05:11:47.480316 (+ 164us) server_negotiation.cc:299] Negotiation successful
0811 05:11:47.480388 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 05:11:47.480491 23209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:47.476879 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.193:36351 (local address 127.26.191.194:33225)
0811 05:11:47.476926 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 05:11:47.476928 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:11:47.476938 (+ 10us) server_negotiation.cc:407] Connection header received
0811 05:11:47.476974 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:11:47.476975 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:11:47.476985 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:11:47.477039 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:11:47.477266 (+ 227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:47.478078 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:47.479566 (+ 1488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:47.480135 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:47.480229 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:47.480237 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 05:11:47.480384 (+ 147us) server_negotiation.cc:299] Negotiation successful
0811 05:11:47.480422 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 05:11:47.480500 22749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:47.476727 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.194:33225 (local address 127.26.191.193:36351)
0811 05:11:47.476869 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:47.476881 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 05:11:47.476928 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:11:47.477072 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:11:47.477074 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:11:47.477076 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:11:47.477152 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:47.477154 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:47.478201 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:47.478203 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:47.479450 (+ 1247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:47.479453 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:47.480227 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:47.480228 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:47.480305 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:47.480307 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 05:11:47.480368 (+ 61us) client_negotiation.cc:240] Negotiation successful
0811 05:11:47.480402 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"mutex_wait_us":2}
I20260811 05:11:47.481078 23108 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdf28a8d6b254c2195e6fa937b4a6610" candidate_uuid: "3ce7637ba68145d7998cffcc6cb56ad2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1d84b392b3046e2b1f0eb194b16fa72" is_pre_election: true
I20260811 05:11:47.481078 22884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdf28a8d6b254c2195e6fa937b4a6610" candidate_uuid: "3ce7637ba68145d7998cffcc6cb56ad2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1f9605aab24d1db96cd475ea38c536" is_pre_election: true
I20260811 05:11:47.481197 23108 raft_consensus.cc:2454] T fdf28a8d6b254c2195e6fa937b4a6610 P f1d84b392b3046e2b1f0eb194b16fa72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ce7637ba68145d7998cffcc6cb56ad2 in term 0.
I20260811 05:11:47.481247 22884 raft_consensus.cc:2454] T fdf28a8d6b254c2195e6fa937b4a6610 P af1f9605aab24d1db96cd475ea38c536 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ce7637ba68145d7998cffcc6cb56ad2 in term 0.
I20260811 05:11:47.481439 22547 leader_election.cc:302] T fdf28a8d6b254c2195e6fa937b4a6610 P 3ce7637ba68145d7998cffcc6cb56ad2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ce7637ba68145d7998cffcc6cb56ad2, f1d84b392b3046e2b1f0eb194b16fa72; no voters:
I20260811 05:11:47.481585 23218 raft_consensus.cc:2781] T fdf28a8d6b254c2195e6fa937b4a6610 P 3ce7637ba68145d7998cffcc6cb56ad2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 05:11:47.481652 23218 raft_consensus.cc:482] T fdf28a8d6b254c2195e6fa937b4a6610 P 3ce7637ba68145d7998cffcc6cb56ad2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 05:11:47.481678 23218 raft_consensus.cc:3037] T fdf28a8d6b254c2195e6fa937b4a6610 P 3ce7637ba68145d7998cffcc6cb56ad2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:11:47.482515 23218 raft_consensus.cc:504] T fdf28a8d6b254c2195e6fa937b4a6610 P 3ce7637ba68145d7998cffcc6cb56ad2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ce7637ba68145d7998cffcc6cb56ad2" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 38365 } } peers { permanent_uuid: "f1d84b392b3046e2b1f0eb194b16fa72" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 33747 } } peers { permanent_uuid: "af1f9605aab24d1db96cd475ea38c536" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 33225 } }
I20260811 05:11:47.482767 23218 leader_election.cc:288] T fdf28a8d6b254c2195e6fa937b4a6610 P 3ce7637ba68145d7998cffcc6cb56ad2 [CANDIDATE]: Term 1 election: Requested vote from peers f1d84b392b3046e2b1f0eb194b16fa72 (127.26.191.195:33747), af1f9605aab24d1db96cd475ea38c536 (127.26.191.194:33225)
I20260811 05:11:47.482852 23108 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdf28a8d6b254c2195e6fa937b4a6610" candidate_uuid: "3ce7637ba68145d7998cffcc6cb56ad2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1d84b392b3046e2b1f0eb194b16fa72"
I20260811 05:11:47.482933 23108 raft_consensus.cc:3037] T fdf28a8d6b254c2195e6fa937b4a6610 P f1d84b392b3046e2b1f0eb194b16fa72 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:11:47.482960 22884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdf28a8d6b254c2195e6fa937b4a6610" candidate_uuid: "3ce7637ba68145d7998cffcc6cb56ad2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1f9605aab24d1db96cd475ea38c536"
I20260811 05:11:47.483024 22884 raft_consensus.cc:3037] T fdf28a8d6b254c2195e6fa937b4a6610 P af1f9605aab24d1db96cd475ea38c536 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:11:47.483597 23108 raft_consensus.cc:2454] T fdf28a8d6b254c2195e6fa937b4a6610 P f1d84b392b3046e2b1f0eb194b16fa72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ce7637ba68145d7998cffcc6cb56ad2 in term 1.
I20260811 05:11:47.483775 22547 leader_election.cc:302] T fdf28a8d6b254c2195e6fa937b4a6610 P 3ce7637ba68145d7998cffcc6cb56ad2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ce7637ba68145d7998cffcc6cb56ad2, f1d84b392b3046e2b1f0eb194b16fa72; no voters:
I20260811 05:11:47.483834 22884 raft_consensus.cc:2454] T fdf28a8d6b254c2195e6fa937b4a6610 P af1f9605aab24d1db96cd475ea38c536 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ce7637ba68145d7998cffcc6cb56ad2 in term 1.
I20260811 05:11:47.483959 23218 raft_consensus.cc:2781] T fdf28a8d6b254c2195e6fa937b4a6610 P 3ce7637ba68145d7998cffcc6cb56ad2 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:11:47.484179 23218 raft_consensus.cc:686] T fdf28a8d6b254c2195e6fa937b4a6610 P 3ce7637ba68145d7998cffcc6cb56ad2 [term 1 LEADER]: Becoming Leader. State: Replica: 3ce7637ba68145d7998cffcc6cb56ad2, State: Running, Role: LEADER
I20260811 05:11:47.484306 23218 consensus_queue.cc:237] T fdf28a8d6b254c2195e6fa937b4a6610 P 3ce7637ba68145d7998cffcc6cb56ad2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ce7637ba68145d7998cffcc6cb56ad2" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 38365 } } peers { permanent_uuid: "f1d84b392b3046e2b1f0eb194b16fa72" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 33747 } } peers { permanent_uuid: "af1f9605aab24d1db96cd475ea38c536" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 33225 } }
I20260811 05:11:47.485386 22417 catalog_manager.cc:5495] T fdf28a8d6b254c2195e6fa937b4a6610 P 3ce7637ba68145d7998cffcc6cb56ad2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3ce7637ba68145d7998cffcc6cb56ad2 (127.26.191.193). New cstate: current_term: 1 leader_uuid: "3ce7637ba68145d7998cffcc6cb56ad2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ce7637ba68145d7998cffcc6cb56ad2" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 38365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f1d84b392b3046e2b1f0eb194b16fa72" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 33747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1f9605aab24d1db96cd475ea38c536" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 33225 } health_report { overall_health: UNKNOWN } } }
I20260811 05:11:47.491081 23205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:47.488597 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41528 (local address 127.26.191.193:38365)
0811 05:11:47.488640 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 05:11:47.488642 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:11:47.488651 (+ 9us) server_negotiation.cc:407] Connection header received
0811 05:11:47.488784 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:11:47.488785 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:11:47.488805 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:11:47.488879 (+ 74us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:11:47.488995 (+ 116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:47.489453 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:47.490207 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:47.490402 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:47.490463 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:47.490654 (+ 191us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:11:47.490776 (+ 122us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:11:47.490844 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 05:11:47.490933 (+ 89us) server_negotiation.cc:299] Negotiation successful
0811 05:11:47.490955 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 05:11:47.493070 23108 raft_consensus.cc:1261] T fdf28a8d6b254c2195e6fa937b4a6610 P f1d84b392b3046e2b1f0eb194b16fa72 [term 1 FOLLOWER]: Refusing update from remote peer 3ce7637ba68145d7998cffcc6cb56ad2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:11:47.493103 22884 raft_consensus.cc:1261] T fdf28a8d6b254c2195e6fa937b4a6610 P af1f9605aab24d1db96cd475ea38c536 [term 1 FOLLOWER]: Refusing update from remote peer 3ce7637ba68145d7998cffcc6cb56ad2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:11:47.493459 23218 consensus_queue.cc:1035] T fdf28a8d6b254c2195e6fa937b4a6610 P 3ce7637ba68145d7998cffcc6cb56ad2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1d84b392b3046e2b1f0eb194b16fa72" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 33747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:11:47.493593 23225 consensus_queue.cc:1035] T fdf28a8d6b254c2195e6fa937b4a6610 P 3ce7637ba68145d7998cffcc6cb56ad2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1f9605aab24d1db96cd475ea38c536" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 33225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:11:47.496809 23229 mvcc.cc:205] Tried to move back new op lower bound from 7317197240288579584 to 7317197240256647168. Current Snapshot: MvccSnapshot[applied={T|T < 7317197240288579584}]
I20260811 05:11:47.497383 23230 mvcc.cc:205] Tried to move back new op lower bound from 7317197240288579584 to 7317197240256647168. Current Snapshot: MvccSnapshot[applied={T|T < 7317197240288579584}]
I20260811 05:11:47.497562 23231 mvcc.cc:205] Tried to move back new op lower bound from 7317197240288579584 to 7317197240256647168. Current Snapshot: MvccSnapshot[applied={T|T < 7317197240288579584}]
I20260811 05:11:47.499630 22418 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39078:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:11:47.499723 22418 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39078:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:11:47.500492 22418 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7590907fb0894b428438111bb1c3458e: Sending DeleteTablet for 3 replicas of tablet fdf28a8d6b254c2195e6fa937b4a6610
I20260811 05:11:47.500927 22854 tablet_service.cc:1514] Processing DeleteTablet for tablet fdf28a8d6b254c2195e6fa937b4a6610 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:11:47 UTC) from {username='kudu', principal='kudu/127.26.191.254@KRBTEST.COM'} at 127.0.0.1:33506
I20260811 05:11:47.500946 23076 tablet_service.cc:1514] Processing DeleteTablet for tablet fdf28a8d6b254c2195e6fa937b4a6610 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:11:47 UTC) from {username='kudu', principal='kudu/127.26.191.254@KRBTEST.COM'} at 127.0.0.1:39102
I20260811 05:11:47.501184 23242 tablet_replica.cc:330] T fdf28a8d6b254c2195e6fa937b4a6610 P f1d84b392b3046e2b1f0eb194b16fa72: stopping tablet replica
I20260811 05:11:47.501302 23242 raft_consensus.cc:2229] T fdf28a8d6b254c2195e6fa937b4a6610 P f1d84b392b3046e2b1f0eb194b16fa72 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 05:11:47.501405 23242 raft_consensus.cc:2258] T fdf28a8d6b254c2195e6fa937b4a6610 P f1d84b392b3046e2b1f0eb194b16fa72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:11:47.501463 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 22519
I20260811 05:11:47.501844 23242 ts_tablet_manager.cc:1905] T fdf28a8d6b254c2195e6fa937b4a6610 P f1d84b392b3046e2b1f0eb194b16fa72: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:11:47.503505 23242 ts_tablet_manager.cc:1918] T fdf28a8d6b254c2195e6fa937b4a6610 P f1d84b392b3046e2b1f0eb194b16fa72: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 05:11:47.503574 23242 log.cc:1196] T fdf28a8d6b254c2195e6fa937b4a6610 P f1d84b392b3046e2b1f0eb194b16fa72: Deleting WAL directory at /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424853995437-27391-0/minicluster-data/ts-2/wal/wals/fdf28a8d6b254c2195e6fa937b4a6610
I20260811 05:11:47.503799 23242 ts_tablet_manager.cc:1939] T fdf28a8d6b254c2195e6fa937b4a6610 P f1d84b392b3046e2b1f0eb194b16fa72: Deleting consensus metadata
I20260811 05:11:47.504168 22395 catalog_manager.cc:4841] TS f1d84b392b3046e2b1f0eb194b16fa72 (127.26.191.195:33747): tablet fdf28a8d6b254c2195e6fa937b4a6610 (table test-table [id=e1b52059357d4888948a50135558e9d9]) successfully deleted
I20260811 05:11:47.508396 23241 tablet_replica.cc:330] T fdf28a8d6b254c2195e6fa937b4a6610 P af1f9605aab24d1db96cd475ea38c536: stopping tablet replica
I20260811 05:11:47.508540 23241 raft_consensus.cc:2229] T fdf28a8d6b254c2195e6fa937b4a6610 P af1f9605aab24d1db96cd475ea38c536 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 05:11:47.508683 23241 raft_consensus.cc:2258] T fdf28a8d6b254c2195e6fa937b4a6610 P af1f9605aab24d1db96cd475ea38c536 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:11:47.509138 23241 ts_tablet_manager.cc:1905] T fdf28a8d6b254c2195e6fa937b4a6610 P af1f9605aab24d1db96cd475ea38c536: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:11:47.510560 23241 ts_tablet_manager.cc:1918] T fdf28a8d6b254c2195e6fa937b4a6610 P af1f9605aab24d1db96cd475ea38c536: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 05:11:47.510684 23241 log.cc:1196] T fdf28a8d6b254c2195e6fa937b4a6610 P af1f9605aab24d1db96cd475ea38c536: Deleting WAL directory at /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424853995437-27391-0/minicluster-data/ts-1/wal/wals/fdf28a8d6b254c2195e6fa937b4a6610
I20260811 05:11:47.510972 23241 ts_tablet_manager.cc:1939] T fdf28a8d6b254c2195e6fa937b4a6610 P af1f9605aab24d1db96cd475ea38c536: Deleting consensus metadata
I20260811 05:11:47.511471 22394 catalog_manager.cc:4841] TS af1f9605aab24d1db96cd475ea38c536 (127.26.191.194:33225): tablet fdf28a8d6b254c2195e6fa937b4a6610 (table test-table [id=e1b52059357d4888948a50135558e9d9]) successfully deleted
W20260811 05:11:47.513306 22395 connection.cc:535] client connection to 127.26.191.193:38365 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260811 05:11:47.513423 22395 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 05:11:47.513547 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 22756
I20260811 05:11:47.519323 23204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:47.519130 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.193:38365 (local address 127.0.0.1:41538)
0811 05:11:47.519211 (+ 81us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:47.519276 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.193:38365: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260811 05:11:47.519506 22395 catalog_manager.cc:4584] TS 3ce7637ba68145d7998cffcc6cb56ad2 (127.26.191.193:38365): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet fdf28a8d6b254c2195e6fa937b4a6610: Network error: Client connection negotiation failed: client connection to 127.26.191.193:38365: connect: Connection refused (error 111)
I20260811 05:11:47.526201 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 22979
I20260811 05:11:47.541733 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 22368
2026-08-11T05:11:47Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2299 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-11T05:11:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:11:47Z Disabled control of system clock
I20260811 05:11:47.579603 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424853995437-27391-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424853995437-27391-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424853995437-27391-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.254:36703
--webserver_interface=127.26.191.254
--webserver_port=0
--builtin_ntp_servers=127.26.191.212:46347
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.191.254:36703
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 05:11:47.662817 23250 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:11:47.663034 23250 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:11:47.663055 23250 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:11:47.664245 23250 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:11:47.664288 23250 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:11:47.664300 23250 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:11:47.664314 23250 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:11:47.664325 23250 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:11:47.665632 23250 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:46347
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424853995437-27391-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424853995437-27391-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.191.254:36703
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.254:36703
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.191.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23250
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424853995437-27391-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:11:47.665838 23250 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:11:47.666077 23250 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:11:47.671149 23257 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:11:47.671180 23260 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:11:47.671191 23258 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:11:47.671211 23250 server_base.cc:1034] running on GCE node
I20260811 05:11:47.671636 23250 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:11:47.671941 23250 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:11:47.673136 23250 hybrid_clock.cc:648] HybridClock initialized: now 1786425107673129 us; error 39 us; skew 500 ppm
I20260811 05:11:47.674738 23250 webserver.cc:460] Webserver started at http://127.26.191.254:46311/ using document root <none> and password file <none>
I20260811 05:11:47.675030 23250 fs_manager.cc:359] Metadata directory not provided
I20260811 05:11:47.675123 23250 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:11:47.675307 23250 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:11:47.676546 23250 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424853995437-27391-0/minicluster-data/master-0/data/instance:
uuid: "4721c130cce147d3b9ec8d5ea89c0aa6"
format_stamp: "Formatted at 2026-08-11 05:11:47 on dist-test-slave-x5fp"
server_key: "69fc0b92a54b8c57c6759cafba6d8457"
server_key_iv: "781a5af355b43b880ccf73de52129f52"
server_key_version: "encryptionkey@0"
I20260811 05:11:47.677028 23250 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424853995437-27391-0/minicluster-data/master-0/wal/instance:
uuid: "4721c130cce147d3b9ec8d5ea89c0aa6"
format_stamp: "Formatted at 2026-08-11 05:11:47 on dist-test-slave-x5fp"
server_key: "69fc0b92a54b8c57c6759cafba6d8457"
server_key_iv: "781a5af355b43b880ccf73de52129f52"
server_key_version: "encryptionkey@0"
I20260811 05:11:47.678512 23250 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:11:47.679436 23268 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:11:47.679665 23250 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:11:47.679800 23250 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424853995437-27391-0/minicluster-data/master-0/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424853995437-27391-0/minicluster-data/master-0/wal
uuid: "4721c130cce147d3b9ec8d5ea89c0aa6"
format_stamp: "Formatted at 2026-08-11 05:11:47 on dist-test-slave-x5fp"
server_key: "69fc0b92a54b8c57c6759cafba6d8457"
server_key_iv: "781a5af355b43b880ccf73de52129f52"
server_key_version: "encryptionkey@0"
I20260811 05:11:47.679885 23250 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424853995437-27391-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424853995437-27391-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424853995437-27391-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:11:47.714030 23250 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:11:47.714473 23250 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:11:47.714655 23250 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:11:47.719313 23250 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.254:36703
I20260811 05:11:47.719358 23358 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.254:36703 every 8 connection(s)
I20260811 05:11:47.719761 23250 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
I20260811 05:11:47.720849 23361 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:11:47.723218 23361 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4721c130cce147d3b9ec8d5ea89c0aa6: Bootstrap starting.
I20260811 05:11:47.723780 23361 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4721c130cce147d3b9ec8d5ea89c0aa6: Neither blocks nor log segments found. Creating new log.
I20260811 05:11:47.724035 23361 log.cc:824] T 00000000000000000000000000000000 P 4721c130cce147d3b9ec8d5ea89c0aa6: Log is configured to *not* fsync() on all Append() calls
I20260811 05:11:47.724638 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 23250
I20260811 05:11:47.724776 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424853995437-27391-0/minicluster-data/master-0/wal/instance
I20260811 05:11:47.724781 23361 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4721c130cce147d3b9ec8d5ea89c0aa6: No bootstrap required, opened a new log
I20260811 05:11:47.724983 27391 external_mini_cluster.cc:1428] Setting key 43d621b88f61a67dec5fb6859047ae7d
I20260811 05:11:47.727653 23361 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4721c130cce147d3b9ec8d5ea89c0aa6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4721c130cce147d3b9ec8d5ea89c0aa6" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 36703 } }
I20260811 05:11:47.727845 23361 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4721c130cce147d3b9ec8d5ea89c0aa6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:11:47.727883 23361 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4721c130cce147d3b9ec8d5ea89c0aa6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4721c130cce147d3b9ec8d5ea89c0aa6, State: Initialized, Role: FOLLOWER
I20260811 05:11:47.728014 23361 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4721c130cce147d3b9ec8d5ea89c0aa6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4721c130cce147d3b9ec8d5ea89c0aa6" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 36703 } }
I20260811 05:11:47.728096 23361 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4721c130cce147d3b9ec8d5ea89c0aa6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:11:47.728124 23361 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4721c130cce147d3b9ec8d5ea89c0aa6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:11:47.728171 23361 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4721c130cce147d3b9ec8d5ea89c0aa6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:11:47.728962 23361 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4721c130cce147d3b9ec8d5ea89c0aa6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4721c130cce147d3b9ec8d5ea89c0aa6" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 36703 } }
I20260811 05:11:47.729090 23361 leader_election.cc:302] T 00000000000000000000000000000000 P 4721c130cce147d3b9ec8d5ea89c0aa6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4721c130cce147d3b9ec8d5ea89c0aa6; no voters:
I20260811 05:11:47.729310 23361 leader_election.cc:288] T 00000000000000000000000000000000 P 4721c130cce147d3b9ec8d5ea89c0aa6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 05:11:47.729503 23377 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4721c130cce147d3b9ec8d5ea89c0aa6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:11:47.729637 23361 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4721c130cce147d3b9ec8d5ea89c0aa6 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:11:47.730070 23377 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4721c130cce147d3b9ec8d5ea89c0aa6 [term 1 LEADER]: Becoming Leader. State: Replica: 4721c130cce147d3b9ec8d5ea89c0aa6, State: Running, Role: LEADER
I20260811 05:11:47.730255 23377 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4721c130cce147d3b9ec8d5ea89c0aa6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4721c130cce147d3b9ec8d5ea89c0aa6" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 36703 } }
I20260811 05:11:47.730887 23375 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4721c130cce147d3b9ec8d5ea89c0aa6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4721c130cce147d3b9ec8d5ea89c0aa6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4721c130cce147d3b9ec8d5ea89c0aa6" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 36703 } } }
I20260811 05:11:47.730985 23375 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4721c130cce147d3b9ec8d5ea89c0aa6 [sys.catalog]: This master's current role is: LEADER
I20260811 05:11:47.731171 23373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:47.725593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56962 (local address 127.26.191.254:36703)
0811 05:11:47.725790 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0811 05:11:47.725797 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 05:11:47.725825 (+ 28us) server_negotiation.cc:407] Connection header received
0811 05:11:47.726242 (+ 417us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:11:47.726248 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:11:47.726306 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:11:47.726429 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:11:47.726682 (+ 253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:47.727572 (+ 890us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:47.728686 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:47.729225 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:47.729373 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:47.730190 (+ 817us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:11:47.730194 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:11:47.730194 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:11:47.730428 (+ 234us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:11:47.730471 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:11:47.730486 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:11:47.730553 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 05:11:47.730656 (+ 103us) server_negotiation.cc:299] Negotiation successful
0811 05:11:47.730872 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122,"thread_start_us":90,"threads_started":1}
I20260811 05:11:47.731212 23378 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4721c130cce147d3b9ec8d5ea89c0aa6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4721c130cce147d3b9ec8d5ea89c0aa6. Latest consensus state: current_term: 1 leader_uuid: "4721c130cce147d3b9ec8d5ea89c0aa6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4721c130cce147d3b9ec8d5ea89c0aa6" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 36703 } } }
I20260811 05:11:47.731392 23378 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4721c130cce147d3b9ec8d5ea89c0aa6 [sys.catalog]: This master's current role is: LEADER
W20260811 05:11:47.731734 23401 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 4721c130cce147d3b9ec8d5ea89c0aa6: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 05:11:47.731833 23401 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 05:11:47.732838 23400 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:11:47.733062 23400 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:11:47.734619 23400 catalog_manager.cc:1347] Generated new cluster ID: 3b2c5cb5a6374c64848383f5a344d72c
I20260811 05:11:47.734678 23400 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:11:47.758487 23400 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:11:47.759222 23400 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:11:47.766276 23400 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4721c130cce147d3b9ec8d5ea89c0aa6: Generated new TSK 0
I20260811 05:11:47.766476 23400 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 05:11:47.769833 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424853995437-27391-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424853995437-27391-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424853995437-27391-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424853995437-27391-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.191.193:0
--local_ip_for_outbound_sockets=127.26.191.193
--webserver_interface=127.26.191.193
--webserver_port=0
--tserver_master_addrs=127.26.191.254:36703
--builtin_ntp_servers=127.26.191.212:46347
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 05:11:47.862445 23408 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:11:47.862718 23408 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:11:47.862761 23408 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:11:47.863933 23408 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:11:47.864001 23408 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:11:47.864043 23408 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.191.193
I20260811 05:11:47.865468 23408 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:46347
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424853995437-27391-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424853995437-27391-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.191.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424853995437-27391-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.191.193
--webserver_port=0
--tserver_master_addrs=127.26.191.254:36703
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23408
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.191.193
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424853995437-27391-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:11:47.865764 23408 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:11:47.866096 23408 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:11:47.872176 23417 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:11:47.872205 23415 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:11:47.872205 23420 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:11:47.872450 23408 server_base.cc:1034] running on GCE node
I20260811 05:11:47.872668 23408 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:11:47.872999 23408 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:11:47.874177 23408 hybrid_clock.cc:648] HybridClock initialized: now 1786425107874149 us; error 41 us; skew 500 ppm
I20260811 05:11:47.875543 23408 webserver.cc:460] Webserver started at http://127.26.191.193:38545/ using document root <none> and password file <none>
I20260811 05:11:47.875821 23408 fs_manager.cc:359] Metadata directory not provided
I20260811 05:11:47.875898 23408 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:11:47.876066 23408 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:11:47.877254 23408 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424853995437-27391-0/minicluster-data/ts-0/data/instance:
uuid: "1075e6077957466793c4c15316d39b2d"
format_stamp: "Formatted at 2026-08-11 05:11:47 on dist-test-slave-x5fp"
server_key: "b6864b9e60f0e4dce0581b133dea5d1c"
server_key_iv: "6293373b12ead7cf5d403ddc01a5e013"
server_key_version: "encryptionkey@0"
I20260811 05:11:47.877637 23408 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424853995437-27391-0/minicluster-data/ts-0/wal/instance:
uuid: "1075e6077957466793c4c15316d39b2d"
format_stamp: "Formatted at 2026-08-11 05:11:47 on dist-test-slave-x5fp"
server_key: "b6864b9e60f0e4dce0581b133dea5d1c"
server_key_iv: "6293373b12ead7cf5d403ddc01a5e013"
server_key_version: "encryptionkey@0"
I20260811 05:11:47.879194 23408 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 05:11:47.880048 23429 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:11:47.880285 23408 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:11:47.880409 23408 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424853995437-27391-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424853995437-27391-0/minicluster-data/ts-0/wal
uuid: "1075e6077957466793c4c15316d39b2d"
format_stamp: "Formatted at 2026-08-11 05:11:47 on dist-test-slave-x5fp"
server_key: "b6864b9e60f0e4dce0581b133dea5d1c"
server_key_iv: "6293373b12ead7cf5d403ddc01a5e013"
server_key_version: "encryptionkey@0"
I20260811 05:11:47.880492 23408 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424853995437-27391-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424853995437-27391-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424853995437-27391-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:11:47.909406 23408 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:11:47.909787 23408 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:11:47.909965 23408 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:11:47.910251 23408 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:11:47.910625 23408 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:11:47.910691 23408 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:11:47.910727 23408 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:11:47.910746 23408 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:11:47.916780 23408 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.193:45115
I20260811 05:11:47.916850 23607 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.193:45115 every 8 connection(s)
I20260811 05:11:47.917240 23408 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424853995437-27391-0/minicluster-data/ts-0/data/info.pb
I20260811 05:11:47.922705 23373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:47.918062 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.193:40449 (local address 127.26.191.254:36703)
0811 05:11:47.918144 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0811 05:11:47.918146 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:11:47.918368 (+ 222us) server_negotiation.cc:407] Connection header received
0811 05:11:47.918904 (+ 536us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:11:47.918906 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:11:47.918921 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:11:47.918977 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:11:47.919641 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:47.920151 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:47.921128 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:47.921333 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:47.921385 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:47.922355 (+ 970us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:11:47.922357 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:11:47.922357 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:11:47.922362 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:11:47.922390 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:11:47.922394 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:11:47.922450 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 05:11:47.922606 (+ 156us) server_negotiation.cc:299] Negotiation successful
0811 05:11:47.922639 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 05:11:47.922936 23611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:47.918028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:36703 (local address 127.26.191.193:40449)
0811 05:11:47.918257 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:47.918293 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 05:11:47.918799 (+ 506us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:11:47.919029 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:11:47.919032 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:11:47.919041 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:11:47.919570 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:47.919574 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:47.920233 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:47.920233 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:47.921046 (+ 813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:47.921048 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:47.921439 (+ 391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:47.921440 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:47.921571 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:47.922194 (+ 623us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 05:11:47.922203 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:11:47.922234 (+ 31us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 05:11:47.922257 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:11:47.922486 (+ 229us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:11:47.922493 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:11:47.922496 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 05:11:47.922572 (+ 76us) client_negotiation.cc:240] Negotiation successful
0811 05:11:47.922662 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":116,"threads_started":1}
I20260811 05:11:47.923538 23608 heartbeater.cc:347] Connected to a master server at 127.26.191.254:36703
I20260811 05:11:47.923624 23608 heartbeater.cc:464] Registering TS with master...
I20260811 05:11:47.923779 23608 heartbeater.cc:511] Master 127.26.191.254:36703 requested a full tablet report, sending...
I20260811 05:11:47.924471 23305 ts_manager.cc:194] Registered new tserver with Master: 1075e6077957466793c4c15316d39b2d (127.26.191.193:45115)
I20260811 05:11:47.925139 23305 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.191.193:40449
I20260811 05:11:47.926594 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 23408
I20260811 05:11:47.926707 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424853995437-27391-0/minicluster-data/ts-0/wal/instance
I20260811 05:11:47.926905 27391 external_mini_cluster.cc:1428] Setting key 9cac61b44adacef6ca72313917c07736
I20260811 05:11:47.927824 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424853995437-27391-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424853995437-27391-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424853995437-27391-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424853995437-27391-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.191.194:0
--local_ip_for_outbound_sockets=127.26.191.194
--webserver_interface=127.26.191.194
--webserver_port=0
--tserver_master_addrs=127.26.191.254:36703
--builtin_ntp_servers=127.26.191.212:46347
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 05:11:48.017379 23612 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:11:48.017604 23612 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:11:48.017627 23612 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:11:48.018731 23612 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:11:48.018767 23612 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:11:48.018791 23612 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.191.194
I20260811 05:11:48.020081 23612 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:46347
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424853995437-27391-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424853995437-27391-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.191.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424853995437-27391-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.191.194
--webserver_port=0
--tserver_master_addrs=127.26.191.254:36703
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23612
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.191.194
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424853995437-27391-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:11:48.020279 23612 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:11:48.020552 23612 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:11:48.025875 23618 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:11:48.025892 23623 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:11:48.025936 23619 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:11:48.026219 23612 server_base.cc:1034] running on GCE node
I20260811 05:11:48.026484 23612 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:11:48.026696 23612 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:11:48.027861 23612 hybrid_clock.cc:648] HybridClock initialized: now 1786425108027852 us; error 36 us; skew 500 ppm
I20260811 05:11:48.029294 23612 webserver.cc:460] Webserver started at http://127.26.191.194:35731/ using document root <none> and password file <none>
I20260811 05:11:48.029501 23612 fs_manager.cc:359] Metadata directory not provided
I20260811 05:11:48.029543 23612 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:11:48.029640 23612 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:11:48.030869 23612 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424853995437-27391-0/minicluster-data/ts-1/data/instance:
uuid: "d7c1e6b5128545fdab3edb90f84ecd12"
format_stamp: "Formatted at 2026-08-11 05:11:48 on dist-test-slave-x5fp"
server_key: "dd4dee2f7f74d6114b00a08c3d011124"
server_key_iv: "09dd38085770110891e5307a41942ce2"
server_key_version: "encryptionkey@0"
I20260811 05:11:48.031184 23612 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424853995437-27391-0/minicluster-data/ts-1/wal/instance:
uuid: "d7c1e6b5128545fdab3edb90f84ecd12"
format_stamp: "Formatted at 2026-08-11 05:11:48 on dist-test-slave-x5fp"
server_key: "dd4dee2f7f74d6114b00a08c3d011124"
server_key_iv: "09dd38085770110891e5307a41942ce2"
server_key_version: "encryptionkey@0"
I20260811 05:11:48.032534 23612 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 05:11:48.033387 23638 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:11:48.033730 23612 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 05:11:48.033823 23612 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424853995437-27391-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424853995437-27391-0/minicluster-data/ts-1/wal
uuid: "d7c1e6b5128545fdab3edb90f84ecd12"
format_stamp: "Formatted at 2026-08-11 05:11:48 on dist-test-slave-x5fp"
server_key: "dd4dee2f7f74d6114b00a08c3d011124"
server_key_iv: "09dd38085770110891e5307a41942ce2"
server_key_version: "encryptionkey@0"
I20260811 05:11:48.033891 23612 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424853995437-27391-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424853995437-27391-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424853995437-27391-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:11:48.060392 23612 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:11:48.060827 23612 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:11:48.060966 23612 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:11:48.061196 23612 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:11:48.061582 23612 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:11:48.061630 23612 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:11:48.061683 23612 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:11:48.061722 23612 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:11:48.068327 23612 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.194:43739
I20260811 05:11:48.068413 23816 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.194:43739 every 8 connection(s)
I20260811 05:11:48.068872 23612 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424853995437-27391-0/minicluster-data/ts-1/data/info.pb
I20260811 05:11:48.074383 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 23612
I20260811 05:11:48.074501 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424853995437-27391-0/minicluster-data/ts-1/wal/instance
I20260811 05:11:48.074738 27391 external_mini_cluster.cc:1428] Setting key f767c405555efc3b612a8aa6172b3b0e
I20260811 05:11:48.074719 23373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:48.069757 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.194:44829 (local address 127.26.191.254:36703)
0811 05:11:48.069830 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0811 05:11:48.069832 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:11:48.070112 (+ 280us) server_negotiation.cc:407] Connection header received
0811 05:11:48.070702 (+ 590us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:11:48.070703 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:11:48.070717 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:11:48.070802 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:11:48.071561 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:48.072091 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:48.073183 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:48.073407 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:48.073484 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:48.074379 (+ 895us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:11:48.074381 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:11:48.074382 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:11:48.074387 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:11:48.074403 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:11:48.074408 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:11:48.074466 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 05:11:48.074631 (+ 165us) server_negotiation.cc:299] Negotiation successful
0811 05:11:48.074655 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 05:11:48.075037 23820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:48.069734 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:36703 (local address 127.26.191.194:44829)
0811 05:11:48.069982 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:48.070026 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 05:11:48.070574 (+ 548us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:11:48.070887 (+ 313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:11:48.070890 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:11:48.070898 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:11:48.071461 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:48.071466 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:48.072198 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:48.072199 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:48.073092 (+ 893us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:48.073095 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:48.073506 (+ 411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:48.073507 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:48.073643 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:48.074217 (+ 574us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 05:11:48.074217 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:11:48.074259 (+ 42us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 05:11:48.074282 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:11:48.074501 (+ 219us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:11:48.074509 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:11:48.074513 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 05:11:48.074629 (+ 116us) client_negotiation.cc:240] Negotiation successful
0811 05:11:48.074765 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":104,"threads_started":1}
I20260811 05:11:48.075536 23817 heartbeater.cc:347] Connected to a master server at 127.26.191.254:36703
I20260811 05:11:48.075654 23817 heartbeater.cc:464] Registering TS with master...
I20260811 05:11:48.075851 23817 heartbeater.cc:511] Master 127.26.191.254:36703 requested a full tablet report, sending...
I20260811 05:11:48.075971 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424853995437-27391-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424853995437-27391-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424853995437-27391-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424853995437-27391-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.191.195:0
--local_ip_for_outbound_sockets=127.26.191.195
--webserver_interface=127.26.191.195
--webserver_port=0
--tserver_master_addrs=127.26.191.254:36703
--builtin_ntp_servers=127.26.191.212:46347
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 05:11:48.076287 23302 ts_manager.cc:194] Registered new tserver with Master: d7c1e6b5128545fdab3edb90f84ecd12 (127.26.191.194:43739)
I20260811 05:11:48.076833 23302 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.191.194:44829
W20260811 05:11:48.163911 23821 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:11:48.164136 23821 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:11:48.164160 23821 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:11:48.165308 23821 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:11:48.165347 23821 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:11:48.165374 23821 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.191.195
I20260811 05:11:48.166680 23821 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:46347
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424853995437-27391-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424853995437-27391-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.191.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424853995437-27391-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.191.195
--webserver_port=0
--tserver_master_addrs=127.26.191.254:36703
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23821
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.191.195
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424853995437-27391-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:11:48.166890 23821 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:11:48.167160 23821 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:11:48.172720 23830 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:11:48.172746 23831 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:11:48.172784 23833 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:11:48.172981 23821 server_base.cc:1034] running on GCE node
I20260811 05:11:48.173313 23821 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:11:48.173544 23821 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:11:48.174724 23821 hybrid_clock.cc:648] HybridClock initialized: now 1786425108174700 us; error 44 us; skew 500 ppm
I20260811 05:11:48.176054 23821 webserver.cc:460] Webserver started at http://127.26.191.195:42439/ using document root <none> and password file <none>
I20260811 05:11:48.176362 23821 fs_manager.cc:359] Metadata directory not provided
I20260811 05:11:48.176421 23821 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:11:48.176584 23821 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:11:48.177867 23821 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424853995437-27391-0/minicluster-data/ts-2/data/instance:
uuid: "4ea880bb4c0f4dacb7a09261d425d690"
format_stamp: "Formatted at 2026-08-11 05:11:48 on dist-test-slave-x5fp"
server_key: "4277a76e90d6207c2fd1a2e86f3aa029"
server_key_iv: "b3cf290f562724f9a298900e7facd75a"
server_key_version: "encryptionkey@0"
I20260811 05:11:48.178234 23821 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424853995437-27391-0/minicluster-data/ts-2/wal/instance:
uuid: "4ea880bb4c0f4dacb7a09261d425d690"
format_stamp: "Formatted at 2026-08-11 05:11:48 on dist-test-slave-x5fp"
server_key: "4277a76e90d6207c2fd1a2e86f3aa029"
server_key_iv: "b3cf290f562724f9a298900e7facd75a"
server_key_version: "encryptionkey@0"
I20260811 05:11:48.179618 23821 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 05:11:48.180456 23843 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:11:48.180671 23821 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:11:48.180812 23821 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424853995437-27391-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424853995437-27391-0/minicluster-data/ts-2/wal
uuid: "4ea880bb4c0f4dacb7a09261d425d690"
format_stamp: "Formatted at 2026-08-11 05:11:48 on dist-test-slave-x5fp"
server_key: "4277a76e90d6207c2fd1a2e86f3aa029"
server_key_iv: "b3cf290f562724f9a298900e7facd75a"
server_key_version: "encryptionkey@0"
I20260811 05:11:48.180895 23821 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424853995437-27391-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424853995437-27391-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424853995437-27391-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:11:48.198239 23821 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:11:48.198633 23821 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:11:48.198818 23821 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:11:48.199080 23821 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:11:48.199460 23821 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:11:48.199517 23821 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:11:48.199561 23821 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:11:48.199590 23821 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:11:48.205965 23821 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.195:42859
I20260811 05:11:48.206013 24017 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.195:42859 every 8 connection(s)
I20260811 05:11:48.206396 23821 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424853995437-27391-0/minicluster-data/ts-2/data/info.pb
I20260811 05:11:48.211768 23373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:48.207339 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.195:33865 (local address 127.26.191.254:36703)
0811 05:11:48.207407 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 05:11:48.207409 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:11:48.207639 (+ 230us) server_negotiation.cc:407] Connection header received
0811 05:11:48.208154 (+ 515us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:11:48.208155 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:11:48.208166 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:11:48.208237 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:11:48.208938 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:48.209438 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:48.210442 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:48.210624 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:48.210679 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:48.211527 (+ 848us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:11:48.211528 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:11:48.211528 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:11:48.211532 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:11:48.211547 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:11:48.211550 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:11:48.211595 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0811 05:11:48.211685 (+ 90us) server_negotiation.cc:299] Negotiation successful
0811 05:11:48.211707 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 05:11:48.212052 24020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:48.207318 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:36703 (local address 127.26.191.195:33865)
0811 05:11:48.207506 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:48.207549 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 05:11:48.208064 (+ 515us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:11:48.208295 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:11:48.208299 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:11:48.208307 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:11:48.208854 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:48.208858 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:48.209524 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:48.209525 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:48.210362 (+ 837us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:48.210364 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:48.210729 (+ 365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:48.210730 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:48.210851 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:48.211382 (+ 531us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 05:11:48.211383 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:11:48.211415 (+ 32us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 05:11:48.211438 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:11:48.211610 (+ 172us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:11:48.211614 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:11:48.211616 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 05:11:48.211670 (+ 54us) client_negotiation.cc:240] Negotiation successful
0811 05:11:48.211782 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":82,"threads_started":1}
I20260811 05:11:48.212636 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 23821
I20260811 05:11:48.212767 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424853995437-27391-0/minicluster-data/ts-2/wal/instance
I20260811 05:11:48.212795 24018 heartbeater.cc:347] Connected to a master server at 127.26.191.254:36703
I20260811 05:11:48.212913 24018 heartbeater.cc:464] Registering TS with master...
I20260811 05:11:48.213011 27391 external_mini_cluster.cc:1428] Setting key 685d8d44bafc0a5605fb88c245108a03
I20260811 05:11:48.213145 24018 heartbeater.cc:511] Master 127.26.191.254:36703 requested a full tablet report, sending...
I20260811 05:11:48.213613 23302 ts_manager.cc:194] Registered new tserver with Master: 4ea880bb4c0f4dacb7a09261d425d690 (127.26.191.195:42859)
I20260811 05:11:48.214105 23302 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.191.195:33865
I20260811 05:11:48.214094 27391 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 05:11:48.219048 23373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:48.215774 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56972 (local address 127.26.191.254:36703)
0811 05:11:48.215836 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 05:11:48.215838 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:11:48.215950 (+ 112us) server_negotiation.cc:407] Connection header received
0811 05:11:48.215988 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:11:48.215989 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:11:48.215999 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:11:48.216061 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:11:48.216241 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:48.216775 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:48.218000 (+ 1225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:48.218187 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:48.218246 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:48.218868 (+ 622us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:11:48.218870 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:11:48.218870 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:11:48.218874 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:11:48.218886 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:11:48.218890 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:11:48.218938 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 05:11:48.218976 (+ 38us) server_negotiation.cc:299] Negotiation successful
0811 05:11:48.218995 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 05:11:48.220782 23302 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56972:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 05:11:48.222586 23302 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 05:11:48.229072 24029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:48.225262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.193:45115 (local address 127.0.0.1:38912)
0811 05:11:48.225617 (+ 355us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:48.225626 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 05:11:48.225678 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:11:48.226010 (+ 332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:11:48.226011 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:11:48.226014 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:11:48.226063 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:48.226064 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:48.226950 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:48.226951 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:48.227904 (+ 953us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:48.227907 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:48.228754 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:48.228755 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:48.228839 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:48.228855 (+ 16us) client_negotiation.cc:769] Sending connection context
0811 05:11:48.228936 (+ 81us) client_negotiation.cc:240] Negotiation successful
0811 05:11:48.228989 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":346,"mutex_wait_us":2,"thread_start_us":65,"threads_started":1}
I20260811 05:11:48.229080 24038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:48.225396 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38912 (local address 127.26.191.193:45115)
0811 05:11:48.225583 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0811 05:11:48.225587 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:11:48.225686 (+ 99us) server_negotiation.cc:407] Connection header received
0811 05:11:48.225754 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:11:48.225757 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:11:48.225774 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:11:48.226019 (+ 245us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:11:48.226135 (+ 116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:48.226848 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:48.228005 (+ 1157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:48.228645 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:48.228752 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:48.228866 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0811 05:11:48.228951 (+ 85us) server_negotiation.cc:299] Negotiation successful
0811 05:11:48.228989 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":115,"threads_started":1}
I20260811 05:11:48.229743 24034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:48.225019 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.195:42859 (local address 127.0.0.1:35422)
0811 05:11:48.225476 (+ 457us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:48.225486 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 05:11:48.225536 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:11:48.225833 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:11:48.225836 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:11:48.225839 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:11:48.225936 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:48.225938 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:48.226919 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:48.226921 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:48.228507 (+ 1586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:48.228510 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:48.229514 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:48.229515 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:48.229576 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:48.229580 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 05:11:48.229625 (+ 45us) client_negotiation.cc:240] Negotiation successful
0811 05:11:48.229663 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":445,"mutex_wait_us":63,"spinlock_wait_cycles":768,"thread_start_us":61,"threads_started":1}
I20260811 05:11:48.229756 24030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:48.225143 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35422 (local address 127.26.191.195:42859)
0811 05:11:48.225393 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0811 05:11:48.225398 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:11:48.225612 (+ 214us) server_negotiation.cc:407] Connection header received
0811 05:11:48.225663 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:11:48.225666 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:11:48.225683 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:11:48.225755 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:11:48.226045 (+ 290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:48.226818 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:48.228591 (+ 1773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:48.229425 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:48.229506 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:48.229600 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0811 05:11:48.229637 (+ 37us) server_negotiation.cc:299] Negotiation successful
0811 05:11:48.229677 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":210,"thread_start_us":127,"threads_started":1}
I20260811 05:11:48.230309 23503 tablet_service.cc:1467] Processing CreateTablet for tablet 4e4550773fd44dc188087f4863ff138d (DEFAULT_TABLE table=test-table [id=2cda28727a3d47aa98c2f936c416221e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:11:48.230463 23914 tablet_service.cc:1467] Processing CreateTablet for tablet 4e4550773fd44dc188087f4863ff138d (DEFAULT_TABLE table=test-table [id=2cda28727a3d47aa98c2f936c416221e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:11:48.230757 23914 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4e4550773fd44dc188087f4863ff138d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:11:48.230758 23503 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4e4550773fd44dc188087f4863ff138d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:11:48.230839 24028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:48.225019 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.194:43739 (local address 127.0.0.1:54336)
0811 05:11:48.225398 (+ 379us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:48.225443 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 05:11:48.225516 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:11:48.227170 (+ 1654us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:11:48.227171 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:11:48.227173 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:11:48.227213 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:48.227214 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:48.228443 (+ 1229us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:48.228444 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:48.229534 (+ 1090us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:48.229536 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:48.230616 (+ 1080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:48.230617 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:48.230664 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:48.230667 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 05:11:48.230733 (+ 66us) client_negotiation.cc:240] Negotiation successful
0811 05:11:48.230775 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":352,"thread_start_us":63,"threads_started":1}
I20260811 05:11:48.230901 24037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:48.225288 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54336 (local address 127.26.191.194:43739)
0811 05:11:48.226997 (+ 1709us) server_negotiation.cc:206] Beginning negotiation
0811 05:11:48.227002 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:11:48.227012 (+ 10us) server_negotiation.cc:407] Connection header received
0811 05:11:48.227054 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:11:48.227056 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:11:48.227071 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:11:48.227155 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:11:48.227285 (+ 130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:48.228358 (+ 1073us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:48.229635 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:48.230432 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:48.230504 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:48.230585 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 05:11:48.230763 (+ 178us) server_negotiation.cc:299] Negotiation successful
0811 05:11:48.230802 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1668,"thread_start_us":102,"threads_started":1}
I20260811 05:11:48.231563 23710 tablet_service.cc:1467] Processing CreateTablet for tablet 4e4550773fd44dc188087f4863ff138d (DEFAULT_TABLE table=test-table [id=2cda28727a3d47aa98c2f936c416221e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:11:48.231850 23710 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4e4550773fd44dc188087f4863ff138d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:11:48.234663 24039 tablet_bootstrap.cc:492] T 4e4550773fd44dc188087f4863ff138d P 1075e6077957466793c4c15316d39b2d: Bootstrap starting.
I20260811 05:11:48.234695 24043 tablet_bootstrap.cc:492] T 4e4550773fd44dc188087f4863ff138d P d7c1e6b5128545fdab3edb90f84ecd12: Bootstrap starting.
I20260811 05:11:48.235383 24039 tablet_bootstrap.cc:654] T 4e4550773fd44dc188087f4863ff138d P 1075e6077957466793c4c15316d39b2d: Neither blocks nor log segments found. Creating new log.
I20260811 05:11:48.235409 24043 tablet_bootstrap.cc:654] T 4e4550773fd44dc188087f4863ff138d P d7c1e6b5128545fdab3edb90f84ecd12: Neither blocks nor log segments found. Creating new log.
I20260811 05:11:48.235745 24039 log.cc:824] T 4e4550773fd44dc188087f4863ff138d P 1075e6077957466793c4c15316d39b2d: Log is configured to *not* fsync() on all Append() calls
I20260811 05:11:48.235744 24043 log.cc:824] T 4e4550773fd44dc188087f4863ff138d P d7c1e6b5128545fdab3edb90f84ecd12: Log is configured to *not* fsync() on all Append() calls
I20260811 05:11:48.236104 24041 tablet_bootstrap.cc:492] T 4e4550773fd44dc188087f4863ff138d P 4ea880bb4c0f4dacb7a09261d425d690: Bootstrap starting.
I20260811 05:11:48.236582 24039 tablet_bootstrap.cc:492] T 4e4550773fd44dc188087f4863ff138d P 1075e6077957466793c4c15316d39b2d: No bootstrap required, opened a new log
I20260811 05:11:48.236608 24043 tablet_bootstrap.cc:492] T 4e4550773fd44dc188087f4863ff138d P d7c1e6b5128545fdab3edb90f84ecd12: No bootstrap required, opened a new log
I20260811 05:11:48.236660 24039 ts_tablet_manager.cc:1397] T 4e4550773fd44dc188087f4863ff138d P 1075e6077957466793c4c15316d39b2d: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 05:11:48.236660 24043 ts_tablet_manager.cc:1397] T 4e4550773fd44dc188087f4863ff138d P d7c1e6b5128545fdab3edb90f84ecd12: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 05:11:48.236855 24041 tablet_bootstrap.cc:654] T 4e4550773fd44dc188087f4863ff138d P 4ea880bb4c0f4dacb7a09261d425d690: Neither blocks nor log segments found. Creating new log.
I20260811 05:11:48.237167 24041 log.cc:824] T 4e4550773fd44dc188087f4863ff138d P 4ea880bb4c0f4dacb7a09261d425d690: Log is configured to *not* fsync() on all Append() calls
I20260811 05:11:48.238113 24041 tablet_bootstrap.cc:492] T 4e4550773fd44dc188087f4863ff138d P 4ea880bb4c0f4dacb7a09261d425d690: No bootstrap required, opened a new log
I20260811 05:11:48.238215 24041 ts_tablet_manager.cc:1397] T 4e4550773fd44dc188087f4863ff138d P 4ea880bb4c0f4dacb7a09261d425d690: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 05:11:48.239467 24043 raft_consensus.cc:348] T 4e4550773fd44dc188087f4863ff138d P d7c1e6b5128545fdab3edb90f84ecd12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ea880bb4c0f4dacb7a09261d425d690" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 42859 } } peers { permanent_uuid: "d7c1e6b5128545fdab3edb90f84ecd12" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 43739 } } peers { permanent_uuid: "1075e6077957466793c4c15316d39b2d" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 45115 } }
I20260811 05:11:48.239467 24039 raft_consensus.cc:348] T 4e4550773fd44dc188087f4863ff138d P 1075e6077957466793c4c15316d39b2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ea880bb4c0f4dacb7a09261d425d690" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 42859 } } peers { permanent_uuid: "d7c1e6b5128545fdab3edb90f84ecd12" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 43739 } } peers { permanent_uuid: "1075e6077957466793c4c15316d39b2d" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 45115 } }
I20260811 05:11:48.239645 24043 raft_consensus.cc:374] T 4e4550773fd44dc188087f4863ff138d P d7c1e6b5128545fdab3edb90f84ecd12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:11:48.239645 24039 raft_consensus.cc:374] T 4e4550773fd44dc188087f4863ff138d P 1075e6077957466793c4c15316d39b2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:11:48.239683 24039 raft_consensus.cc:729] T 4e4550773fd44dc188087f4863ff138d P 1075e6077957466793c4c15316d39b2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1075e6077957466793c4c15316d39b2d, State: Initialized, Role: FOLLOWER
I20260811 05:11:48.239683 24043 raft_consensus.cc:729] T 4e4550773fd44dc188087f4863ff138d P d7c1e6b5128545fdab3edb90f84ecd12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7c1e6b5128545fdab3edb90f84ecd12, State: Initialized, Role: FOLLOWER
I20260811 05:11:48.239807 24043 consensus_queue.cc:260] T 4e4550773fd44dc188087f4863ff138d P d7c1e6b5128545fdab3edb90f84ecd12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ea880bb4c0f4dacb7a09261d425d690" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 42859 } } peers { permanent_uuid: "d7c1e6b5128545fdab3edb90f84ecd12" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 43739 } } peers { permanent_uuid: "1075e6077957466793c4c15316d39b2d" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 45115 } }
I20260811 05:11:48.239835 24039 consensus_queue.cc:260] T 4e4550773fd44dc188087f4863ff138d P 1075e6077957466793c4c15316d39b2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ea880bb4c0f4dacb7a09261d425d690" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 42859 } } peers { permanent_uuid: "d7c1e6b5128545fdab3edb90f84ecd12" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 43739 } } peers { permanent_uuid: "1075e6077957466793c4c15316d39b2d" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 45115 } }
I20260811 05:11:48.240070 24039 ts_tablet_manager.cc:1428] T 4e4550773fd44dc188087f4863ff138d P 1075e6077957466793c4c15316d39b2d: Time spent starting tablet: real 0.003s user 0.000s sys 0.004s
I20260811 05:11:48.240070 24043 ts_tablet_manager.cc:1428] T 4e4550773fd44dc188087f4863ff138d P d7c1e6b5128545fdab3edb90f84ecd12: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 05:11:48.240193 23608 heartbeater.cc:503] Master 127.26.191.254:36703 was elected leader, sending a full tablet report...
I20260811 05:11:48.240309 23817 heartbeater.cc:503] Master 127.26.191.254:36703 was elected leader, sending a full tablet report...
I20260811 05:11:48.240319 24041 raft_consensus.cc:348] T 4e4550773fd44dc188087f4863ff138d P 4ea880bb4c0f4dacb7a09261d425d690 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ea880bb4c0f4dacb7a09261d425d690" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 42859 } } peers { permanent_uuid: "d7c1e6b5128545fdab3edb90f84ecd12" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 43739 } } peers { permanent_uuid: "1075e6077957466793c4c15316d39b2d" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 45115 } }
I20260811 05:11:48.240509 24041 raft_consensus.cc:374] T 4e4550773fd44dc188087f4863ff138d P 4ea880bb4c0f4dacb7a09261d425d690 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:11:48.240551 24041 raft_consensus.cc:729] T 4e4550773fd44dc188087f4863ff138d P 4ea880bb4c0f4dacb7a09261d425d690 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ea880bb4c0f4dacb7a09261d425d690, State: Initialized, Role: FOLLOWER
I20260811 05:11:48.240700 24041 consensus_queue.cc:260] T 4e4550773fd44dc188087f4863ff138d P 4ea880bb4c0f4dacb7a09261d425d690 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ea880bb4c0f4dacb7a09261d425d690" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 42859 } } peers { permanent_uuid: "d7c1e6b5128545fdab3edb90f84ecd12" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 43739 } } peers { permanent_uuid: "1075e6077957466793c4c15316d39b2d" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 45115 } }
I20260811 05:11:48.241097 24041 ts_tablet_manager.cc:1428] T 4e4550773fd44dc188087f4863ff138d P 4ea880bb4c0f4dacb7a09261d425d690: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 05:11:48.241243 24018 heartbeater.cc:503] Master 127.26.191.254:36703 was elected leader, sending a full tablet report...
I20260811 05:11:48.256184 24050 raft_consensus.cc:482] T 4e4550773fd44dc188087f4863ff138d P 1075e6077957466793c4c15316d39b2d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 05:11:48.256320 24050 raft_consensus.cc:504] T 4e4550773fd44dc188087f4863ff138d P 1075e6077957466793c4c15316d39b2d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ea880bb4c0f4dacb7a09261d425d690" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 42859 } } peers { permanent_uuid: "d7c1e6b5128545fdab3edb90f84ecd12" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 43739 } } peers { permanent_uuid: "1075e6077957466793c4c15316d39b2d" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 45115 } }
I20260811 05:11:48.256826 24050 leader_election.cc:288] T 4e4550773fd44dc188087f4863ff138d P 1075e6077957466793c4c15316d39b2d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4ea880bb4c0f4dacb7a09261d425d690 (127.26.191.195:42859), d7c1e6b5128545fdab3edb90f84ecd12 (127.26.191.194:43739)
I20260811 05:11:48.260088 24037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:48.257179 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.193:57523 (local address 127.26.191.194:43739)
0811 05:11:48.257252 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0811 05:11:48.257254 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:11:48.257265 (+ 11us) server_negotiation.cc:407] Connection header received
0811 05:11:48.257321 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:11:48.257322 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:11:48.257335 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:11:48.257404 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:11:48.257575 (+ 171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:48.258364 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:48.259278 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:48.259675 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:48.259731 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:48.259739 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 05:11:48.259960 (+ 221us) server_negotiation.cc:299] Negotiation successful
0811 05:11:48.260002 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 05:11:48.260089 24030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:48.257052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.193:52699 (local address 127.26.191.195:42859)
0811 05:11:48.257114 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 05:11:48.257116 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:11:48.257242 (+ 126us) server_negotiation.cc:407] Connection header received
0811 05:11:48.257351 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:11:48.257352 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:11:48.257363 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:11:48.257415 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:11:48.257656 (+ 241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:48.258355 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:48.259344 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:48.259696 (+ 352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:48.259795 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:48.259804 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 05:11:48.259968 (+ 164us) server_negotiation.cc:299] Negotiation successful
0811 05:11:48.260007 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 05:11:48.260118 23611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:48.256975 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.194:43739 (local address 127.26.191.193:57523)
0811 05:11:48.257015 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:48.257029 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 05:11:48.257081 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:11:48.257425 (+ 344us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:11:48.257426 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:11:48.257428 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:11:48.257506 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:48.257508 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:48.258438 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:48.258439 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:48.259184 (+ 745us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:48.259186 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:48.259764 (+ 578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:48.259765 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:48.259877 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:48.259880 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 05:11:48.259951 (+ 71us) client_negotiation.cc:240] Negotiation successful
0811 05:11:48.259996 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":19}
I20260811 05:11:48.260128 24054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:48.256980 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.195:42859 (local address 127.26.191.193:52699)
0811 05:11:48.257184 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:48.257193 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 05:11:48.257268 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:11:48.257467 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:11:48.257467 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:11:48.257470 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:11:48.257576 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:48.257577 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:48.258474 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:48.258475 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:48.259252 (+ 777us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:48.259254 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:48.259814 (+ 560us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:48.259815 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:48.259878 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:48.259881 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 05:11:48.259948 (+ 67us) client_negotiation.cc:240] Negotiation successful
0811 05:11:48.259994 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":188,"mutex_wait_us":16,"thread_start_us":119,"threads_started":1}
I20260811 05:11:48.260541 23744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4e4550773fd44dc188087f4863ff138d" candidate_uuid: "1075e6077957466793c4c15316d39b2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7c1e6b5128545fdab3edb90f84ecd12" is_pre_election: true
I20260811 05:11:48.260740 23744 raft_consensus.cc:2454] T 4e4550773fd44dc188087f4863ff138d P d7c1e6b5128545fdab3edb90f84ecd12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1075e6077957466793c4c15316d39b2d in term 0.
I20260811 05:11:48.260774 23943 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4e4550773fd44dc188087f4863ff138d" candidate_uuid: "1075e6077957466793c4c15316d39b2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ea880bb4c0f4dacb7a09261d425d690" is_pre_election: true
I20260811 05:11:48.260911 23943 raft_consensus.cc:2454] T 4e4550773fd44dc188087f4863ff138d P 4ea880bb4c0f4dacb7a09261d425d690 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1075e6077957466793c4c15316d39b2d in term 0.
I20260811 05:11:48.261152 23433 leader_election.cc:302] T 4e4550773fd44dc188087f4863ff138d P 1075e6077957466793c4c15316d39b2d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1075e6077957466793c4c15316d39b2d, 4ea880bb4c0f4dacb7a09261d425d690; no voters:
I20260811 05:11:48.261310 24050 raft_consensus.cc:2781] T 4e4550773fd44dc188087f4863ff138d P 1075e6077957466793c4c15316d39b2d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 05:11:48.261380 24050 raft_consensus.cc:482] T 4e4550773fd44dc188087f4863ff138d P 1075e6077957466793c4c15316d39b2d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 05:11:48.261417 24050 raft_consensus.cc:3037] T 4e4550773fd44dc188087f4863ff138d P 1075e6077957466793c4c15316d39b2d [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:11:48.262167 24050 raft_consensus.cc:504] T 4e4550773fd44dc188087f4863ff138d P 1075e6077957466793c4c15316d39b2d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ea880bb4c0f4dacb7a09261d425d690" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 42859 } } peers { permanent_uuid: "d7c1e6b5128545fdab3edb90f84ecd12" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 43739 } } peers { permanent_uuid: "1075e6077957466793c4c15316d39b2d" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 45115 } }
I20260811 05:11:48.262326 24050 leader_election.cc:288] T 4e4550773fd44dc188087f4863ff138d P 1075e6077957466793c4c15316d39b2d [CANDIDATE]: Term 1 election: Requested vote from peers 4ea880bb4c0f4dacb7a09261d425d690 (127.26.191.195:42859), d7c1e6b5128545fdab3edb90f84ecd12 (127.26.191.194:43739)
I20260811 05:11:48.262471 23744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4e4550773fd44dc188087f4863ff138d" candidate_uuid: "1075e6077957466793c4c15316d39b2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7c1e6b5128545fdab3edb90f84ecd12"
I20260811 05:11:48.262485 23943 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4e4550773fd44dc188087f4863ff138d" candidate_uuid: "1075e6077957466793c4c15316d39b2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ea880bb4c0f4dacb7a09261d425d690"
I20260811 05:11:48.262565 23943 raft_consensus.cc:3037] T 4e4550773fd44dc188087f4863ff138d P 4ea880bb4c0f4dacb7a09261d425d690 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:11:48.262568 23744 raft_consensus.cc:3037] T 4e4550773fd44dc188087f4863ff138d P d7c1e6b5128545fdab3edb90f84ecd12 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:11:48.263311 23744 raft_consensus.cc:2454] T 4e4550773fd44dc188087f4863ff138d P d7c1e6b5128545fdab3edb90f84ecd12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1075e6077957466793c4c15316d39b2d in term 1.
I20260811 05:11:48.263321 23943 raft_consensus.cc:2454] T 4e4550773fd44dc188087f4863ff138d P 4ea880bb4c0f4dacb7a09261d425d690 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1075e6077957466793c4c15316d39b2d in term 1.
I20260811 05:11:48.263500 23431 leader_election.cc:302] T 4e4550773fd44dc188087f4863ff138d P 1075e6077957466793c4c15316d39b2d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1075e6077957466793c4c15316d39b2d, d7c1e6b5128545fdab3edb90f84ecd12; no voters:
I20260811 05:11:48.263616 24050 raft_consensus.cc:2781] T 4e4550773fd44dc188087f4863ff138d P 1075e6077957466793c4c15316d39b2d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:11:48.263789 24050 raft_consensus.cc:686] T 4e4550773fd44dc188087f4863ff138d P 1075e6077957466793c4c15316d39b2d [term 1 LEADER]: Becoming Leader. State: Replica: 1075e6077957466793c4c15316d39b2d, State: Running, Role: LEADER
I20260811 05:11:48.263911 24050 consensus_queue.cc:237] T 4e4550773fd44dc188087f4863ff138d P 1075e6077957466793c4c15316d39b2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ea880bb4c0f4dacb7a09261d425d690" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 42859 } } peers { permanent_uuid: "d7c1e6b5128545fdab3edb90f84ecd12" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 43739 } } peers { permanent_uuid: "1075e6077957466793c4c15316d39b2d" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 45115 } }
I20260811 05:11:48.264801 23302 catalog_manager.cc:5495] T 4e4550773fd44dc188087f4863ff138d P 1075e6077957466793c4c15316d39b2d reported cstate change: term changed from 0 to 1, leader changed from <none> to 1075e6077957466793c4c15316d39b2d (127.26.191.193). New cstate: current_term: 1 leader_uuid: "1075e6077957466793c4c15316d39b2d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ea880bb4c0f4dacb7a09261d425d690" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 42859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7c1e6b5128545fdab3edb90f84ecd12" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 43739 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1075e6077957466793c4c15316d39b2d" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 45115 } health_report { overall_health: HEALTHY } } }
I20260811 05:11:48.280009 24038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:48.277479 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38918 (local address 127.26.191.193:45115)
0811 05:11:48.277541 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 05:11:48.277543 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:11:48.277552 (+ 9us) server_negotiation.cc:407] Connection header received
0811 05:11:48.277599 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:11:48.277600 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:11:48.277619 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:11:48.277683 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:11:48.277875 (+ 192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:48.278356 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:48.279192 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:48.279395 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:48.279453 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:48.279632 (+ 179us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:11:48.279739 (+ 107us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:11:48.279807 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 05:11:48.279897 (+ 90us) server_negotiation.cc:299] Negotiation successful
0811 05:11:48.279917 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 05:11:48.282204 23943 raft_consensus.cc:1261] T 4e4550773fd44dc188087f4863ff138d P 4ea880bb4c0f4dacb7a09261d425d690 [term 1 FOLLOWER]: Refusing update from remote peer 1075e6077957466793c4c15316d39b2d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:11:48.282230 23744 raft_consensus.cc:1261] T 4e4550773fd44dc188087f4863ff138d P d7c1e6b5128545fdab3edb90f84ecd12 [term 1 FOLLOWER]: Refusing update from remote peer 1075e6077957466793c4c15316d39b2d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:11:48.282689 24050 consensus_queue.cc:1035] T 4e4550773fd44dc188087f4863ff138d P 1075e6077957466793c4c15316d39b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ea880bb4c0f4dacb7a09261d425d690" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 42859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:11:48.282868 24055 consensus_queue.cc:1035] T 4e4550773fd44dc188087f4863ff138d P 1075e6077957466793c4c15316d39b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7c1e6b5128545fdab3edb90f84ecd12" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 43739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:11:48.285499 24059 mvcc.cc:205] Tried to move back new op lower bound from 7317197243520647168 to 7317197243449589760. Current Snapshot: MvccSnapshot[applied={T|T < 7317197243520647168}]
I20260811 05:11:48.285748 24060 mvcc.cc:205] Tried to move back new op lower bound from 7317197243520647168 to 7317197243449589760. Current Snapshot: MvccSnapshot[applied={T|T < 7317197243520647168}]
I20260811 05:11:48.286311 24061 mvcc.cc:205] Tried to move back new op lower bound from 7317197243520647168 to 7317197243449589760. Current Snapshot: MvccSnapshot[applied={T|T < 7317197243520647168}]
I20260811 05:11:48.288604 23301 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56972:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:11:48.288736 23301 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56972:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:11:48.289661 23301 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4721c130cce147d3b9ec8d5ea89c0aa6: Sending DeleteTablet for 3 replicas of tablet 4e4550773fd44dc188087f4863ff138d
I20260811 05:11:48.290031 23710 tablet_service.cc:1514] Processing DeleteTablet for tablet 4e4550773fd44dc188087f4863ff138d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:11:48 UTC) from {username='slave'} at 127.0.0.1:54336
I20260811 05:11:48.290104 23503 tablet_service.cc:1514] Processing DeleteTablet for tablet 4e4550773fd44dc188087f4863ff138d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:11:48 UTC) from {username='slave'} at 127.0.0.1:38912
I20260811 05:11:48.290287 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 23408
I20260811 05:11:48.290290 23914 tablet_service.cc:1514] Processing DeleteTablet for tablet 4e4550773fd44dc188087f4863ff138d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:11:48 UTC) from {username='slave'} at 127.0.0.1:35422
I20260811 05:11:48.290952 24074 tablet_replica.cc:330] T 4e4550773fd44dc188087f4863ff138d P 4ea880bb4c0f4dacb7a09261d425d690: stopping tablet replica
I20260811 05:11:48.291122 24074 raft_consensus.cc:2229] T 4e4550773fd44dc188087f4863ff138d P 4ea880bb4c0f4dacb7a09261d425d690 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 05:11:48.291299 24074 raft_consensus.cc:2258] T 4e4550773fd44dc188087f4863ff138d P 4ea880bb4c0f4dacb7a09261d425d690 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:11:48.291540 24070 tablet_replica.cc:330] T 4e4550773fd44dc188087f4863ff138d P d7c1e6b5128545fdab3edb90f84ecd12: stopping tablet replica
I20260811 05:11:48.291734 24070 raft_consensus.cc:2229] T 4e4550773fd44dc188087f4863ff138d P d7c1e6b5128545fdab3edb90f84ecd12 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 05:11:48.291944 24070 raft_consensus.cc:2258] T 4e4550773fd44dc188087f4863ff138d P d7c1e6b5128545fdab3edb90f84ecd12 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:11:48.294916 24070 ts_tablet_manager.cc:1905] T 4e4550773fd44dc188087f4863ff138d P d7c1e6b5128545fdab3edb90f84ecd12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:11:48.300829 24070 ts_tablet_manager.cc:1918] T 4e4550773fd44dc188087f4863ff138d P d7c1e6b5128545fdab3edb90f84ecd12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 05:11:48.300949 24070 log.cc:1196] T 4e4550773fd44dc188087f4863ff138d P d7c1e6b5128545fdab3edb90f84ecd12: Deleting WAL directory at /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424853995437-27391-0/minicluster-data/ts-1/wal/wals/4e4550773fd44dc188087f4863ff138d
I20260811 05:11:48.301213 24070 ts_tablet_manager.cc:1939] T 4e4550773fd44dc188087f4863ff138d P d7c1e6b5128545fdab3edb90f84ecd12: Deleting consensus metadata
I20260811 05:11:48.301676 23271 catalog_manager.cc:4841] TS d7c1e6b5128545fdab3edb90f84ecd12 (127.26.191.194:43739): tablet 4e4550773fd44dc188087f4863ff138d (table test-table [id=2cda28727a3d47aa98c2f936c416221e]) successfully deleted
I20260811 05:11:48.301793 24074 ts_tablet_manager.cc:1905] T 4e4550773fd44dc188087f4863ff138d P 4ea880bb4c0f4dacb7a09261d425d690: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:11:48.303112 24074 ts_tablet_manager.cc:1918] T 4e4550773fd44dc188087f4863ff138d P 4ea880bb4c0f4dacb7a09261d425d690: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 05:11:48.303176 24074 log.cc:1196] T 4e4550773fd44dc188087f4863ff138d P 4ea880bb4c0f4dacb7a09261d425d690: Deleting WAL directory at /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424853995437-27391-0/minicluster-data/ts-2/wal/wals/4e4550773fd44dc188087f4863ff138d
I20260811 05:11:48.303424 24074 ts_tablet_manager.cc:1939] T 4e4550773fd44dc188087f4863ff138d P 4ea880bb4c0f4dacb7a09261d425d690: Deleting consensus metadata
I20260811 05:11:48.303864 23276 catalog_manager.cc:4841] TS 4ea880bb4c0f4dacb7a09261d425d690 (127.26.191.195:42859): tablet 4e4550773fd44dc188087f4863ff138d (table test-table [id=2cda28727a3d47aa98c2f936c416221e]) successfully deleted
W20260811 05:11:48.308039 23276 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.191.193:45115 (error 108)
I20260811 05:11:48.308353 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 23612
I20260811 05:11:48.311537 24029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:48.308510 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.193:45115 (local address 127.0.0.1:38922)
0811 05:11:48.311432 (+ 2922us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:48.311492 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.193:45115: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2893}
W20260811 05:11:48.318375 23276 catalog_manager.cc:4584] TS 1075e6077957466793c4c15316d39b2d (127.26.191.193:45115): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 4e4550773fd44dc188087f4863ff138d: Network error: Client connection negotiation failed: client connection to 127.26.191.193:45115: connect: Connection refused (error 111)
I20260811 05:11:48.322818 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 23821
I20260811 05:11:48.352660 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 23250
2026-08-11T05:11:48Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (808 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424853995437-27391-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 05:11:48 dist-test-slave-x5fp krb5kdc[24079](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 05:11:48 dist-test-slave-x5fp krb5kdc[24079](info): set up 2 sockets
Aug 11 05:11:48 dist-test-slave-x5fp krb5kdc[24079](info): commencing operation
krb5kdc: starting...
W20260811 05:11:49.624958 27391 mini_kdc.cc:121] Time spent starting KDC: real 1.246s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424853995437-27391-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424853995437-27391-0/krb5kdc/test-user.keytab.
Aug 11 05:11:49 dist-test-slave-x5fp krb5kdc[24079](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425109, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T05:11:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:11:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.191.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.191.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.191.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab.
Entry for principal kudu/127.26.191.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab.
I20260811 05:11:49.761050 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424853995437-27391-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424853995437-27391-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424853995437-27391-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.254:34837
--webserver_interface=127.26.191.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab
--principal=kudu/127.26.191.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:35011
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.191.254:34837
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:11:49.847560 24098 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:11:49.847779 24098 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:11:49.847805 24098 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:11:49.848964 24098 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:11:49.849009 24098 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:11:49.849023 24098 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:11:49.849035 24098 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:11:49.849047 24098 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:11:49.850512 24098 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:35011
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424853995437-27391-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424853995437-27391-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.191.254:34837
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab
--principal=kudu/127.26.191.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.254:34837
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.191.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24098
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424853995437-27391-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:11:49.850710 24098 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:11:49.850893 24098 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:11:49.856109 24104 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:11:49.856117 24098 server_base.cc:1034] running on GCE node
W20260811 05:11:49.856127 24108 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:11:49.856124 24105 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:11:49.856582 24098 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:11:49.856946 24098 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:11:49.858130 24098 hybrid_clock.cc:648] HybridClock initialized: now 1786425109858110 us; error 41 us; skew 500 ppm
Aug 11 05:11:49 dist-test-slave-x5fp krb5kdc[24079](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425109, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:11:49.860632 24098 init.cc:377] Logged in from keytab as kudu/127.26.191.254@KRBTEST.COM (short username kudu)
I20260811 05:11:49.861150 24098 webserver.cc:460] Webserver started at http://127.26.191.254:34081/ using document root <none> and password file <none>
I20260811 05:11:49.861394 24098 fs_manager.cc:359] Metadata directory not provided
I20260811 05:11:49.861471 24098 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:11:49.861625 24098 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:11:49.862720 24098 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424853995437-27391-0/minicluster-data/master-0/data/instance:
uuid: "b0d58601bfe749c5b2b9a455e2a8da5f"
format_stamp: "Formatted at 2026-08-11 05:11:49 on dist-test-slave-x5fp"
server_key: "fd8089e0c8a9a581d4c9ccb1542a6740"
server_key_iv: "726b2b395f025a2d54591ad98a7ebcb9"
server_key_version: "encryptionkey@0"
I20260811 05:11:49.863098 24098 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424853995437-27391-0/minicluster-data/master-0/wal/instance:
uuid: "b0d58601bfe749c5b2b9a455e2a8da5f"
format_stamp: "Formatted at 2026-08-11 05:11:49 on dist-test-slave-x5fp"
server_key: "fd8089e0c8a9a581d4c9ccb1542a6740"
server_key_iv: "726b2b395f025a2d54591ad98a7ebcb9"
server_key_version: "encryptionkey@0"
I20260811 05:11:49.864462 24098 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 05:11:49.865351 24120 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:11:49.865583 24098 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 05:11:49.865696 24098 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424853995437-27391-0/minicluster-data/master-0/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424853995437-27391-0/minicluster-data/master-0/wal
uuid: "b0d58601bfe749c5b2b9a455e2a8da5f"
format_stamp: "Formatted at 2026-08-11 05:11:49 on dist-test-slave-x5fp"
server_key: "fd8089e0c8a9a581d4c9ccb1542a6740"
server_key_iv: "726b2b395f025a2d54591ad98a7ebcb9"
server_key_version: "encryptionkey@0"
I20260811 05:11:49.865788 24098 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424853995437-27391-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424853995437-27391-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424853995437-27391-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:11:49.892172 24098 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:11:49.894858 24098 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:11:49.895059 24098 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:11:49.899675 24098 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.254:34837
I20260811 05:11:49.899719 24205 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.254:34837 every 8 connection(s)
I20260811 05:11:49.900105 24098 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
I20260811 05:11:49.901192 24206 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:11:49.903514 24206 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b0d58601bfe749c5b2b9a455e2a8da5f: Bootstrap starting.
I20260811 05:11:49.904098 24206 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b0d58601bfe749c5b2b9a455e2a8da5f: Neither blocks nor log segments found. Creating new log.
I20260811 05:11:49.904345 24206 log.cc:824] T 00000000000000000000000000000000 P b0d58601bfe749c5b2b9a455e2a8da5f: Log is configured to *not* fsync() on all Append() calls
I20260811 05:11:49.905164 24206 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b0d58601bfe749c5b2b9a455e2a8da5f: No bootstrap required, opened a new log
I20260811 05:11:49.906804 24206 raft_consensus.cc:348] T 00000000000000000000000000000000 P b0d58601bfe749c5b2b9a455e2a8da5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0d58601bfe749c5b2b9a455e2a8da5f" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 34837 } }
I20260811 05:11:49.906951 24206 raft_consensus.cc:374] T 00000000000000000000000000000000 P b0d58601bfe749c5b2b9a455e2a8da5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:11:49.906975 24206 raft_consensus.cc:729] T 00000000000000000000000000000000 P b0d58601bfe749c5b2b9a455e2a8da5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0d58601bfe749c5b2b9a455e2a8da5f, State: Initialized, Role: FOLLOWER
I20260811 05:11:49.907125 24206 consensus_queue.cc:260] T 00000000000000000000000000000000 P b0d58601bfe749c5b2b9a455e2a8da5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0d58601bfe749c5b2b9a455e2a8da5f" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 34837 } }
I20260811 05:11:49.907217 24206 raft_consensus.cc:388] T 00000000000000000000000000000000 P b0d58601bfe749c5b2b9a455e2a8da5f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:11:49.907241 24206 raft_consensus.cc:482] T 00000000000000000000000000000000 P b0d58601bfe749c5b2b9a455e2a8da5f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:11:49.907275 24206 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b0d58601bfe749c5b2b9a455e2a8da5f [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:11:49.907599 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 24098
I20260811 05:11:49.907742 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424853995437-27391-0/minicluster-data/master-0/wal/instance
I20260811 05:11:49.907853 24206 raft_consensus.cc:504] T 00000000000000000000000000000000 P b0d58601bfe749c5b2b9a455e2a8da5f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0d58601bfe749c5b2b9a455e2a8da5f" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 34837 } }
I20260811 05:11:49.907998 27391 external_mini_cluster.cc:1428] Setting key d7aaa3cae2838fabfee3e69b7e004d6a
I20260811 05:11:49.907977 24206 leader_election.cc:302] T 00000000000000000000000000000000 P b0d58601bfe749c5b2b9a455e2a8da5f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b0d58601bfe749c5b2b9a455e2a8da5f; no voters:
I20260811 05:11:49.908167 24206 leader_election.cc:288] T 00000000000000000000000000000000 P b0d58601bfe749c5b2b9a455e2a8da5f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 05:11:49.908193 24211 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b0d58601bfe749c5b2b9a455e2a8da5f [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:11:49.908388 24211 raft_consensus.cc:686] T 00000000000000000000000000000000 P b0d58601bfe749c5b2b9a455e2a8da5f [term 1 LEADER]: Becoming Leader. State: Replica: b0d58601bfe749c5b2b9a455e2a8da5f, State: Running, Role: LEADER
I20260811 05:11:49.908507 24206 sys_catalog.cc:564] T 00000000000000000000000000000000 P b0d58601bfe749c5b2b9a455e2a8da5f [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:11:49.908535 24211 consensus_queue.cc:237] T 00000000000000000000000000000000 P b0d58601bfe749c5b2b9a455e2a8da5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0d58601bfe749c5b2b9a455e2a8da5f" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 34837 } }
I20260811 05:11:49.909171 24213 sys_catalog.cc:455] T 00000000000000000000000000000000 P b0d58601bfe749c5b2b9a455e2a8da5f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b0d58601bfe749c5b2b9a455e2a8da5f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0d58601bfe749c5b2b9a455e2a8da5f" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 34837 } } }
I20260811 05:11:49.909258 24213 sys_catalog.cc:458] T 00000000000000000000000000000000 P b0d58601bfe749c5b2b9a455e2a8da5f [sys.catalog]: This master's current role is: LEADER
I20260811 05:11:49.909736 24214 sys_catalog.cc:455] T 00000000000000000000000000000000 P b0d58601bfe749c5b2b9a455e2a8da5f [sys.catalog]: SysCatalogTable state changed. Reason: New leader b0d58601bfe749c5b2b9a455e2a8da5f. Latest consensus state: current_term: 1 leader_uuid: "b0d58601bfe749c5b2b9a455e2a8da5f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0d58601bfe749c5b2b9a455e2a8da5f" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 34837 } } }
I20260811 05:11:49.909839 24214 sys_catalog.cc:458] T 00000000000000000000000000000000 P b0d58601bfe749c5b2b9a455e2a8da5f [sys.catalog]: This master's current role is: LEADER
I20260811 05:11:49.910660 24226 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:11:49.911438 24226 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:11:49.913168 24226 catalog_manager.cc:1347] Generated new cluster ID: 4c8e3643a76e4098bfdf924c9baf747f
I20260811 05:11:49.913224 24226 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 05:11:49 dist-test-slave-x5fp krb5kdc[24079](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425109, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
I20260811 05:11:49.919981 24216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:49.908695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35106 (local address 127.26.191.254:34837)
0811 05:11:49.909052 (+ 357us) server_negotiation.cc:206] Beginning negotiation
0811 05:11:49.909064 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 05:11:49.909103 (+ 39us) server_negotiation.cc:407] Connection header received
0811 05:11:49.909230 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:11:49.909238 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:11:49.909301 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:11:49.910089 (+ 788us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:11:49.910622 (+ 533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:49.911771 (+ 1149us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:49.912862 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:49.913416 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:49.913535 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:49.915964 (+ 2429us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:11:49.915969 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:11:49.915970 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:11:49.915983 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:11:49.918339 (+ 2356us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:11:49.918723 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:11:49.918727 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:11:49.918727 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:11:49.918844 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:11:49.919073 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:11:49.919074 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:11:49.919074 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:11:49.919331 (+ 257us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:11:49.919502 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0811 05:11:49.919601 (+ 99us) server_negotiation.cc:299] Negotiation successful
0811 05:11:49.919766 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":281,"thread_start_us":74,"threads_started":1}
I20260811 05:11:49.923413 24226 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:11:49.923965 24226 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:11:49.927032 24226 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b0d58601bfe749c5b2b9a455e2a8da5f: Generated new TSK 0
I20260811 05:11:49.927232 24226 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.191.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.191.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.191.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.193.keytab.
Entry for principal kudu/127.26.191.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.193.keytab.
I20260811 05:11:49.966616 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424853995437-27391-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424853995437-27391-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424853995437-27391-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424853995437-27391-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.191.193:0
--local_ip_for_outbound_sockets=127.26.191.193
--webserver_interface=127.26.191.193
--webserver_port=0
--tserver_master_addrs=127.26.191.254:34837
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.193.keytab
--principal=kudu/127.26.191.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:35011
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:11:50.057746 24240 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:11:50.057978 24240 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:11:50.058004 24240 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:11:50.059224 24240 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:11:50.059276 24240 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:11:50.059309 24240 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.191.193
I20260811 05:11:50.060889 24240 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:35011
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424853995437-27391-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424853995437-27391-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.193.keytab
--principal=kudu/127.26.191.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.191.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424853995437-27391-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.191.193
--webserver_port=0
--tserver_master_addrs=127.26.191.254:34837
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24240
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.191.193
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424853995437-27391-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:11:50.061180 24240 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:11:50.061463 24240 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:11:50.067579 24246 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:11:50.067543 24247 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:11:50.067566 24249 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:11:50.067881 24240 server_base.cc:1034] running on GCE node
I20260811 05:11:50.068198 24240 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:11:50.068527 24240 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:11:50.069746 24240 hybrid_clock.cc:648] HybridClock initialized: now 1786425110069700 us; error 57 us; skew 500 ppm
Aug 11 05:11:50 dist-test-slave-x5fp krb5kdc[24079](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425110, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:11:50.072546 24240 init.cc:377] Logged in from keytab as kudu/127.26.191.193@KRBTEST.COM (short username kudu)
I20260811 05:11:50.073093 24240 webserver.cc:460] Webserver started at http://127.26.191.193:35665/ using document root <none> and password file <none>
I20260811 05:11:50.073356 24240 fs_manager.cc:359] Metadata directory not provided
I20260811 05:11:50.073406 24240 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:11:50.073594 24240 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:11:50.074733 24240 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424853995437-27391-0/minicluster-data/ts-0/data/instance:
uuid: "d317c3e49cfa4ab5952064face2050a0"
format_stamp: "Formatted at 2026-08-11 05:11:50 on dist-test-slave-x5fp"
server_key: "d4ec38bfb8770d209d0c307096ce94ae"
server_key_iv: "8ab9cf0845ef81916d30eb5b45ae847d"
server_key_version: "encryptionkey@0"
I20260811 05:11:50.075130 24240 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424853995437-27391-0/minicluster-data/ts-0/wal/instance:
uuid: "d317c3e49cfa4ab5952064face2050a0"
format_stamp: "Formatted at 2026-08-11 05:11:50 on dist-test-slave-x5fp"
server_key: "d4ec38bfb8770d209d0c307096ce94ae"
server_key_iv: "8ab9cf0845ef81916d30eb5b45ae847d"
server_key_version: "encryptionkey@0"
I20260811 05:11:50.076640 24240 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 05:11:50.077648 24257 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:11:50.077960 24240 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:11:50.078051 24240 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424853995437-27391-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424853995437-27391-0/minicluster-data/ts-0/wal
uuid: "d317c3e49cfa4ab5952064face2050a0"
format_stamp: "Formatted at 2026-08-11 05:11:50 on dist-test-slave-x5fp"
server_key: "d4ec38bfb8770d209d0c307096ce94ae"
server_key_iv: "8ab9cf0845ef81916d30eb5b45ae847d"
server_key_version: "encryptionkey@0"
I20260811 05:11:50.078152 24240 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424853995437-27391-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424853995437-27391-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424853995437-27391-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:11:50.094079 24240 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:11:50.096650 24240 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:11:50.096902 24240 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:11:50.097198 24240 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:11:50.097543 24240 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:11:50.097579 24240 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:11:50.097602 24240 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:11:50.097651 24240 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:11:50.103948 24240 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.193:45593
I20260811 05:11:50.104048 24428 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.193:45593 every 8 connection(s)
I20260811 05:11:50.104396 24240 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424853995437-27391-0/minicluster-data/ts-0/data/info.pb
Aug 11 05:11:50 dist-test-slave-x5fp krb5kdc[24079](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425110, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.193@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
I20260811 05:11:50.113433 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 24240
I20260811 05:11:50.113548 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424853995437-27391-0/minicluster-data/ts-0/wal/instance
I20260811 05:11:50.113751 27391 external_mini_cluster.cc:1428] Setting key fec61295925d270ab7261a5abce4be84
I20260811 05:11:50.115087 24432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:50.105295 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:34837 (local address 127.26.191.193:39337)
0811 05:11:50.105513 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:50.105553 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 05:11:50.106126 (+ 573us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:11:50.106427 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:11:50.106431 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:11:50.107135 (+ 704us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:11:50.107346 (+ 211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:50.107351 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:50.108229 (+ 878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:50.108230 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:50.109235 (+ 1005us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:50.109238 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:50.109682 (+ 444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:50.109683 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:50.109815 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:50.110427 (+ 612us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:11:50.110436 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:11:50.111897 (+ 1461us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:11:50.113473 (+ 1576us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:11:50.113481 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:11:50.113484 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:11:50.113755 (+ 271us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:11:50.114028 (+ 273us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:11:50.114028 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:11:50.114029 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:11:50.114184 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:11:50.114504 (+ 320us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:11:50.114513 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:11:50.114685 (+ 172us) client_negotiation.cc:769] Sending connection context
0811 05:11:50.114775 (+ 90us) client_negotiation.cc:240] Negotiation successful
0811 05:11:50.114913 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":114,"threads_started":1}
I20260811 05:11:50.115079 24216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:50.105332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.193:39337 (local address 127.26.191.254:34837)
0811 05:11:50.105413 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0811 05:11:50.105415 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:11:50.105653 (+ 238us) server_negotiation.cc:407] Connection header received
0811 05:11:50.106266 (+ 613us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:11:50.106268 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:11:50.106287 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:11:50.106344 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:11:50.107556 (+ 1212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:50.108118 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:50.109331 (+ 1213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:50.109561 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:50.109666 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:50.112002 (+ 2336us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:11:50.112003 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:11:50.112004 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:11:50.112012 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:11:50.113377 (+ 1365us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:11:50.113859 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:11:50.113860 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:11:50.113861 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:11:50.113939 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:11:50.114258 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:11:50.114259 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:11:50.114259 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:11:50.114378 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:11:50.114479 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0811 05:11:50.114832 (+ 353us) server_negotiation.cc:299] Negotiation successful
0811 05:11:50.114944 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 05:11:50.115679 24429 heartbeater.cc:347] Connected to a master server at 127.26.191.254:34837
I20260811 05:11:50.115772 24429 heartbeater.cc:464] Registering TS with master...
I20260811 05:11:50.115981 24429 heartbeater.cc:511] Master 127.26.191.254:34837 requested a full tablet report, sending...
I20260811 05:11:50.116621 24149 ts_manager.cc:194] Registered new tserver with Master: d317c3e49cfa4ab5952064face2050a0 (127.26.191.193:45593)
I20260811 05:11:50.117282 24149 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.191.193@KRBTEST.COM'} at 127.26.191.193:39337
WARNING: no policy specified for kudu/127.26.191.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.191.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.191.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.194.keytab.
Entry for principal kudu/127.26.191.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.194.keytab.
I20260811 05:11:50.141116 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424853995437-27391-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424853995437-27391-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424853995437-27391-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424853995437-27391-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.191.194:0
--local_ip_for_outbound_sockets=127.26.191.194
--webserver_interface=127.26.191.194
--webserver_port=0
--tserver_master_addrs=127.26.191.254:34837
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.194.keytab
--principal=kudu/127.26.191.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:35011
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:11:50.226536 24435 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:11:50.226799 24435 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:11:50.226843 24435 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:11:50.228039 24435 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:11:50.228109 24435 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:11:50.228152 24435 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.191.194
I20260811 05:11:50.229645 24435 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:35011
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424853995437-27391-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424853995437-27391-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.194.keytab
--principal=kudu/127.26.191.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.191.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424853995437-27391-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.191.194
--webserver_port=0
--tserver_master_addrs=127.26.191.254:34837
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24435
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.191.194
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424853995437-27391-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:11:50.229925 24435 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:11:50.230163 24435 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:11:50.235517 24441 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:11:50.235510 24442 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:11:50.235586 24435 server_base.cc:1034] running on GCE node
W20260811 05:11:50.235510 24446 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:11:50.236028 24435 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:11:50.236311 24435 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:11:50.237484 24435 hybrid_clock.cc:648] HybridClock initialized: now 1786425110237467 us; error 29 us; skew 500 ppm
Aug 11 05:11:50 dist-test-slave-x5fp krb5kdc[24079](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425110, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:11:50.240432 24435 init.cc:377] Logged in from keytab as kudu/127.26.191.194@KRBTEST.COM (short username kudu)
I20260811 05:11:50.240993 24435 webserver.cc:460] Webserver started at http://127.26.191.194:37431/ using document root <none> and password file <none>
I20260811 05:11:50.241214 24435 fs_manager.cc:359] Metadata directory not provided
I20260811 05:11:50.241261 24435 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:11:50.241369 24435 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:11:50.242492 24435 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424853995437-27391-0/minicluster-data/ts-1/data/instance:
uuid: "b709626ec6b7462a980a10c1d24a2b0d"
format_stamp: "Formatted at 2026-08-11 05:11:50 on dist-test-slave-x5fp"
server_key: "eeed1136364ccd4d67985bcf3538e6c9"
server_key_iv: "057e2bdb4caa213b9feebcbdeb08a4e5"
server_key_version: "encryptionkey@0"
I20260811 05:11:50.242838 24435 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424853995437-27391-0/minicluster-data/ts-1/wal/instance:
uuid: "b709626ec6b7462a980a10c1d24a2b0d"
format_stamp: "Formatted at 2026-08-11 05:11:50 on dist-test-slave-x5fp"
server_key: "eeed1136364ccd4d67985bcf3538e6c9"
server_key_iv: "057e2bdb4caa213b9feebcbdeb08a4e5"
server_key_version: "encryptionkey@0"
I20260811 05:11:50.244241 24435 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 05:11:50.245178 24457 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:11:50.245379 24435 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 05:11:50.245491 24435 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424853995437-27391-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424853995437-27391-0/minicluster-data/ts-1/wal
uuid: "b709626ec6b7462a980a10c1d24a2b0d"
format_stamp: "Formatted at 2026-08-11 05:11:50 on dist-test-slave-x5fp"
server_key: "eeed1136364ccd4d67985bcf3538e6c9"
server_key_iv: "057e2bdb4caa213b9feebcbdeb08a4e5"
server_key_version: "encryptionkey@0"
I20260811 05:11:50.245574 24435 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424853995437-27391-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424853995437-27391-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424853995437-27391-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:11:50.256934 24435 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:11:50.259701 24435 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:11:50.259840 24435 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:11:50.260166 24435 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:11:50.260538 24435 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:11:50.260577 24435 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:11:50.260604 24435 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:11:50.260658 24435 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:11:50.267462 24435 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.194:40743
I20260811 05:11:50.267505 24626 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.194:40743 every 8 connection(s)
I20260811 05:11:50.267956 24435 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424853995437-27391-0/minicluster-data/ts-1/data/info.pb
Aug 11 05:11:50 dist-test-slave-x5fp krb5kdc[24079](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425110, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.194@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
I20260811 05:11:50.277417 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 24435
I20260811 05:11:50.277539 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424853995437-27391-0/minicluster-data/ts-1/wal/instance
I20260811 05:11:50.277772 27391 external_mini_cluster.cc:1428] Setting key c4c73b1c1c66e7674db271e51f12cce3
I20260811 05:11:50.278568 24216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:50.268704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.194:53371 (local address 127.26.191.254:34837)
0811 05:11:50.268804 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0811 05:11:50.268807 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:11:50.269129 (+ 322us) server_negotiation.cc:407] Connection header received
0811 05:11:50.269726 (+ 597us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:11:50.269728 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:11:50.269743 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:11:50.269796 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:11:50.270903 (+ 1107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:50.271478 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:50.272636 (+ 1158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:50.272941 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:50.273029 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:50.275382 (+ 2353us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:11:50.275383 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:11:50.275384 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:11:50.275391 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:11:50.276704 (+ 1313us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:11:50.277248 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:11:50.277250 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:11:50.277250 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:11:50.277341 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:11:50.277715 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:11:50.277717 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:11:50.277717 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:11:50.277927 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:11:50.278001 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 05:11:50.278362 (+ 361us) server_negotiation.cc:299] Negotiation successful
0811 05:11:50.278469 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260811 05:11:50.278800 24629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:50.268703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:34837 (local address 127.26.191.194:53371)
0811 05:11:50.268979 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:50.269033 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0811 05:11:50.269598 (+ 565us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:11:50.269887 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:11:50.269891 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:11:50.270537 (+ 646us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:11:50.270758 (+ 221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:50.270763 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:50.271593 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:50.271594 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:50.272533 (+ 939us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:50.272535 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:50.273039 (+ 504us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:50.273040 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:50.273221 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:50.273786 (+ 565us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:11:50.273795 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:11:50.275266 (+ 1471us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:11:50.276854 (+ 1588us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:11:50.276862 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:11:50.276867 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:11:50.277126 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:11:50.277430 (+ 304us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:11:50.277431 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:11:50.277431 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:11:50.277612 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:11:50.278005 (+ 393us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:11:50.278014 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:11:50.278202 (+ 188us) client_negotiation.cc:769] Sending connection context
0811 05:11:50.278336 (+ 134us) client_negotiation.cc:240] Negotiation successful
0811 05:11:50.278514 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":173,"threads_started":1}
I20260811 05:11:50.279287 24627 heartbeater.cc:347] Connected to a master server at 127.26.191.254:34837
I20260811 05:11:50.279408 24627 heartbeater.cc:464] Registering TS with master...
I20260811 05:11:50.279625 24627 heartbeater.cc:511] Master 127.26.191.254:34837 requested a full tablet report, sending...
I20260811 05:11:50.280705 24149 ts_manager.cc:194] Registered new tserver with Master: b709626ec6b7462a980a10c1d24a2b0d (127.26.191.194:40743)
I20260811 05:11:50.281260 24149 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.191.194@KRBTEST.COM'} at 127.26.191.194:53371
WARNING: no policy specified for kudu/127.26.191.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.191.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.191.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.195.keytab.
Entry for principal kudu/127.26.191.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.195.keytab.
I20260811 05:11:50.308100 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424853995437-27391-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424853995437-27391-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424853995437-27391-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424853995437-27391-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.191.195:0
--local_ip_for_outbound_sockets=127.26.191.195
--webserver_interface=127.26.191.195
--webserver_port=0
--tserver_master_addrs=127.26.191.254:34837
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.195.keytab
--principal=kudu/127.26.191.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:35011
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:11:50.400305 24633 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:11:50.400535 24633 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:11:50.400559 24633 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:11:50.401751 24633 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:11:50.401798 24633 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:11:50.401824 24633 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.191.195
I20260811 05:11:50.403301 24633 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:35011
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424853995437-27391-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424853995437-27391-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.195.keytab
--principal=kudu/127.26.191.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.191.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424853995437-27391-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.191.195
--webserver_port=0
--tserver_master_addrs=127.26.191.254:34837
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24633
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.191.195
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424853995437-27391-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:11:50.403506 24633 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:11:50.403687 24633 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:11:50.409485 24638 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:11:50.409508 24644 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:11:50.409508 24641 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:11:50.409824 24633 server_base.cc:1034] running on GCE node
I20260811 05:11:50.410084 24633 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:11:50.410341 24633 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:11:50.411520 24633 hybrid_clock.cc:648] HybridClock initialized: now 1786425110411509 us; error 31 us; skew 500 ppm
Aug 11 05:11:50 dist-test-slave-x5fp krb5kdc[24079](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425110, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:11:50.414330 24633 init.cc:377] Logged in from keytab as kudu/127.26.191.195@KRBTEST.COM (short username kudu)
I20260811 05:11:50.414881 24633 webserver.cc:460] Webserver started at http://127.26.191.195:32877/ using document root <none> and password file <none>
I20260811 05:11:50.415143 24633 fs_manager.cc:359] Metadata directory not provided
I20260811 05:11:50.415215 24633 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:11:50.415375 24633 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:11:50.416517 24633 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424853995437-27391-0/minicluster-data/ts-2/data/instance:
uuid: "994070d07eba4bdc8b4be87bc9471d6c"
format_stamp: "Formatted at 2026-08-11 05:11:50 on dist-test-slave-x5fp"
server_key: "3123318be23156a1991a0f82584dea05"
server_key_iv: "9e49416222c9408e39237f3cc136fc48"
server_key_version: "encryptionkey@0"
I20260811 05:11:50.416945 24633 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424853995437-27391-0/minicluster-data/ts-2/wal/instance:
uuid: "994070d07eba4bdc8b4be87bc9471d6c"
format_stamp: "Formatted at 2026-08-11 05:11:50 on dist-test-slave-x5fp"
server_key: "3123318be23156a1991a0f82584dea05"
server_key_iv: "9e49416222c9408e39237f3cc136fc48"
server_key_version: "encryptionkey@0"
I20260811 05:11:50.418357 24633 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 05:11:50.419164 24657 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:11:50.419519 24633 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 05:11:50.419631 24633 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424853995437-27391-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424853995437-27391-0/minicluster-data/ts-2/wal
uuid: "994070d07eba4bdc8b4be87bc9471d6c"
format_stamp: "Formatted at 2026-08-11 05:11:50 on dist-test-slave-x5fp"
server_key: "3123318be23156a1991a0f82584dea05"
server_key_iv: "9e49416222c9408e39237f3cc136fc48"
server_key_version: "encryptionkey@0"
I20260811 05:11:50.419723 24633 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424853995437-27391-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424853995437-27391-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424853995437-27391-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:11:50.431691 24633 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:11:50.434078 24633 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:11:50.434252 24633 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:11:50.434512 24633 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:11:50.434885 24633 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:11:50.434949 24633 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:11:50.434983 24633 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:11:50.434995 24633 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:11:50.441146 24633 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.195:36403
I20260811 05:11:50.441192 24834 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.195:36403 every 8 connection(s)
I20260811 05:11:50.441553 24633 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424853995437-27391-0/minicluster-data/ts-2/data/info.pb
I20260811 05:11:50.445211 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 24633
I20260811 05:11:50.445326 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424853995437-27391-0/minicluster-data/ts-2/wal/instance
I20260811 05:11:50.445498 27391 external_mini_cluster.cc:1428] Setting key 1b091ba1c81b7c8bb33025a87267c02f
Aug 11 05:11:50 dist-test-slave-x5fp krb5kdc[24079](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425110, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.195@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
I20260811 05:11:50.452106 24216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:50.442398 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.195:36909 (local address 127.26.191.254:34837)
0811 05:11:50.442525 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0811 05:11:50.442528 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:11:50.442733 (+ 205us) server_negotiation.cc:407] Connection header received
0811 05:11:50.443249 (+ 516us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:11:50.443250 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:11:50.443262 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:11:50.443331 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:11:50.444288 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:50.445002 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:50.446398 (+ 1396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:50.446690 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:50.446751 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:50.449129 (+ 2378us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:11:50.449130 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:11:50.449130 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:11:50.449137 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:11:50.450819 (+ 1682us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:11:50.451243 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:11:50.451245 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:11:50.451245 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:11:50.451311 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:11:50.451544 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:11:50.451545 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:11:50.451545 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:11:50.451661 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:11:50.451717 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 05:11:50.451968 (+ 251us) server_negotiation.cc:299] Negotiation successful
0811 05:11:50.452037 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260811 05:11:50.452272 24837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:50.442349 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:34837 (local address 127.26.191.195:36909)
0811 05:11:50.442591 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:50.442631 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 05:11:50.443125 (+ 494us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:11:50.443388 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:11:50.443397 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:11:50.443995 (+ 598us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:11:50.444199 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:50.444204 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:50.445109 (+ 905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:50.445110 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:50.446299 (+ 1189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:50.446302 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:50.446760 (+ 458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:50.446761 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:50.446878 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:50.447380 (+ 502us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:11:50.447388 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:11:50.449000 (+ 1612us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:11:50.450893 (+ 1893us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:11:50.450898 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:11:50.450900 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:11:50.451133 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:11:50.451379 (+ 246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:11:50.451380 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:11:50.451380 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:11:50.451484 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:11:50.451718 (+ 234us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:11:50.451722 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:11:50.451840 (+ 118us) client_negotiation.cc:769] Sending connection context
0811 05:11:50.451936 (+ 96us) client_negotiation.cc:240] Negotiation successful
0811 05:11:50.452062 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":167,"threads_started":1}
I20260811 05:11:50.452838 24835 heartbeater.cc:347] Connected to a master server at 127.26.191.254:34837
I20260811 05:11:50.452956 24835 heartbeater.cc:464] Registering TS with master...
I20260811 05:11:50.453157 24835 heartbeater.cc:511] Master 127.26.191.254:34837 requested a full tablet report, sending...
I20260811 05:11:50.453568 24149 ts_manager.cc:194] Registered new tserver with Master: 994070d07eba4bdc8b4be87bc9471d6c (127.26.191.195:36403)
I20260811 05:11:50.453929 24149 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.191.195@KRBTEST.COM'} at 127.26.191.195:36909
I20260811 05:11:50.458123 27391 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 05:11:50.469430 24216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:50.460014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41100 (local address 127.26.191.254:34837)
0811 05:11:50.460157 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0811 05:11:50.460159 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:11:50.460235 (+ 76us) server_negotiation.cc:407] Connection header received
0811 05:11:50.460326 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:11:50.460327 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:11:50.460342 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:11:50.460412 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:11:50.461214 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:50.462078 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:50.463349 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:50.463735 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:50.463799 (+ 64us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:50.466149 (+ 2350us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:11:50.466150 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:11:50.466150 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:11:50.466158 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:11:50.467889 (+ 1731us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:11:50.468387 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:11:50.468389 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:11:50.468389 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:11:50.468461 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:11:50.468698 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:11:50.468700 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:11:50.468700 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:11:50.468944 (+ 244us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:11:50.469080 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0811 05:11:50.469259 (+ 179us) server_negotiation.cc:299] Negotiation successful
0811 05:11:50.469329 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108}
I20260811 05:11:50.475435 24149 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41100:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 05:11:50.477741 24149 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 05:11:50.485924 24850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:50.480753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.195:36403 (local address 127.0.0.1:50922)
0811 05:11:50.480915 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:50.480964 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0811 05:11:50.481036 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:11:50.481583 (+ 547us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:11:50.481587 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:11:50.481589 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:11:50.481680 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:50.481682 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:50.483030 (+ 1348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:50.483031 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:50.484139 (+ 1108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:50.484142 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:50.485596 (+ 1454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:50.485597 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:50.485685 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:50.485703 (+ 18us) client_negotiation.cc:769] Sending connection context
0811 05:11:50.485754 (+ 51us) client_negotiation.cc:240] Negotiation successful
0811 05:11:50.485809 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":74,"threads_started":1}
I20260811 05:11:50.486263 24853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:50.481022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.193:45593 (local address 127.0.0.1:47494)
0811 05:11:50.481663 (+ 641us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:50.481675 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 05:11:50.481775 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:11:50.482027 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:11:50.482028 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:11:50.482031 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:11:50.482127 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:50.482130 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:50.483874 (+ 1744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:50.483876 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:50.485004 (+ 1128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:50.485007 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:50.486040 (+ 1033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:50.486041 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:50.486098 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:50.486102 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 05:11:50.486153 (+ 51us) client_negotiation.cc:240] Negotiation successful
0811 05:11:50.486195 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":615,"mutex_wait_us":2,"thread_start_us":93,"threads_started":1}
I20260811 05:11:50.486282 24855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:50.481203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50922 (local address 127.26.191.195:36403)
0811 05:11:50.481405 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0811 05:11:50.481410 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:11:50.481422 (+ 12us) server_negotiation.cc:407] Connection header received
0811 05:11:50.481469 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:11:50.481472 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:11:50.481490 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:11:50.481577 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:11:50.481785 (+ 208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:50.482932 (+ 1147us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:50.484748 (+ 1816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:50.485492 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:50.486074 (+ 582us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:50.486138 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 05:11:50.486166 (+ 28us) server_negotiation.cc:299] Negotiation successful
0811 05:11:50.486206 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":95,"threads_started":1}
I20260811 05:11:50.486524 24854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:50.481150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47494 (local address 127.26.191.193:45593)
0811 05:11:50.481507 (+ 357us) server_negotiation.cc:206] Beginning negotiation
0811 05:11:50.481512 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:11:50.481762 (+ 250us) server_negotiation.cc:407] Connection header received
0811 05:11:50.481857 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:11:50.481860 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:11:50.481877 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:11:50.481959 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:11:50.482322 (+ 363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:50.483754 (+ 1432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:50.485099 (+ 1345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:50.485845 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:50.485937 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:50.486002 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 05:11:50.486387 (+ 385us) server_negotiation.cc:299] Negotiation successful
0811 05:11:50.486446 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":319,"thread_start_us":133,"threads_started":1}
I20260811 05:11:50.487011 24730 tablet_service.cc:1467] Processing CreateTablet for tablet f96bd40f845c4b9ba6dabe2261453e6a (DEFAULT_TABLE table=test-table [id=5c8ce52486ca430ebf605ce50e36fcde]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:11:50.487411 24730 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f96bd40f845c4b9ba6dabe2261453e6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:11:50.488302 24851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:50.480782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.194:40743 (local address 127.0.0.1:32834)
0811 05:11:50.480951 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:50.480964 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 05:11:50.481036 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:11:50.482016 (+ 980us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:11:50.482017 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:11:50.482019 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:11:50.482094 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:50.482096 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:50.484698 (+ 2602us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:50.484699 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:50.485923 (+ 1224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:50.485926 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:50.488035 (+ 2109us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:50.488036 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:50.488106 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:50.488111 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 05:11:50.488176 (+ 65us) client_negotiation.cc:240] Negotiation successful
0811 05:11:50.488219 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"mutex_wait_us":26,"thread_start_us":113,"threads_started":1}
I20260811 05:11:50.488330 24856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:50.481452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32834 (local address 127.26.191.194:40743)
0811 05:11:50.481838 (+ 386us) server_negotiation.cc:206] Beginning negotiation
0811 05:11:50.481842 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:11:50.481852 (+ 10us) server_negotiation.cc:407] Connection header received
0811 05:11:50.481893 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:11:50.481895 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:11:50.481912 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:11:50.482155 (+ 243us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:11:50.482236 (+ 81us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:50.484606 (+ 2370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:50.486905 (+ 2299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:50.487910 (+ 1005us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:50.488040 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:50.488103 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 05:11:50.488196 (+ 93us) server_negotiation.cc:299] Negotiation successful
0811 05:11:50.488249 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":344,"thread_start_us":97,"threads_started":1}
I20260811 05:11:50.489202 24329 tablet_service.cc:1467] Processing CreateTablet for tablet f96bd40f845c4b9ba6dabe2261453e6a (DEFAULT_TABLE table=test-table [id=5c8ce52486ca430ebf605ce50e36fcde]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:11:50.489212 24528 tablet_service.cc:1467] Processing CreateTablet for tablet f96bd40f845c4b9ba6dabe2261453e6a (DEFAULT_TABLE table=test-table [id=5c8ce52486ca430ebf605ce50e36fcde]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:11:50.489599 24528 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f96bd40f845c4b9ba6dabe2261453e6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:11:50.489609 24329 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f96bd40f845c4b9ba6dabe2261453e6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:11:50.491106 24860 tablet_bootstrap.cc:492] T f96bd40f845c4b9ba6dabe2261453e6a P 994070d07eba4bdc8b4be87bc9471d6c: Bootstrap starting.
I20260811 05:11:50.491981 24860 tablet_bootstrap.cc:654] T f96bd40f845c4b9ba6dabe2261453e6a P 994070d07eba4bdc8b4be87bc9471d6c: Neither blocks nor log segments found. Creating new log.
I20260811 05:11:50.492658 24860 log.cc:824] T f96bd40f845c4b9ba6dabe2261453e6a P 994070d07eba4bdc8b4be87bc9471d6c: Log is configured to *not* fsync() on all Append() calls
I20260811 05:11:50.492843 24862 tablet_bootstrap.cc:492] T f96bd40f845c4b9ba6dabe2261453e6a P b709626ec6b7462a980a10c1d24a2b0d: Bootstrap starting.
I20260811 05:11:50.493681 24862 tablet_bootstrap.cc:654] T f96bd40f845c4b9ba6dabe2261453e6a P b709626ec6b7462a980a10c1d24a2b0d: Neither blocks nor log segments found. Creating new log.
I20260811 05:11:50.493974 24860 tablet_bootstrap.cc:492] T f96bd40f845c4b9ba6dabe2261453e6a P 994070d07eba4bdc8b4be87bc9471d6c: No bootstrap required, opened a new log
I20260811 05:11:50.494063 24860 ts_tablet_manager.cc:1397] T f96bd40f845c4b9ba6dabe2261453e6a P 994070d07eba4bdc8b4be87bc9471d6c: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260811 05:11:50.494179 24867 tablet_bootstrap.cc:492] T f96bd40f845c4b9ba6dabe2261453e6a P d317c3e49cfa4ab5952064face2050a0: Bootstrap starting.
I20260811 05:11:50.494292 24862 log.cc:824] T f96bd40f845c4b9ba6dabe2261453e6a P b709626ec6b7462a980a10c1d24a2b0d: Log is configured to *not* fsync() on all Append() calls
I20260811 05:11:50.494915 24867 tablet_bootstrap.cc:654] T f96bd40f845c4b9ba6dabe2261453e6a P d317c3e49cfa4ab5952064face2050a0: Neither blocks nor log segments found. Creating new log.
I20260811 05:11:50.495168 24862 tablet_bootstrap.cc:492] T f96bd40f845c4b9ba6dabe2261453e6a P b709626ec6b7462a980a10c1d24a2b0d: No bootstrap required, opened a new log
I20260811 05:11:50.495249 24862 ts_tablet_manager.cc:1397] T f96bd40f845c4b9ba6dabe2261453e6a P b709626ec6b7462a980a10c1d24a2b0d: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 05:11:50.495594 24867 log.cc:824] T f96bd40f845c4b9ba6dabe2261453e6a P d317c3e49cfa4ab5952064face2050a0: Log is configured to *not* fsync() on all Append() calls
I20260811 05:11:50.496224 24860 raft_consensus.cc:348] T f96bd40f845c4b9ba6dabe2261453e6a P 994070d07eba4bdc8b4be87bc9471d6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b709626ec6b7462a980a10c1d24a2b0d" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40743 } } peers { permanent_uuid: "994070d07eba4bdc8b4be87bc9471d6c" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 36403 } } peers { permanent_uuid: "d317c3e49cfa4ab5952064face2050a0" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 45593 } }
I20260811 05:11:50.496440 24860 raft_consensus.cc:374] T f96bd40f845c4b9ba6dabe2261453e6a P 994070d07eba4bdc8b4be87bc9471d6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:11:50.496486 24860 raft_consensus.cc:729] T f96bd40f845c4b9ba6dabe2261453e6a P 994070d07eba4bdc8b4be87bc9471d6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 994070d07eba4bdc8b4be87bc9471d6c, State: Initialized, Role: FOLLOWER
I20260811 05:11:50.496631 24860 consensus_queue.cc:260] T f96bd40f845c4b9ba6dabe2261453e6a P 994070d07eba4bdc8b4be87bc9471d6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b709626ec6b7462a980a10c1d24a2b0d" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40743 } } peers { permanent_uuid: "994070d07eba4bdc8b4be87bc9471d6c" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 36403 } } peers { permanent_uuid: "d317c3e49cfa4ab5952064face2050a0" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 45593 } }
I20260811 05:11:50.496877 24867 tablet_bootstrap.cc:492] T f96bd40f845c4b9ba6dabe2261453e6a P d317c3e49cfa4ab5952064face2050a0: No bootstrap required, opened a new log
I20260811 05:11:50.496959 24867 ts_tablet_manager.cc:1397] T f96bd40f845c4b9ba6dabe2261453e6a P d317c3e49cfa4ab5952064face2050a0: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 05:11:50.497013 24860 ts_tablet_manager.cc:1428] T f96bd40f845c4b9ba6dabe2261453e6a P 994070d07eba4bdc8b4be87bc9471d6c: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 05:11:50.497152 24835 heartbeater.cc:503] Master 127.26.191.254:34837 was elected leader, sending a full tablet report...
I20260811 05:11:50.497481 24862 raft_consensus.cc:348] T f96bd40f845c4b9ba6dabe2261453e6a P b709626ec6b7462a980a10c1d24a2b0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b709626ec6b7462a980a10c1d24a2b0d" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40743 } } peers { permanent_uuid: "994070d07eba4bdc8b4be87bc9471d6c" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 36403 } } peers { permanent_uuid: "d317c3e49cfa4ab5952064face2050a0" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 45593 } }
I20260811 05:11:50.497679 24862 raft_consensus.cc:374] T f96bd40f845c4b9ba6dabe2261453e6a P b709626ec6b7462a980a10c1d24a2b0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:11:50.497727 24862 raft_consensus.cc:729] T f96bd40f845c4b9ba6dabe2261453e6a P b709626ec6b7462a980a10c1d24a2b0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b709626ec6b7462a980a10c1d24a2b0d, State: Initialized, Role: FOLLOWER
I20260811 05:11:50.497850 24862 consensus_queue.cc:260] T f96bd40f845c4b9ba6dabe2261453e6a P b709626ec6b7462a980a10c1d24a2b0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b709626ec6b7462a980a10c1d24a2b0d" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40743 } } peers { permanent_uuid: "994070d07eba4bdc8b4be87bc9471d6c" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 36403 } } peers { permanent_uuid: "d317c3e49cfa4ab5952064face2050a0" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 45593 } }
I20260811 05:11:50.498164 24627 heartbeater.cc:503] Master 127.26.191.254:34837 was elected leader, sending a full tablet report...
I20260811 05:11:50.498147 24862 ts_tablet_manager.cc:1428] T f96bd40f845c4b9ba6dabe2261453e6a P b709626ec6b7462a980a10c1d24a2b0d: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 05:11:50.500769 24867 raft_consensus.cc:348] T f96bd40f845c4b9ba6dabe2261453e6a P d317c3e49cfa4ab5952064face2050a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b709626ec6b7462a980a10c1d24a2b0d" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40743 } } peers { permanent_uuid: "994070d07eba4bdc8b4be87bc9471d6c" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 36403 } } peers { permanent_uuid: "d317c3e49cfa4ab5952064face2050a0" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 45593 } }
I20260811 05:11:50.500988 24867 raft_consensus.cc:374] T f96bd40f845c4b9ba6dabe2261453e6a P d317c3e49cfa4ab5952064face2050a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:11:50.501051 24867 raft_consensus.cc:729] T f96bd40f845c4b9ba6dabe2261453e6a P d317c3e49cfa4ab5952064face2050a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d317c3e49cfa4ab5952064face2050a0, State: Initialized, Role: FOLLOWER
I20260811 05:11:50.501191 24867 consensus_queue.cc:260] T f96bd40f845c4b9ba6dabe2261453e6a P d317c3e49cfa4ab5952064face2050a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b709626ec6b7462a980a10c1d24a2b0d" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40743 } } peers { permanent_uuid: "994070d07eba4bdc8b4be87bc9471d6c" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 36403 } } peers { permanent_uuid: "d317c3e49cfa4ab5952064face2050a0" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 45593 } }
I20260811 05:11:50.501529 24867 ts_tablet_manager.cc:1428] T f96bd40f845c4b9ba6dabe2261453e6a P d317c3e49cfa4ab5952064face2050a0: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260811 05:11:50.501549 24429 heartbeater.cc:503] Master 127.26.191.254:34837 was elected leader, sending a full tablet report...
W20260811 05:11:50.518657 24628 tablet.cc:2369] T f96bd40f845c4b9ba6dabe2261453e6a P b709626ec6b7462a980a10c1d24a2b0d: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 05:11:50.605314 24430 tablet.cc:2369] T f96bd40f845c4b9ba6dabe2261453e6a P d317c3e49cfa4ab5952064face2050a0: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 05:11:50.692185 24836 tablet.cc:2369] T f96bd40f845c4b9ba6dabe2261453e6a P 994070d07eba4bdc8b4be87bc9471d6c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 05:11:50.700527 24871 raft_consensus.cc:482] T f96bd40f845c4b9ba6dabe2261453e6a P 994070d07eba4bdc8b4be87bc9471d6c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 05:11:50.700673 24871 raft_consensus.cc:504] T f96bd40f845c4b9ba6dabe2261453e6a P 994070d07eba4bdc8b4be87bc9471d6c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b709626ec6b7462a980a10c1d24a2b0d" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40743 } } peers { permanent_uuid: "994070d07eba4bdc8b4be87bc9471d6c" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 36403 } } peers { permanent_uuid: "d317c3e49cfa4ab5952064face2050a0" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 45593 } }
I20260811 05:11:50.701116 24871 leader_election.cc:288] T f96bd40f845c4b9ba6dabe2261453e6a P 994070d07eba4bdc8b4be87bc9471d6c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b709626ec6b7462a980a10c1d24a2b0d (127.26.191.194:40743), d317c3e49cfa4ab5952064face2050a0 (127.26.191.193:45593)
I20260811 05:11:50.704118 24854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:50.701511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.195:48685 (local address 127.26.191.193:45593)
0811 05:11:50.701582 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0811 05:11:50.701583 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 05:11:50.701591 (+ 8us) server_negotiation.cc:407] Connection header received
0811 05:11:50.701619 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:11:50.701620 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:11:50.701628 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:11:50.701718 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:11:50.701915 (+ 197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:50.702411 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:50.703363 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:50.703741 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:50.703831 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:50.703843 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0811 05:11:50.704010 (+ 167us) server_negotiation.cc:299] Negotiation successful
0811 05:11:50.704049 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 05:11:50.704118 24837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:50.701368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.193:45593 (local address 127.26.191.195:48685)
0811 05:11:50.701409 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:50.701422 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 05:11:50.701472 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:11:50.701726 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:11:50.701727 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:11:50.701729 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:11:50.701828 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:50.701829 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:50.702509 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:50.702510 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:50.703258 (+ 748us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:50.703260 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:50.703829 (+ 569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:50.703830 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:50.703919 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:50.703922 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 05:11:50.704000 (+ 78us) client_negotiation.cc:240] Negotiation successful
0811 05:11:50.704040 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":21}
I20260811 05:11:50.704273 24875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:50.701367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.194:40743 (local address 127.26.191.195:47659)
0811 05:11:50.701701 (+ 334us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:50.701711 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 05:11:50.701791 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:11:50.701949 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:11:50.701949 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:11:50.701951 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:11:50.702029 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:50.702031 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:50.702674 (+ 643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:50.702675 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:50.703411 (+ 736us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:50.703413 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:50.704001 (+ 588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:50.704002 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:50.704075 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:50.704079 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 05:11:50.704151 (+ 72us) client_negotiation.cc:240] Negotiation successful
0811 05:11:50.704187 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":317,"mutex_wait_us":155,"thread_start_us":126,"threads_started":1}
I20260811 05:11:50.704264 24856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:50.701437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.195:47659 (local address 127.26.191.194:40743)
0811 05:11:50.701501 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 05:11:50.701507 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 05:11:50.701787 (+ 280us) server_negotiation.cc:407] Connection header received
0811 05:11:50.701856 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:11:50.701857 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:11:50.701866 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:11:50.701945 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:11:50.702108 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:50.702580 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:50.703506 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:50.703911 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:50.704002 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:50.704010 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 05:11:50.704157 (+ 147us) server_negotiation.cc:299] Negotiation successful
0811 05:11:50.704197 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 05:11:50.704523 24358 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f96bd40f845c4b9ba6dabe2261453e6a" candidate_uuid: "994070d07eba4bdc8b4be87bc9471d6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d317c3e49cfa4ab5952064face2050a0" is_pre_election: true
I20260811 05:11:50.704700 24358 raft_consensus.cc:2454] T f96bd40f845c4b9ba6dabe2261453e6a P d317c3e49cfa4ab5952064face2050a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 994070d07eba4bdc8b4be87bc9471d6c in term 0.
I20260811 05:11:50.704690 24559 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f96bd40f845c4b9ba6dabe2261453e6a" candidate_uuid: "994070d07eba4bdc8b4be87bc9471d6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b709626ec6b7462a980a10c1d24a2b0d" is_pre_election: true
I20260811 05:11:50.704869 24559 raft_consensus.cc:2454] T f96bd40f845c4b9ba6dabe2261453e6a P b709626ec6b7462a980a10c1d24a2b0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 994070d07eba4bdc8b4be87bc9471d6c in term 0.
I20260811 05:11:50.705001 24661 leader_election.cc:302] T f96bd40f845c4b9ba6dabe2261453e6a P 994070d07eba4bdc8b4be87bc9471d6c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 994070d07eba4bdc8b4be87bc9471d6c, d317c3e49cfa4ab5952064face2050a0; no voters:
I20260811 05:11:50.705152 24871 raft_consensus.cc:2781] T f96bd40f845c4b9ba6dabe2261453e6a P 994070d07eba4bdc8b4be87bc9471d6c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 05:11:50.705219 24871 raft_consensus.cc:482] T f96bd40f845c4b9ba6dabe2261453e6a P 994070d07eba4bdc8b4be87bc9471d6c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 05:11:50.705237 24871 raft_consensus.cc:3037] T f96bd40f845c4b9ba6dabe2261453e6a P 994070d07eba4bdc8b4be87bc9471d6c [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:11:50.705996 24871 raft_consensus.cc:504] T f96bd40f845c4b9ba6dabe2261453e6a P 994070d07eba4bdc8b4be87bc9471d6c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b709626ec6b7462a980a10c1d24a2b0d" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40743 } } peers { permanent_uuid: "994070d07eba4bdc8b4be87bc9471d6c" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 36403 } } peers { permanent_uuid: "d317c3e49cfa4ab5952064face2050a0" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 45593 } }
I20260811 05:11:50.706148 24871 leader_election.cc:288] T f96bd40f845c4b9ba6dabe2261453e6a P 994070d07eba4bdc8b4be87bc9471d6c [CANDIDATE]: Term 1 election: Requested vote from peers b709626ec6b7462a980a10c1d24a2b0d (127.26.191.194:40743), d317c3e49cfa4ab5952064face2050a0 (127.26.191.193:45593)
I20260811 05:11:50.706315 24559 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f96bd40f845c4b9ba6dabe2261453e6a" candidate_uuid: "994070d07eba4bdc8b4be87bc9471d6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b709626ec6b7462a980a10c1d24a2b0d"
I20260811 05:11:50.706382 24559 raft_consensus.cc:3037] T f96bd40f845c4b9ba6dabe2261453e6a P b709626ec6b7462a980a10c1d24a2b0d [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:11:50.707077 24559 raft_consensus.cc:2454] T f96bd40f845c4b9ba6dabe2261453e6a P b709626ec6b7462a980a10c1d24a2b0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 994070d07eba4bdc8b4be87bc9471d6c in term 1.
I20260811 05:11:50.707238 24358 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f96bd40f845c4b9ba6dabe2261453e6a" candidate_uuid: "994070d07eba4bdc8b4be87bc9471d6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d317c3e49cfa4ab5952064face2050a0"
I20260811 05:11:50.707304 24659 leader_election.cc:302] T f96bd40f845c4b9ba6dabe2261453e6a P 994070d07eba4bdc8b4be87bc9471d6c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 994070d07eba4bdc8b4be87bc9471d6c, b709626ec6b7462a980a10c1d24a2b0d; no voters:
I20260811 05:11:50.707340 24358 raft_consensus.cc:3037] T f96bd40f845c4b9ba6dabe2261453e6a P d317c3e49cfa4ab5952064face2050a0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:11:50.707427 24871 raft_consensus.cc:2781] T f96bd40f845c4b9ba6dabe2261453e6a P 994070d07eba4bdc8b4be87bc9471d6c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:11:50.707633 24871 raft_consensus.cc:686] T f96bd40f845c4b9ba6dabe2261453e6a P 994070d07eba4bdc8b4be87bc9471d6c [term 1 LEADER]: Becoming Leader. State: Replica: 994070d07eba4bdc8b4be87bc9471d6c, State: Running, Role: LEADER
I20260811 05:11:50.707782 24871 consensus_queue.cc:237] T f96bd40f845c4b9ba6dabe2261453e6a P 994070d07eba4bdc8b4be87bc9471d6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b709626ec6b7462a980a10c1d24a2b0d" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40743 } } peers { permanent_uuid: "994070d07eba4bdc8b4be87bc9471d6c" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 36403 } } peers { permanent_uuid: "d317c3e49cfa4ab5952064face2050a0" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 45593 } }
I20260811 05:11:50.708316 24358 raft_consensus.cc:2454] T f96bd40f845c4b9ba6dabe2261453e6a P d317c3e49cfa4ab5952064face2050a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 994070d07eba4bdc8b4be87bc9471d6c in term 1.
I20260811 05:11:50.708880 24144 catalog_manager.cc:5495] T f96bd40f845c4b9ba6dabe2261453e6a P 994070d07eba4bdc8b4be87bc9471d6c reported cstate change: term changed from 0 to 1, leader changed from <none> to 994070d07eba4bdc8b4be87bc9471d6c (127.26.191.195). New cstate: current_term: 1 leader_uuid: "994070d07eba4bdc8b4be87bc9471d6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b709626ec6b7462a980a10c1d24a2b0d" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "994070d07eba4bdc8b4be87bc9471d6c" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 36403 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d317c3e49cfa4ab5952064face2050a0" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 45593 } health_report { overall_health: UNKNOWN } } }
I20260811 05:11:50.720202 24855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:50.717674 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50934 (local address 127.26.191.195:36403)
0811 05:11:50.717743 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 05:11:50.717745 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:11:50.717771 (+ 26us) server_negotiation.cc:407] Connection header received
0811 05:11:50.717820 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:11:50.717821 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:11:50.717848 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:11:50.717927 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:11:50.718070 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:50.718551 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:50.719351 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:50.719562 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:50.719641 (+ 79us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:50.719794 (+ 153us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:11:50.719906 (+ 112us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:11:50.720019 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0811 05:11:50.720075 (+ 56us) server_negotiation.cc:299] Negotiation successful
0811 05:11:50.720086 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 05:11:50.722206 24358 raft_consensus.cc:1261] T f96bd40f845c4b9ba6dabe2261453e6a P d317c3e49cfa4ab5952064face2050a0 [term 1 FOLLOWER]: Refusing update from remote peer 994070d07eba4bdc8b4be87bc9471d6c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:11:50.722209 24559 raft_consensus.cc:1261] T f96bd40f845c4b9ba6dabe2261453e6a P b709626ec6b7462a980a10c1d24a2b0d [term 1 FOLLOWER]: Refusing update from remote peer 994070d07eba4bdc8b4be87bc9471d6c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:11:50.722631 24876 consensus_queue.cc:1035] T f96bd40f845c4b9ba6dabe2261453e6a P 994070d07eba4bdc8b4be87bc9471d6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b709626ec6b7462a980a10c1d24a2b0d" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:11:50.722779 24871 consensus_queue.cc:1035] T f96bd40f845c4b9ba6dabe2261453e6a P 994070d07eba4bdc8b4be87bc9471d6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d317c3e49cfa4ab5952064face2050a0" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:11:50.725531 24883 mvcc.cc:205] Tried to move back new op lower bound from 7317197253515186176 to 7317197253459824640. Current Snapshot: MvccSnapshot[applied={T|T < 7317197253515186176}]
I20260811 05:11:50.725440 24879 mvcc.cc:205] Tried to move back new op lower bound from 7317197253515186176 to 7317197253459824640. Current Snapshot: MvccSnapshot[applied={T|T < 7317197253515186176}]
I20260811 05:11:50.728576 24144 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41100:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:11:50.728688 24144 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41100:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:11:50.729554 24144 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b0d58601bfe749c5b2b9a455e2a8da5f: Sending DeleteTablet for 3 replicas of tablet f96bd40f845c4b9ba6dabe2261453e6a
I20260811 05:11:50.729940 24730 tablet_service.cc:1514] Processing DeleteTablet for tablet f96bd40f845c4b9ba6dabe2261453e6a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:11:50 UTC) from {username='kudu', principal='kudu/127.26.191.254@KRBTEST.COM'} at 127.0.0.1:50922
I20260811 05:11:50.729992 24329 tablet_service.cc:1514] Processing DeleteTablet for tablet f96bd40f845c4b9ba6dabe2261453e6a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:11:50 UTC) from {username='kudu', principal='kudu/127.26.191.254@KRBTEST.COM'} at 127.0.0.1:47494
I20260811 05:11:50.730201 24899 tablet_replica.cc:330] T f96bd40f845c4b9ba6dabe2261453e6a P 994070d07eba4bdc8b4be87bc9471d6c: stopping tablet replica
I20260811 05:11:50.730203 24528 tablet_service.cc:1514] Processing DeleteTablet for tablet f96bd40f845c4b9ba6dabe2261453e6a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:11:50 UTC) from {username='kudu', principal='kudu/127.26.191.254@KRBTEST.COM'} at 127.0.0.1:32834
I20260811 05:11:50.730327 24899 raft_consensus.cc:2229] T f96bd40f845c4b9ba6dabe2261453e6a P 994070d07eba4bdc8b4be87bc9471d6c [term 1 LEADER]: Raft consensus shutting down.
I20260811 05:11:50.730459 24899 raft_consensus.cc:2258] T f96bd40f845c4b9ba6dabe2261453e6a P 994070d07eba4bdc8b4be87bc9471d6c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:11:50.730463 24902 tablet_replica.cc:330] T f96bd40f845c4b9ba6dabe2261453e6a P b709626ec6b7462a980a10c1d24a2b0d: stopping tablet replica
I20260811 05:11:50.730651 24902 raft_consensus.cc:2229] T f96bd40f845c4b9ba6dabe2261453e6a P b709626ec6b7462a980a10c1d24a2b0d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 05:11:50.730717 24901 tablet_replica.cc:330] T f96bd40f845c4b9ba6dabe2261453e6a P d317c3e49cfa4ab5952064face2050a0: stopping tablet replica
I20260811 05:11:50.730804 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 24240
I20260811 05:11:50.730826 24901 raft_consensus.cc:2229] T f96bd40f845c4b9ba6dabe2261453e6a P d317c3e49cfa4ab5952064face2050a0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 05:11:50.730926 24901 raft_consensus.cc:2258] T f96bd40f845c4b9ba6dabe2261453e6a P d317c3e49cfa4ab5952064face2050a0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:11:50.730919 24902 raft_consensus.cc:2258] T f96bd40f845c4b9ba6dabe2261453e6a P b709626ec6b7462a980a10c1d24a2b0d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:11:50.734141 24902 ts_tablet_manager.cc:1905] T f96bd40f845c4b9ba6dabe2261453e6a P b709626ec6b7462a980a10c1d24a2b0d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:11:50.736027 24902 ts_tablet_manager.cc:1918] T f96bd40f845c4b9ba6dabe2261453e6a P b709626ec6b7462a980a10c1d24a2b0d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 05:11:50.736153 24902 log.cc:1196] T f96bd40f845c4b9ba6dabe2261453e6a P b709626ec6b7462a980a10c1d24a2b0d: Deleting WAL directory at /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424853995437-27391-0/minicluster-data/ts-1/wal/wals/f96bd40f845c4b9ba6dabe2261453e6a
I20260811 05:11:50.736478 24902 ts_tablet_manager.cc:1939] T f96bd40f845c4b9ba6dabe2261453e6a P b709626ec6b7462a980a10c1d24a2b0d: Deleting consensus metadata
I20260811 05:11:50.753368 24124 catalog_manager.cc:4841] TS b709626ec6b7462a980a10c1d24a2b0d (127.26.191.194:40743): tablet f96bd40f845c4b9ba6dabe2261453e6a (table test-table [id=5c8ce52486ca430ebf605ce50e36fcde]) successfully deleted
I20260811 05:11:50.755051 24899 ts_tablet_manager.cc:1905] T f96bd40f845c4b9ba6dabe2261453e6a P 994070d07eba4bdc8b4be87bc9471d6c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:11:50.756922 24899 ts_tablet_manager.cc:1918] T f96bd40f845c4b9ba6dabe2261453e6a P 994070d07eba4bdc8b4be87bc9471d6c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 05:11:50.757021 24899 log.cc:1196] T f96bd40f845c4b9ba6dabe2261453e6a P 994070d07eba4bdc8b4be87bc9471d6c: Deleting WAL directory at /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424853995437-27391-0/minicluster-data/ts-2/wal/wals/f96bd40f845c4b9ba6dabe2261453e6a
I20260811 05:11:50.757354 24899 ts_tablet_manager.cc:1939] T f96bd40f845c4b9ba6dabe2261453e6a P 994070d07eba4bdc8b4be87bc9471d6c: Deleting consensus metadata
I20260811 05:11:50.757933 24126 catalog_manager.cc:4841] TS 994070d07eba4bdc8b4be87bc9471d6c (127.26.191.195:36403): tablet f96bd40f845c4b9ba6dabe2261453e6a (table test-table [id=5c8ce52486ca430ebf605ce50e36fcde]) successfully deleted
W20260811 05:11:50.760010 24126 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.191.193:45593 (error 108)
I20260811 05:11:50.760627 24851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:50.760476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.193:45593 (local address 127.0.0.1:47504)
0811 05:11:50.760541 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:50.760587 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.193:45593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260811 05:11:50.760763 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 24435
W20260811 05:11:50.765981 24126 catalog_manager.cc:4584] TS d317c3e49cfa4ab5952064face2050a0 (127.26.191.193:45593): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet f96bd40f845c4b9ba6dabe2261453e6a: Network error: Client connection negotiation failed: client connection to 127.26.191.193:45593: connect: Connection refused (error 111)
I20260811 05:11:50.773212 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 24633
I20260811 05:11:50.787196 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 24098
2026-08-11T05:11:50Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2437 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-11T05:11:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:11:50Z Disabled control of system clock
I20260811 05:11:50.826615 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424853995437-27391-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424853995437-27391-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424853995437-27391-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.254:44953
--webserver_interface=127.26.191.254
--webserver_port=0
--builtin_ntp_servers=127.26.191.212:44837
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.191.254:44953
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 05:11:50.910703 24911 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:11:50.911024 24911 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:11:50.911053 24911 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:11:50.912223 24911 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:11:50.912261 24911 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:11:50.912274 24911 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:11:50.912287 24911 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:11:50.912299 24911 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:11:50.914283 24911 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:44837
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424853995437-27391-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424853995437-27391-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.191.254:44953
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.254:44953
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.191.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24911
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424853995437-27391-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:11:50.914508 24911 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:11:50.914753 24911 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:11:50.920465 24918 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:11:50.920454 24922 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:11:50.920454 24919 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:11:50.920781 24911 server_base.cc:1034] running on GCE node
I20260811 05:11:50.921180 24911 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:11:50.921499 24911 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:11:50.922673 24911 hybrid_clock.cc:648] HybridClock initialized: now 1786425110922664 us; error 68 us; skew 500 ppm
I20260811 05:11:50.924013 24911 webserver.cc:460] Webserver started at http://127.26.191.254:38541/ using document root <none> and password file <none>
I20260811 05:11:50.924293 24911 fs_manager.cc:359] Metadata directory not provided
I20260811 05:11:50.924368 24911 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:11:50.924517 24911 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:11:50.925695 24911 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424853995437-27391-0/minicluster-data/master-0/data/instance:
uuid: "007faa2c9a93471e8275c1d2f04fb525"
format_stamp: "Formatted at 2026-08-11 05:11:50 on dist-test-slave-x5fp"
server_key: "122082dbe13f8935e6bfc54ca6fc0af7"
server_key_iv: "3733adc2fbdbb263599a7ede512c7489"
server_key_version: "encryptionkey@0"
I20260811 05:11:50.926088 24911 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424853995437-27391-0/minicluster-data/master-0/wal/instance:
uuid: "007faa2c9a93471e8275c1d2f04fb525"
format_stamp: "Formatted at 2026-08-11 05:11:50 on dist-test-slave-x5fp"
server_key: "122082dbe13f8935e6bfc54ca6fc0af7"
server_key_iv: "3733adc2fbdbb263599a7ede512c7489"
server_key_version: "encryptionkey@0"
I20260811 05:11:50.927498 24911 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 05:11:50.928370 24931 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:11:50.928570 24911 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:11:50.928680 24911 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424853995437-27391-0/minicluster-data/master-0/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424853995437-27391-0/minicluster-data/master-0/wal
uuid: "007faa2c9a93471e8275c1d2f04fb525"
format_stamp: "Formatted at 2026-08-11 05:11:50 on dist-test-slave-x5fp"
server_key: "122082dbe13f8935e6bfc54ca6fc0af7"
server_key_iv: "3733adc2fbdbb263599a7ede512c7489"
server_key_version: "encryptionkey@0"
I20260811 05:11:50.928791 24911 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424853995437-27391-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424853995437-27391-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424853995437-27391-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:11:50.936537 24911 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:11:50.936923 24911 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:11:50.937086 24911 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:11:50.941725 24911 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.254:44953
I20260811 05:11:50.941776 25020 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.254:44953 every 8 connection(s)
I20260811 05:11:50.942147 24911 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
I20260811 05:11:50.943466 25023 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:11:50.945920 25023 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 007faa2c9a93471e8275c1d2f04fb525: Bootstrap starting.
I20260811 05:11:50.946599 25023 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 007faa2c9a93471e8275c1d2f04fb525: Neither blocks nor log segments found. Creating new log.
I20260811 05:11:50.946875 25023 log.cc:824] T 00000000000000000000000000000000 P 007faa2c9a93471e8275c1d2f04fb525: Log is configured to *not* fsync() on all Append() calls
I20260811 05:11:50.947588 25023 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 007faa2c9a93471e8275c1d2f04fb525: No bootstrap required, opened a new log
I20260811 05:11:50.949363 25023 raft_consensus.cc:348] T 00000000000000000000000000000000 P 007faa2c9a93471e8275c1d2f04fb525 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "007faa2c9a93471e8275c1d2f04fb525" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 44953 } }
I20260811 05:11:50.949509 25023 raft_consensus.cc:374] T 00000000000000000000000000000000 P 007faa2c9a93471e8275c1d2f04fb525 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:11:50.949533 25023 raft_consensus.cc:729] T 00000000000000000000000000000000 P 007faa2c9a93471e8275c1d2f04fb525 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 007faa2c9a93471e8275c1d2f04fb525, State: Initialized, Role: FOLLOWER
I20260811 05:11:50.949640 25023 consensus_queue.cc:260] T 00000000000000000000000000000000 P 007faa2c9a93471e8275c1d2f04fb525 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "007faa2c9a93471e8275c1d2f04fb525" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 44953 } }
I20260811 05:11:50.949694 25023 raft_consensus.cc:388] T 00000000000000000000000000000000 P 007faa2c9a93471e8275c1d2f04fb525 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:11:50.949724 25023 raft_consensus.cc:482] T 00000000000000000000000000000000 P 007faa2c9a93471e8275c1d2f04fb525 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:11:50.949759 25023 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 007faa2c9a93471e8275c1d2f04fb525 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:11:50.950245 25023 raft_consensus.cc:504] T 00000000000000000000000000000000 P 007faa2c9a93471e8275c1d2f04fb525 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "007faa2c9a93471e8275c1d2f04fb525" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 44953 } }
I20260811 05:11:50.950331 25023 leader_election.cc:302] T 00000000000000000000000000000000 P 007faa2c9a93471e8275c1d2f04fb525 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 007faa2c9a93471e8275c1d2f04fb525; no voters:
I20260811 05:11:50.950462 25023 leader_election.cc:288] T 00000000000000000000000000000000 P 007faa2c9a93471e8275c1d2f04fb525 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 05:11:50.950518 25028 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 007faa2c9a93471e8275c1d2f04fb525 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:11:50.950730 25028 raft_consensus.cc:686] T 00000000000000000000000000000000 P 007faa2c9a93471e8275c1d2f04fb525 [term 1 LEADER]: Becoming Leader. State: Replica: 007faa2c9a93471e8275c1d2f04fb525, State: Running, Role: LEADER
I20260811 05:11:50.950798 25023 sys_catalog.cc:564] T 00000000000000000000000000000000 P 007faa2c9a93471e8275c1d2f04fb525 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:11:50.950892 25028 consensus_queue.cc:237] T 00000000000000000000000000000000 P 007faa2c9a93471e8275c1d2f04fb525 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "007faa2c9a93471e8275c1d2f04fb525" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 44953 } }
I20260811 05:11:50.951443 25030 sys_catalog.cc:455] T 00000000000000000000000000000000 P 007faa2c9a93471e8275c1d2f04fb525 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "007faa2c9a93471e8275c1d2f04fb525" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "007faa2c9a93471e8275c1d2f04fb525" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 44953 } } }
I20260811 05:11:50.951630 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 24911
I20260811 05:11:50.951719 25030 sys_catalog.cc:458] T 00000000000000000000000000000000 P 007faa2c9a93471e8275c1d2f04fb525 [sys.catalog]: This master's current role is: LEADER
I20260811 05:11:50.951753 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424853995437-27391-0/minicluster-data/master-0/wal/instance
I20260811 05:11:50.951647 25031 sys_catalog.cc:455] T 00000000000000000000000000000000 P 007faa2c9a93471e8275c1d2f04fb525 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 007faa2c9a93471e8275c1d2f04fb525. Latest consensus state: current_term: 1 leader_uuid: "007faa2c9a93471e8275c1d2f04fb525" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "007faa2c9a93471e8275c1d2f04fb525" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 44953 } } }
I20260811 05:11:50.951886 25031 sys_catalog.cc:458] T 00000000000000000000000000000000 P 007faa2c9a93471e8275c1d2f04fb525 [sys.catalog]: This master's current role is: LEADER
I20260811 05:11:50.951968 27391 external_mini_cluster.cc:1428] Setting key 380aa8f1cb15a31fcc95ef668cd620dd
I20260811 05:11:50.952082 25039 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:11:50.952744 25039 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:11:50.954370 25039 catalog_manager.cc:1347] Generated new cluster ID: dc0e66ed91fb4ad4ba8eb557b46fe7fb
I20260811 05:11:50.954424 25039 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:11:50.958858 25056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:50.952678 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59208 (local address 127.26.191.254:44953)
0811 05:11:50.953449 (+ 771us) server_negotiation.cc:206] Beginning negotiation
0811 05:11:50.953458 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 05:11:50.953487 (+ 29us) server_negotiation.cc:407] Connection header received
0811 05:11:50.953598 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:11:50.953605 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:11:50.953673 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:11:50.953810 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:11:50.954056 (+ 246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:50.955442 (+ 1386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:50.956546 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:50.957235 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:50.957370 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:50.958099 (+ 729us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:11:50.958104 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:11:50.958104 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:11:50.958326 (+ 222us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:11:50.958382 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:11:50.958399 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:11:50.958474 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 05:11:50.958543 (+ 69us) server_negotiation.cc:299] Negotiation successful
0811 05:11:50.958628 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":690,"thread_start_us":97,"threads_started":1}
I20260811 05:11:50.979013 25039 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:11:50.979800 25039 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:11:50.992777 25039 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 007faa2c9a93471e8275c1d2f04fb525: Generated new TSK 0
I20260811 05:11:50.993026 25039 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 05:11:51.003171 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424853995437-27391-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424853995437-27391-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424853995437-27391-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424853995437-27391-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.191.193:0
--local_ip_for_outbound_sockets=127.26.191.193
--webserver_interface=127.26.191.193
--webserver_port=0
--tserver_master_addrs=127.26.191.254:44953
--builtin_ntp_servers=127.26.191.212:44837
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 05:11:51.089098 25059 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:11:51.089309 25059 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:11:51.089332 25059 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:11:51.090415 25059 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:11:51.090446 25059 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:11:51.090471 25059 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.191.193
I20260811 05:11:51.091750 25059 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:44837
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424853995437-27391-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424853995437-27391-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.191.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424853995437-27391-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.191.193
--webserver_port=0
--tserver_master_addrs=127.26.191.254:44953
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25059
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.191.193
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424853995437-27391-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:11:51.091959 25059 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:11:51.092221 25059 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:11:51.097484 25068 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:11:51.097458 25067 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:11:51.097476 25073 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:11:51.097802 25059 server_base.cc:1034] running on GCE node
I20260811 05:11:51.098057 25059 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:11:51.098341 25059 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:11:51.099560 25059 hybrid_clock.cc:648] HybridClock initialized: now 1786425111099543 us; error 44 us; skew 500 ppm
I20260811 05:11:51.101075 25059 webserver.cc:460] Webserver started at http://127.26.191.193:35875/ using document root <none> and password file <none>
I20260811 05:11:51.101382 25059 fs_manager.cc:359] Metadata directory not provided
I20260811 05:11:51.101461 25059 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:11:51.101627 25059 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:11:51.102787 25059 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424853995437-27391-0/minicluster-data/ts-0/data/instance:
uuid: "13d92edff82c4fafb0fbccf5dd963b56"
format_stamp: "Formatted at 2026-08-11 05:11:51 on dist-test-slave-x5fp"
server_key: "3ae02047bc63322bc67f5b2297d11316"
server_key_iv: "168183217fd60737d5dc9fc1b54998ea"
server_key_version: "encryptionkey@0"
I20260811 05:11:51.103200 25059 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424853995437-27391-0/minicluster-data/ts-0/wal/instance:
uuid: "13d92edff82c4fafb0fbccf5dd963b56"
format_stamp: "Formatted at 2026-08-11 05:11:51 on dist-test-slave-x5fp"
server_key: "3ae02047bc63322bc67f5b2297d11316"
server_key_iv: "168183217fd60737d5dc9fc1b54998ea"
server_key_version: "encryptionkey@0"
I20260811 05:11:51.104818 25059 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 05:11:51.105670 25086 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:11:51.105881 25059 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:11:51.106002 25059 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424853995437-27391-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424853995437-27391-0/minicluster-data/ts-0/wal
uuid: "13d92edff82c4fafb0fbccf5dd963b56"
format_stamp: "Formatted at 2026-08-11 05:11:51 on dist-test-slave-x5fp"
server_key: "3ae02047bc63322bc67f5b2297d11316"
server_key_iv: "168183217fd60737d5dc9fc1b54998ea"
server_key_version: "encryptionkey@0"
I20260811 05:11:51.106084 25059 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424853995437-27391-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424853995437-27391-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424853995437-27391-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:11:51.123720 25059 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:11:51.124070 25059 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:11:51.124231 25059 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:11:51.124490 25059 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:11:51.124933 25059 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:11:51.124970 25059 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:11:51.124994 25059 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:11:51.125039 25059 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:11:51.130872 25059 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.193:41341
I20260811 05:11:51.130959 25269 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.193:41341 every 8 connection(s)
I20260811 05:11:51.131323 25059 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424853995437-27391-0/minicluster-data/ts-0/data/info.pb
I20260811 05:11:51.136873 25056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:51.132160 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.193:55815 (local address 127.26.191.254:44953)
0811 05:11:51.132221 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0811 05:11:51.132224 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:11:51.132514 (+ 290us) server_negotiation.cc:407] Connection header received
0811 05:11:51.133090 (+ 576us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:11:51.133092 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:11:51.133106 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:11:51.133158 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:11:51.133869 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:51.134388 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:51.135390 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:51.135588 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:51.135655 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:51.136552 (+ 897us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:11:51.136553 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:11:51.136553 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:11:51.136560 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:11:51.136576 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:11:51.136580 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:11:51.136632 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 05:11:51.136769 (+ 137us) server_negotiation.cc:299] Negotiation successful
0811 05:11:51.136809 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 05:11:51.137071 25275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:51.132156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:44953 (local address 127.26.191.193:55815)
0811 05:11:51.132359 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:51.132396 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 05:11:51.132989 (+ 593us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:11:51.133223 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:11:51.133226 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:11:51.133234 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:11:51.133776 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:51.133781 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:51.134484 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:51.134486 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:51.135294 (+ 808us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:51.135296 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:51.135675 (+ 379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:51.135676 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:51.135789 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:51.136410 (+ 621us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 05:11:51.136411 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:11:51.136440 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 05:11:51.136463 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:11:51.136643 (+ 180us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:11:51.136648 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:11:51.136651 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 05:11:51.136703 (+ 52us) client_negotiation.cc:240] Negotiation successful
0811 05:11:51.136856 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":89,"threads_started":1}
I20260811 05:11:51.137635 25273 heartbeater.cc:347] Connected to a master server at 127.26.191.254:44953
I20260811 05:11:51.137746 25273 heartbeater.cc:464] Registering TS with master...
I20260811 05:11:51.137940 25273 heartbeater.cc:511] Master 127.26.191.254:44953 requested a full tablet report, sending...
I20260811 05:11:51.138541 24963 ts_manager.cc:194] Registered new tserver with Master: 13d92edff82c4fafb0fbccf5dd963b56 (127.26.191.193:41341)
I20260811 05:11:51.139168 24963 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.191.193:55815
I20260811 05:11:51.139559 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 25059
I20260811 05:11:51.139693 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424853995437-27391-0/minicluster-data/ts-0/wal/instance
I20260811 05:11:51.139938 27391 external_mini_cluster.cc:1428] Setting key 10ca0a6d96491801ec557108bdfb393c
I20260811 05:11:51.140995 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424853995437-27391-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424853995437-27391-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424853995437-27391-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424853995437-27391-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.191.194:0
--local_ip_for_outbound_sockets=127.26.191.194
--webserver_interface=127.26.191.194
--webserver_port=0
--tserver_master_addrs=127.26.191.254:44953
--builtin_ntp_servers=127.26.191.212:44837
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 05:11:51.233585 25277 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:11:51.233799 25277 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:11:51.233822 25277 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:11:51.234988 25277 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:11:51.235031 25277 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:11:51.235057 25277 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.191.194
I20260811 05:11:51.236426 25277 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:44837
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424853995437-27391-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424853995437-27391-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.191.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424853995437-27391-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.191.194
--webserver_port=0
--tserver_master_addrs=127.26.191.254:44953
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25277
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.191.194
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424853995437-27391-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:11:51.236680 25277 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:11:51.237057 25277 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:11:51.242563 25289 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:11:51.242566 25286 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:11:51.242666 25292 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:11:51.242688 25277 server_base.cc:1034] running on GCE node
I20260811 05:11:51.243144 25277 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:11:51.243456 25277 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:11:51.244638 25277 hybrid_clock.cc:648] HybridClock initialized: now 1786425111244621 us; error 27 us; skew 500 ppm
I20260811 05:11:51.246057 25277 webserver.cc:460] Webserver started at http://127.26.191.194:39031/ using document root <none> and password file <none>
I20260811 05:11:51.246341 25277 fs_manager.cc:359] Metadata directory not provided
I20260811 05:11:51.246419 25277 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:11:51.246582 25277 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:11:51.247792 25277 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424853995437-27391-0/minicluster-data/ts-1/data/instance:
uuid: "172d28c3c3c74db9ade0f3bd86dd9b0f"
format_stamp: "Formatted at 2026-08-11 05:11:51 on dist-test-slave-x5fp"
server_key: "e5aba96e843fc0c268fcd2e96a0a89d1"
server_key_iv: "c023fe56709825265aaf4d64d3e9c1f6"
server_key_version: "encryptionkey@0"
I20260811 05:11:51.248178 25277 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424853995437-27391-0/minicluster-data/ts-1/wal/instance:
uuid: "172d28c3c3c74db9ade0f3bd86dd9b0f"
format_stamp: "Formatted at 2026-08-11 05:11:51 on dist-test-slave-x5fp"
server_key: "e5aba96e843fc0c268fcd2e96a0a89d1"
server_key_iv: "c023fe56709825265aaf4d64d3e9c1f6"
server_key_version: "encryptionkey@0"
I20260811 05:11:51.249629 25277 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 05:11:51.250490 25301 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:11:51.250691 25277 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:11:51.250805 25277 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424853995437-27391-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424853995437-27391-0/minicluster-data/ts-1/wal
uuid: "172d28c3c3c74db9ade0f3bd86dd9b0f"
format_stamp: "Formatted at 2026-08-11 05:11:51 on dist-test-slave-x5fp"
server_key: "e5aba96e843fc0c268fcd2e96a0a89d1"
server_key_iv: "c023fe56709825265aaf4d64d3e9c1f6"
server_key_version: "encryptionkey@0"
I20260811 05:11:51.250914 25277 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424853995437-27391-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424853995437-27391-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424853995437-27391-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:11:51.278421 25277 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:11:51.278784 25277 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:11:51.278955 25277 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:11:51.279232 25277 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:11:51.279606 25277 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:11:51.279664 25277 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:11:51.279716 25277 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:11:51.279747 25277 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:11:51.285724 25277 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.194:42951
I20260811 05:11:51.285815 25487 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.194:42951 every 8 connection(s)
I20260811 05:11:51.286185 25277 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424853995437-27391-0/minicluster-data/ts-1/data/info.pb
I20260811 05:11:51.288174 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 25277
I20260811 05:11:51.288295 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424853995437-27391-0/minicluster-data/ts-1/wal/instance
I20260811 05:11:51.288491 27391 external_mini_cluster.cc:1428] Setting key cf818344ae15eae842d6f8c34020a3fb
I20260811 05:11:51.289547 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424853995437-27391-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424853995437-27391-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424853995437-27391-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424853995437-27391-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.191.195:0
--local_ip_for_outbound_sockets=127.26.191.195
--webserver_interface=127.26.191.195
--webserver_port=0
--tserver_master_addrs=127.26.191.254:44953
--builtin_ntp_servers=127.26.191.212:44837
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 05:11:51.292207 25056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:51.287039 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.194:41243 (local address 127.26.191.254:44953)
0811 05:11:51.287111 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0811 05:11:51.287113 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:11:51.287362 (+ 249us) server_negotiation.cc:407] Connection header received
0811 05:11:51.287940 (+ 578us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:11:51.287941 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:11:51.287954 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:11:51.288026 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:11:51.288944 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:51.289555 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:51.290588 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:51.290800 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:51.290895 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:51.291931 (+ 1036us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:11:51.291933 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:11:51.291934 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:11:51.291938 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:11:51.291954 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:11:51.291959 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:11:51.292008 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 05:11:51.292119 (+ 111us) server_negotiation.cc:299] Negotiation successful
0811 05:11:51.292144 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 05:11:51.292526 25491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:51.287030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:44953 (local address 127.26.191.194:41243)
0811 05:11:51.287229 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:51.287266 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 05:11:51.287813 (+ 547us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:11:51.288108 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:11:51.288111 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:11:51.288120 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:11:51.288833 (+ 713us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:51.288841 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:51.289658 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:51.289659 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:51.290485 (+ 826us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:51.290488 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:51.290912 (+ 424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:51.290913 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:51.291095 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:51.291721 (+ 626us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 05:11:51.291722 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:11:51.291766 (+ 44us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 05:11:51.291797 (+ 31us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:11:51.292030 (+ 233us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:11:51.292036 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:11:51.292040 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 05:11:51.292116 (+ 76us) client_negotiation.cc:240] Negotiation successful
0811 05:11:51.292237 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":70,"threads_started":1}
I20260811 05:11:51.293102 25488 heartbeater.cc:347] Connected to a master server at 127.26.191.254:44953
I20260811 05:11:51.293203 25488 heartbeater.cc:464] Registering TS with master...
I20260811 05:11:51.293426 25488 heartbeater.cc:511] Master 127.26.191.254:44953 requested a full tablet report, sending...
I20260811 05:11:51.293867 24963 ts_manager.cc:194] Registered new tserver with Master: 172d28c3c3c74db9ade0f3bd86dd9b0f (127.26.191.194:42951)
I20260811 05:11:51.294255 24963 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.191.194:41243
W20260811 05:11:51.375772 25492 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:11:51.376032 25492 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:11:51.376070 25492 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:11:51.377239 25492 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:11:51.377305 25492 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:11:51.377346 25492 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.191.195
I20260811 05:11:51.378731 25492 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:44837
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424853995437-27391-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424853995437-27391-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.191.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424853995437-27391-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.191.195
--webserver_port=0
--tserver_master_addrs=127.26.191.254:44953
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25492
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.191.195
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424853995437-27391-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:11:51.379011 25492 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:11:51.379329 25492 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:11:51.384910 25511 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:11:51.385064 25492 server_base.cc:1034] running on GCE node
W20260811 05:11:51.384912 25506 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:11:51.385187 25504 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:11:51.385416 25492 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:11:51.385697 25492 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:11:51.386919 25492 hybrid_clock.cc:648] HybridClock initialized: now 1786425111386903 us; error 32 us; skew 500 ppm
I20260811 05:11:51.388293 25492 webserver.cc:460] Webserver started at http://127.26.191.195:46657/ using document root <none> and password file <none>
I20260811 05:11:51.388581 25492 fs_manager.cc:359] Metadata directory not provided
I20260811 05:11:51.388635 25492 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:11:51.388830 25492 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:11:51.389978 25492 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424853995437-27391-0/minicluster-data/ts-2/data/instance:
uuid: "2142c6b9560b4293958900b545d1dc8e"
format_stamp: "Formatted at 2026-08-11 05:11:51 on dist-test-slave-x5fp"
server_key: "05eefe5b34b5ed3bed05ab6f0f04fb1b"
server_key_iv: "5a163fea860707358fafe83ad72be290"
server_key_version: "encryptionkey@0"
I20260811 05:11:51.390339 25492 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424853995437-27391-0/minicluster-data/ts-2/wal/instance:
uuid: "2142c6b9560b4293958900b545d1dc8e"
format_stamp: "Formatted at 2026-08-11 05:11:51 on dist-test-slave-x5fp"
server_key: "05eefe5b34b5ed3bed05ab6f0f04fb1b"
server_key_iv: "5a163fea860707358fafe83ad72be290"
server_key_version: "encryptionkey@0"
I20260811 05:11:51.391808 25492 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 05:11:51.392791 25524 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:11:51.393038 25492 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:11:51.393162 25492 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424853995437-27391-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424853995437-27391-0/minicluster-data/ts-2/wal
uuid: "2142c6b9560b4293958900b545d1dc8e"
format_stamp: "Formatted at 2026-08-11 05:11:51 on dist-test-slave-x5fp"
server_key: "05eefe5b34b5ed3bed05ab6f0f04fb1b"
server_key_iv: "5a163fea860707358fafe83ad72be290"
server_key_version: "encryptionkey@0"
I20260811 05:11:51.393261 25492 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424853995437-27391-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424853995437-27391-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424853995437-27391-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:11:51.419556 25492 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:11:51.419953 25492 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:11:51.420140 25492 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:11:51.420444 25492 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:11:51.420962 25492 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:11:51.421026 25492 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:11:51.421072 25492 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:11:51.421120 25492 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:11:51.427855 25492 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.195:42001
I20260811 05:11:51.427953 25698 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.195:42001 every 8 connection(s)
I20260811 05:11:51.428375 25492 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424853995437-27391-0/minicluster-data/ts-2/data/info.pb
I20260811 05:11:51.434226 25056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:51.429235 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.195:41383 (local address 127.26.191.254:44953)
0811 05:11:51.429300 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 05:11:51.429302 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:11:51.429569 (+ 267us) server_negotiation.cc:407] Connection header received
0811 05:11:51.430143 (+ 574us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:11:51.430144 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:11:51.430155 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:11:51.430232 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:11:51.430913 (+ 681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:51.431454 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:51.432585 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:51.432919 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:51.432982 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:51.433866 (+ 884us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:11:51.433867 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:11:51.433867 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:11:51.433872 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:11:51.433886 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:11:51.433890 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:11:51.433943 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 05:11:51.434133 (+ 190us) server_negotiation.cc:299] Negotiation successful
0811 05:11:51.434159 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260811 05:11:51.434448 25704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:51.429214 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:44953 (local address 127.26.191.195:41383)
0811 05:11:51.429397 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:51.429434 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 05:11:51.430037 (+ 603us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:11:51.430291 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:11:51.430294 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:11:51.430303 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:11:51.430829 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:51.430834 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:51.431571 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:51.431572 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:51.432488 (+ 916us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:51.432492 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:51.432990 (+ 498us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:51.432991 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:51.433108 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:51.433729 (+ 621us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 05:11:51.433730 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:11:51.433759 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 05:11:51.433783 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:11:51.433944 (+ 161us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:11:51.433946 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:11:51.433948 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 05:11:51.434119 (+ 171us) client_negotiation.cc:240] Negotiation successful
0811 05:11:51.434201 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":81,"threads_started":1}
I20260811 05:11:51.435045 25699 heartbeater.cc:347] Connected to a master server at 127.26.191.254:44953
I20260811 05:11:51.435134 25699 heartbeater.cc:464] Registering TS with master...
I20260811 05:11:51.435375 25699 heartbeater.cc:511] Master 127.26.191.254:44953 requested a full tablet report, sending...
I20260811 05:11:51.435817 24963 ts_manager.cc:194] Registered new tserver with Master: 2142c6b9560b4293958900b545d1dc8e (127.26.191.195:42001)
I20260811 05:11:51.436221 24963 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.191.195:41383
I20260811 05:11:51.436681 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 25492
I20260811 05:11:51.436837 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424853995437-27391-0/minicluster-data/ts-2/wal/instance
I20260811 05:11:51.437073 27391 external_mini_cluster.cc:1428] Setting key 2fc4d4711e9fc711c72f8145252ed131
I20260811 05:11:51.438290 27391 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 05:11:51.443090 25056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:51.439859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59216 (local address 127.26.191.254:44953)
0811 05:11:51.439930 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0811 05:11:51.439932 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:11:51.440071 (+ 139us) server_negotiation.cc:407] Connection header received
0811 05:11:51.440144 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:11:51.440145 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:11:51.440158 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:11:51.440203 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:11:51.440376 (+ 173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:51.440951 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:51.441732 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:51.441934 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:51.442010 (+ 76us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:51.442711 (+ 701us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:11:51.442712 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:11:51.442713 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:11:51.442718 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:11:51.442734 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:11:51.442738 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:11:51.442853 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0811 05:11:51.442984 (+ 131us) server_negotiation.cc:299] Negotiation successful
0811 05:11:51.442996 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 05:11:51.444681 24963 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59216:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 05:11:51.446334 24963 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 05:11:51.453581 25716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:51.448906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.193:41341 (local address 127.0.0.1:35514)
0811 05:11:51.449020 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:51.449065 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 05:11:51.449139 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:11:51.449599 (+ 460us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:11:51.449602 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:11:51.449604 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:11:51.449693 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:51.449697 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:51.451083 (+ 1386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:51.451083 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:51.452292 (+ 1209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:51.452295 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:51.453318 (+ 1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:51.453319 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:51.453387 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:51.453391 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 05:11:51.453435 (+ 44us) client_negotiation.cc:240] Negotiation successful
0811 05:11:51.453481 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":89,"mutex_wait_us":2,"thread_start_us":64,"threads_started":1}
I20260811 05:11:51.453596 25720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:51.449192 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35514 (local address 127.26.191.193:41341)
0811 05:11:51.449388 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0811 05:11:51.449394 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 05:11:51.449406 (+ 12us) server_negotiation.cc:407] Connection header received
0811 05:11:51.449456 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:11:51.449458 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:11:51.449475 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:11:51.449784 (+ 309us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:11:51.449859 (+ 75us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:51.451009 (+ 1150us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:51.452400 (+ 1391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:51.453221 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:51.453316 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:51.453413 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0811 05:11:51.453458 (+ 45us) server_negotiation.cc:299] Negotiation successful
0811 05:11:51.453503 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154,"thread_start_us":117,"threads_started":1}
I20260811 05:11:51.453596 25719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:51.449187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57744 (local address 127.26.191.194:42951)
0811 05:11:51.449382 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0811 05:11:51.449387 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:11:51.449655 (+ 268us) server_negotiation.cc:407] Connection header received
0811 05:11:51.449707 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:11:51.449709 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:11:51.449739 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:11:51.449812 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:11:51.450002 (+ 190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:51.451190 (+ 1188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:51.452299 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:51.453056 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:51.453141 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:51.453236 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0811 05:11:51.453459 (+ 223us) server_negotiation.cc:299] Negotiation successful
0811 05:11:51.453504 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":96,"threads_started":1}
I20260811 05:11:51.454033 25721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:51.449395 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52016 (local address 127.26.191.195:42001)
0811 05:11:51.449766 (+ 371us) server_negotiation.cc:206] Beginning negotiation
0811 05:11:51.449770 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:11:51.449781 (+ 11us) server_negotiation.cc:407] Connection header received
0811 05:11:51.449824 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:11:51.449826 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:11:51.449842 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:11:51.449917 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:11:51.450031 (+ 114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:51.450855 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:51.452747 (+ 1892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:51.453479 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:51.453546 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:51.453627 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 05:11:51.453844 (+ 217us) server_negotiation.cc:299] Negotiation successful
0811 05:11:51.453902 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":330,"thread_start_us":141,"threads_started":1}
I20260811 05:11:51.453922 25717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:51.448911 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.195:42001 (local address 127.0.0.1:52016)
0811 05:11:51.449408 (+ 497us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:51.449420 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 05:11:51.449474 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:11:51.449926 (+ 452us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:11:51.449927 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:11:51.449929 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:11:51.449978 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:51.449979 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:51.450938 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:51.450939 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:51.452630 (+ 1691us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:51.452632 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:51.453666 (+ 1034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:51.453666 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:51.453744 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:51.453749 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 05:11:51.453808 (+ 59us) client_negotiation.cc:240] Negotiation successful
0811 05:11:51.453861 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":483,"mutex_wait_us":32,"thread_start_us":69,"threads_started":1}
I20260811 05:11:51.454048 25718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:51.448912 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.194:42951 (local address 127.0.0.1:57744)
0811 05:11:51.449549 (+ 637us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:51.449559 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 05:11:51.449600 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:11:51.449882 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:11:51.449883 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:11:51.449884 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:11:51.449922 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:51.449924 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:51.451272 (+ 1348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:51.451273 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:51.452200 (+ 927us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:51.452203 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:51.453169 (+ 966us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:51.453170 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:51.453256 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:51.453275 (+ 19us) client_negotiation.cc:769] Sending connection context
0811 05:11:51.453346 (+ 71us) client_negotiation.cc:240] Negotiation successful
0811 05:11:51.453751 (+ 405us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":626,"mutex_wait_us":4,"thread_start_us":60,"threads_started":1}
I20260811 05:11:51.455009 25165 tablet_service.cc:1467] Processing CreateTablet for tablet 9e0cfd6bc8024d10831e4892cd0de587 (DEFAULT_TABLE table=test-table [id=47aedb117a11480f80bc2c459b371d97]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:11:51.455168 25602 tablet_service.cc:1467] Processing CreateTablet for tablet 9e0cfd6bc8024d10831e4892cd0de587 (DEFAULT_TABLE table=test-table [id=47aedb117a11480f80bc2c459b371d97]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:11:51.455168 25387 tablet_service.cc:1467] Processing CreateTablet for tablet 9e0cfd6bc8024d10831e4892cd0de587 (DEFAULT_TABLE table=test-table [id=47aedb117a11480f80bc2c459b371d97]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:11:51.455488 25165 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9e0cfd6bc8024d10831e4892cd0de587. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:11:51.455523 25387 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9e0cfd6bc8024d10831e4892cd0de587. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:11:51.455523 25602 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9e0cfd6bc8024d10831e4892cd0de587. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:11:51.458398 25722 tablet_bootstrap.cc:492] T 9e0cfd6bc8024d10831e4892cd0de587 P 13d92edff82c4fafb0fbccf5dd963b56: Bootstrap starting.
I20260811 05:11:51.458971 25723 tablet_bootstrap.cc:492] T 9e0cfd6bc8024d10831e4892cd0de587 P 172d28c3c3c74db9ade0f3bd86dd9b0f: Bootstrap starting.
I20260811 05:11:51.459259 25722 tablet_bootstrap.cc:654] T 9e0cfd6bc8024d10831e4892cd0de587 P 13d92edff82c4fafb0fbccf5dd963b56: Neither blocks nor log segments found. Creating new log.
I20260811 05:11:51.459345 25725 tablet_bootstrap.cc:492] T 9e0cfd6bc8024d10831e4892cd0de587 P 2142c6b9560b4293958900b545d1dc8e: Bootstrap starting.
I20260811 05:11:51.459697 25723 tablet_bootstrap.cc:654] T 9e0cfd6bc8024d10831e4892cd0de587 P 172d28c3c3c74db9ade0f3bd86dd9b0f: Neither blocks nor log segments found. Creating new log.
I20260811 05:11:51.459960 25725 tablet_bootstrap.cc:654] T 9e0cfd6bc8024d10831e4892cd0de587 P 2142c6b9560b4293958900b545d1dc8e: Neither blocks nor log segments found. Creating new log.
I20260811 05:11:51.459934 25722 log.cc:824] T 9e0cfd6bc8024d10831e4892cd0de587 P 13d92edff82c4fafb0fbccf5dd963b56: Log is configured to *not* fsync() on all Append() calls
I20260811 05:11:51.460023 25723 log.cc:824] T 9e0cfd6bc8024d10831e4892cd0de587 P 172d28c3c3c74db9ade0f3bd86dd9b0f: Log is configured to *not* fsync() on all Append() calls
I20260811 05:11:51.460325 25725 log.cc:824] T 9e0cfd6bc8024d10831e4892cd0de587 P 2142c6b9560b4293958900b545d1dc8e: Log is configured to *not* fsync() on all Append() calls
I20260811 05:11:51.460906 25722 tablet_bootstrap.cc:492] T 9e0cfd6bc8024d10831e4892cd0de587 P 13d92edff82c4fafb0fbccf5dd963b56: No bootstrap required, opened a new log
I20260811 05:11:51.460986 25722 ts_tablet_manager.cc:1397] T 9e0cfd6bc8024d10831e4892cd0de587 P 13d92edff82c4fafb0fbccf5dd963b56: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 05:11:51.461177 25725 tablet_bootstrap.cc:492] T 9e0cfd6bc8024d10831e4892cd0de587 P 2142c6b9560b4293958900b545d1dc8e: No bootstrap required, opened a new log
I20260811 05:11:51.461206 25723 tablet_bootstrap.cc:492] T 9e0cfd6bc8024d10831e4892cd0de587 P 172d28c3c3c74db9ade0f3bd86dd9b0f: No bootstrap required, opened a new log
I20260811 05:11:51.461243 25725 ts_tablet_manager.cc:1397] T 9e0cfd6bc8024d10831e4892cd0de587 P 2142c6b9560b4293958900b545d1dc8e: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 05:11:51.461301 25723 ts_tablet_manager.cc:1397] T 9e0cfd6bc8024d10831e4892cd0de587 P 172d28c3c3c74db9ade0f3bd86dd9b0f: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 05:11:51.463091 25723 raft_consensus.cc:348] T 9e0cfd6bc8024d10831e4892cd0de587 P 172d28c3c3c74db9ade0f3bd86dd9b0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d92edff82c4fafb0fbccf5dd963b56" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 41341 } } peers { permanent_uuid: "2142c6b9560b4293958900b545d1dc8e" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 42001 } } peers { permanent_uuid: "172d28c3c3c74db9ade0f3bd86dd9b0f" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 42951 } }
I20260811 05:11:51.463266 25723 raft_consensus.cc:374] T 9e0cfd6bc8024d10831e4892cd0de587 P 172d28c3c3c74db9ade0f3bd86dd9b0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:11:51.463315 25723 raft_consensus.cc:729] T 9e0cfd6bc8024d10831e4892cd0de587 P 172d28c3c3c74db9ade0f3bd86dd9b0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 172d28c3c3c74db9ade0f3bd86dd9b0f, State: Initialized, Role: FOLLOWER
I20260811 05:11:51.463455 25723 consensus_queue.cc:260] T 9e0cfd6bc8024d10831e4892cd0de587 P 172d28c3c3c74db9ade0f3bd86dd9b0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d92edff82c4fafb0fbccf5dd963b56" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 41341 } } peers { permanent_uuid: "2142c6b9560b4293958900b545d1dc8e" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 42001 } } peers { permanent_uuid: "172d28c3c3c74db9ade0f3bd86dd9b0f" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 42951 } }
I20260811 05:11:51.463768 25723 ts_tablet_manager.cc:1428] T 9e0cfd6bc8024d10831e4892cd0de587 P 172d28c3c3c74db9ade0f3bd86dd9b0f: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 05:11:51.463790 25488 heartbeater.cc:503] Master 127.26.191.254:44953 was elected leader, sending a full tablet report...
I20260811 05:11:51.463785 25725 raft_consensus.cc:348] T 9e0cfd6bc8024d10831e4892cd0de587 P 2142c6b9560b4293958900b545d1dc8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d92edff82c4fafb0fbccf5dd963b56" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 41341 } } peers { permanent_uuid: "2142c6b9560b4293958900b545d1dc8e" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 42001 } } peers { permanent_uuid: "172d28c3c3c74db9ade0f3bd86dd9b0f" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 42951 } }
I20260811 05:11:51.463721 25722 raft_consensus.cc:348] T 9e0cfd6bc8024d10831e4892cd0de587 P 13d92edff82c4fafb0fbccf5dd963b56 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d92edff82c4fafb0fbccf5dd963b56" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 41341 } } peers { permanent_uuid: "2142c6b9560b4293958900b545d1dc8e" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 42001 } } peers { permanent_uuid: "172d28c3c3c74db9ade0f3bd86dd9b0f" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 42951 } }
I20260811 05:11:51.463912 25725 raft_consensus.cc:374] T 9e0cfd6bc8024d10831e4892cd0de587 P 2142c6b9560b4293958900b545d1dc8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:11:51.463922 25722 raft_consensus.cc:374] T 9e0cfd6bc8024d10831e4892cd0de587 P 13d92edff82c4fafb0fbccf5dd963b56 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:11:51.463953 25725 raft_consensus.cc:729] T 9e0cfd6bc8024d10831e4892cd0de587 P 2142c6b9560b4293958900b545d1dc8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2142c6b9560b4293958900b545d1dc8e, State: Initialized, Role: FOLLOWER
I20260811 05:11:51.463963 25722 raft_consensus.cc:729] T 9e0cfd6bc8024d10831e4892cd0de587 P 13d92edff82c4fafb0fbccf5dd963b56 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13d92edff82c4fafb0fbccf5dd963b56, State: Initialized, Role: FOLLOWER
I20260811 05:11:51.464073 25722 consensus_queue.cc:260] T 9e0cfd6bc8024d10831e4892cd0de587 P 13d92edff82c4fafb0fbccf5dd963b56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d92edff82c4fafb0fbccf5dd963b56" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 41341 } } peers { permanent_uuid: "2142c6b9560b4293958900b545d1dc8e" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 42001 } } peers { permanent_uuid: "172d28c3c3c74db9ade0f3bd86dd9b0f" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 42951 } }
I20260811 05:11:51.464351 25722 ts_tablet_manager.cc:1428] T 9e0cfd6bc8024d10831e4892cd0de587 P 13d92edff82c4fafb0fbccf5dd963b56: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260811 05:11:51.464326 25725 consensus_queue.cc:260] T 9e0cfd6bc8024d10831e4892cd0de587 P 2142c6b9560b4293958900b545d1dc8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d92edff82c4fafb0fbccf5dd963b56" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 41341 } } peers { permanent_uuid: "2142c6b9560b4293958900b545d1dc8e" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 42001 } } peers { permanent_uuid: "172d28c3c3c74db9ade0f3bd86dd9b0f" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 42951 } }
I20260811 05:11:51.464469 25273 heartbeater.cc:503] Master 127.26.191.254:44953 was elected leader, sending a full tablet report...
I20260811 05:11:51.464633 25725 ts_tablet_manager.cc:1428] T 9e0cfd6bc8024d10831e4892cd0de587 P 2142c6b9560b4293958900b545d1dc8e: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 05:11:51.464767 25699 heartbeater.cc:503] Master 127.26.191.254:44953 was elected leader, sending a full tablet report...
I20260811 05:11:51.521761 25735 raft_consensus.cc:482] T 9e0cfd6bc8024d10831e4892cd0de587 P 2142c6b9560b4293958900b545d1dc8e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 05:11:51.521974 25735 raft_consensus.cc:504] T 9e0cfd6bc8024d10831e4892cd0de587 P 2142c6b9560b4293958900b545d1dc8e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d92edff82c4fafb0fbccf5dd963b56" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 41341 } } peers { permanent_uuid: "2142c6b9560b4293958900b545d1dc8e" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 42001 } } peers { permanent_uuid: "172d28c3c3c74db9ade0f3bd86dd9b0f" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 42951 } }
I20260811 05:11:51.522445 25735 leader_election.cc:288] T 9e0cfd6bc8024d10831e4892cd0de587 P 2142c6b9560b4293958900b545d1dc8e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13d92edff82c4fafb0fbccf5dd963b56 (127.26.191.193:41341), 172d28c3c3c74db9ade0f3bd86dd9b0f (127.26.191.194:42951)
I20260811 05:11:51.526640 25704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:51.522616 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.193:41341 (local address 127.26.191.195:41535)
0811 05:11:51.522678 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:51.522690 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 05:11:51.522735 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:11:51.522915 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:11:51.522915 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:11:51.522918 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:11:51.522999 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:51.523001 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:51.524077 (+ 1076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:51.524079 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:51.525483 (+ 1404us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:51.525486 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:51.526352 (+ 866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:51.526353 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:51.526440 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:51.526444 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 05:11:51.526494 (+ 50us) client_negotiation.cc:240] Negotiation successful
0811 05:11:51.526548 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43,"mutex_wait_us":56}
I20260811 05:11:51.526640 25720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:51.522687 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.195:41535 (local address 127.26.191.193:41341)
0811 05:11:51.522746 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 05:11:51.522748 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:11:51.522762 (+ 14us) server_negotiation.cc:407] Connection header received
0811 05:11:51.522799 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:11:51.522800 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:11:51.522812 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:11:51.522891 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:11:51.523090 (+ 199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:51.523931 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:51.525611 (+ 1680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:51.526194 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:51.526280 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:51.526290 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 05:11:51.526525 (+ 235us) server_negotiation.cc:299] Negotiation successful
0811 05:11:51.526572 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 05:11:51.526727 25719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:51.522719 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.195:57101 (local address 127.26.191.194:42951)
0811 05:11:51.522789 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0811 05:11:51.522790 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 05:11:51.523000 (+ 210us) server_negotiation.cc:407] Connection header received
0811 05:11:51.523030 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:11:51.523031 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:11:51.523064 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:11:51.523119 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:11:51.523287 (+ 168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:51.523987 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:51.525611 (+ 1624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:51.526202 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:51.526280 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:51.526290 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 05:11:51.526613 (+ 323us) server_negotiation.cc:299] Negotiation successful
0811 05:11:51.526666 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 05:11:51.526656 25737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:51.522675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.194:42951 (local address 127.26.191.195:57101)
0811 05:11:51.522901 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:51.522911 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 05:11:51.522964 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:11:51.523138 (+ 174us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:11:51.523139 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:11:51.523141 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:11:51.523190 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:51.523191 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:51.524077 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:51.524079 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:51.525483 (+ 1404us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:51.525486 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:51.526313 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:51.526315 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:51.526412 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:51.526417 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 05:11:51.526494 (+ 77us) client_negotiation.cc:240] Negotiation successful
0811 05:11:51.526538 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":200,"mutex_wait_us":48,"thread_start_us":136,"threads_started":1}
I20260811 05:11:51.527300 25195 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e0cfd6bc8024d10831e4892cd0de587" candidate_uuid: "2142c6b9560b4293958900b545d1dc8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d92edff82c4fafb0fbccf5dd963b56" is_pre_election: true
I20260811 05:11:51.527359 25417 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e0cfd6bc8024d10831e4892cd0de587" candidate_uuid: "2142c6b9560b4293958900b545d1dc8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "172d28c3c3c74db9ade0f3bd86dd9b0f" is_pre_election: true
I20260811 05:11:51.527495 25417 raft_consensus.cc:2454] T 9e0cfd6bc8024d10831e4892cd0de587 P 172d28c3c3c74db9ade0f3bd86dd9b0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2142c6b9560b4293958900b545d1dc8e in term 0.
I20260811 05:11:51.527495 25195 raft_consensus.cc:2454] T 9e0cfd6bc8024d10831e4892cd0de587 P 13d92edff82c4fafb0fbccf5dd963b56 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2142c6b9560b4293958900b545d1dc8e in term 0.
I20260811 05:11:51.527756 25528 leader_election.cc:302] T 9e0cfd6bc8024d10831e4892cd0de587 P 2142c6b9560b4293958900b545d1dc8e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13d92edff82c4fafb0fbccf5dd963b56, 2142c6b9560b4293958900b545d1dc8e; no voters:
I20260811 05:11:51.527915 25735 raft_consensus.cc:2781] T 9e0cfd6bc8024d10831e4892cd0de587 P 2142c6b9560b4293958900b545d1dc8e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 05:11:51.527979 25735 raft_consensus.cc:482] T 9e0cfd6bc8024d10831e4892cd0de587 P 2142c6b9560b4293958900b545d1dc8e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 05:11:51.528009 25735 raft_consensus.cc:3037] T 9e0cfd6bc8024d10831e4892cd0de587 P 2142c6b9560b4293958900b545d1dc8e [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:11:51.528869 25735 raft_consensus.cc:504] T 9e0cfd6bc8024d10831e4892cd0de587 P 2142c6b9560b4293958900b545d1dc8e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d92edff82c4fafb0fbccf5dd963b56" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 41341 } } peers { permanent_uuid: "2142c6b9560b4293958900b545d1dc8e" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 42001 } } peers { permanent_uuid: "172d28c3c3c74db9ade0f3bd86dd9b0f" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 42951 } }
I20260811 05:11:51.529031 25735 leader_election.cc:288] T 9e0cfd6bc8024d10831e4892cd0de587 P 2142c6b9560b4293958900b545d1dc8e [CANDIDATE]: Term 1 election: Requested vote from peers 13d92edff82c4fafb0fbccf5dd963b56 (127.26.191.193:41341), 172d28c3c3c74db9ade0f3bd86dd9b0f (127.26.191.194:42951)
I20260811 05:11:51.529264 25195 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e0cfd6bc8024d10831e4892cd0de587" candidate_uuid: "2142c6b9560b4293958900b545d1dc8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d92edff82c4fafb0fbccf5dd963b56"
I20260811 05:11:51.529325 25417 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e0cfd6bc8024d10831e4892cd0de587" candidate_uuid: "2142c6b9560b4293958900b545d1dc8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "172d28c3c3c74db9ade0f3bd86dd9b0f"
I20260811 05:11:51.529381 25195 raft_consensus.cc:3037] T 9e0cfd6bc8024d10831e4892cd0de587 P 13d92edff82c4fafb0fbccf5dd963b56 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:11:51.529443 25417 raft_consensus.cc:3037] T 9e0cfd6bc8024d10831e4892cd0de587 P 172d28c3c3c74db9ade0f3bd86dd9b0f [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:11:51.530154 25195 raft_consensus.cc:2454] T 9e0cfd6bc8024d10831e4892cd0de587 P 13d92edff82c4fafb0fbccf5dd963b56 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2142c6b9560b4293958900b545d1dc8e in term 1.
I20260811 05:11:51.530267 25417 raft_consensus.cc:2454] T 9e0cfd6bc8024d10831e4892cd0de587 P 172d28c3c3c74db9ade0f3bd86dd9b0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2142c6b9560b4293958900b545d1dc8e in term 1.
I20260811 05:11:51.530350 25528 leader_election.cc:302] T 9e0cfd6bc8024d10831e4892cd0de587 P 2142c6b9560b4293958900b545d1dc8e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13d92edff82c4fafb0fbccf5dd963b56, 2142c6b9560b4293958900b545d1dc8e; no voters:
I20260811 05:11:51.530440 25735 raft_consensus.cc:2781] T 9e0cfd6bc8024d10831e4892cd0de587 P 2142c6b9560b4293958900b545d1dc8e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:11:51.530592 25735 raft_consensus.cc:686] T 9e0cfd6bc8024d10831e4892cd0de587 P 2142c6b9560b4293958900b545d1dc8e [term 1 LEADER]: Becoming Leader. State: Replica: 2142c6b9560b4293958900b545d1dc8e, State: Running, Role: LEADER
I20260811 05:11:51.530831 25735 consensus_queue.cc:237] T 9e0cfd6bc8024d10831e4892cd0de587 P 2142c6b9560b4293958900b545d1dc8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d92edff82c4fafb0fbccf5dd963b56" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 41341 } } peers { permanent_uuid: "2142c6b9560b4293958900b545d1dc8e" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 42001 } } peers { permanent_uuid: "172d28c3c3c74db9ade0f3bd86dd9b0f" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 42951 } }
I20260811 05:11:51.531797 24962 catalog_manager.cc:5495] T 9e0cfd6bc8024d10831e4892cd0de587 P 2142c6b9560b4293958900b545d1dc8e reported cstate change: term changed from 0 to 1, leader changed from <none> to 2142c6b9560b4293958900b545d1dc8e (127.26.191.195). New cstate: current_term: 1 leader_uuid: "2142c6b9560b4293958900b545d1dc8e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d92edff82c4fafb0fbccf5dd963b56" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 41341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2142c6b9560b4293958900b545d1dc8e" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 42001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "172d28c3c3c74db9ade0f3bd86dd9b0f" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 42951 } health_report { overall_health: UNKNOWN } } }
W20260811 05:11:51.536872 25490 tablet.cc:2369] T 9e0cfd6bc8024d10831e4892cd0de587 P 172d28c3c3c74db9ade0f3bd86dd9b0f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 05:11:51.551710 25721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:51.548904 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52032 (local address 127.26.191.195:42001)
0811 05:11:51.548970 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0811 05:11:51.548973 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:11:51.549016 (+ 43us) server_negotiation.cc:407] Connection header received
0811 05:11:51.549107 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:11:51.549108 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:11:51.549130 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:11:51.549207 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:11:51.549432 (+ 225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:51.549929 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:51.550776 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:51.551063 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:51.551125 (+ 62us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:51.551386 (+ 261us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:11:51.551485 (+ 99us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:11:51.551566 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 05:11:51.551615 (+ 49us) server_negotiation.cc:299] Negotiation successful
0811 05:11:51.551623 (+ 8us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 05:11:51.554003 25417 raft_consensus.cc:1261] T 9e0cfd6bc8024d10831e4892cd0de587 P 172d28c3c3c74db9ade0f3bd86dd9b0f [term 1 FOLLOWER]: Refusing update from remote peer 2142c6b9560b4293958900b545d1dc8e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:11:51.554041 25195 raft_consensus.cc:1261] T 9e0cfd6bc8024d10831e4892cd0de587 P 13d92edff82c4fafb0fbccf5dd963b56 [term 1 FOLLOWER]: Refusing update from remote peer 2142c6b9560b4293958900b545d1dc8e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:11:51.554489 25739 consensus_queue.cc:1035] T 9e0cfd6bc8024d10831e4892cd0de587 P 2142c6b9560b4293958900b545d1dc8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "13d92edff82c4fafb0fbccf5dd963b56" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 41341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:11:51.554656 25735 consensus_queue.cc:1035] T 9e0cfd6bc8024d10831e4892cd0de587 P 2142c6b9560b4293958900b545d1dc8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "172d28c3c3c74db9ade0f3bd86dd9b0f" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 42951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:11:51.557921 25747 mvcc.cc:205] Tried to move back new op lower bound from 7317197256921882624 to 7317197256831148032. Current Snapshot: MvccSnapshot[applied={T|T < 7317197256921882624}]
I20260811 05:11:51.558539 25746 mvcc.cc:205] Tried to move back new op lower bound from 7317197256921882624 to 7317197256831148032. Current Snapshot: MvccSnapshot[applied={T|T < 7317197256921882624}]
I20260811 05:11:51.560110 24963 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59216:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:11:51.560233 24963 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59216:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:11:51.561163 24963 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 007faa2c9a93471e8275c1d2f04fb525: Sending DeleteTablet for 3 replicas of tablet 9e0cfd6bc8024d10831e4892cd0de587
I20260811 05:11:51.561553 25387 tablet_service.cc:1514] Processing DeleteTablet for tablet 9e0cfd6bc8024d10831e4892cd0de587 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:11:51 UTC) from {username='slave'} at 127.0.0.1:57744
I20260811 05:11:51.561582 25602 tablet_service.cc:1514] Processing DeleteTablet for tablet 9e0cfd6bc8024d10831e4892cd0de587 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:11:51 UTC) from {username='slave'} at 127.0.0.1:52016
I20260811 05:11:51.561599 25165 tablet_service.cc:1514] Processing DeleteTablet for tablet 9e0cfd6bc8024d10831e4892cd0de587 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:11:51 UTC) from {username='slave'} at 127.0.0.1:35514
I20260811 05:11:51.561820 25757 tablet_replica.cc:330] T 9e0cfd6bc8024d10831e4892cd0de587 P 172d28c3c3c74db9ade0f3bd86dd9b0f: stopping tablet replica
I20260811 05:11:51.561932 25757 raft_consensus.cc:2229] T 9e0cfd6bc8024d10831e4892cd0de587 P 172d28c3c3c74db9ade0f3bd86dd9b0f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 05:11:51.562060 25757 raft_consensus.cc:2258] T 9e0cfd6bc8024d10831e4892cd0de587 P 172d28c3c3c74db9ade0f3bd86dd9b0f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:11:51.562166 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 25059
I20260811 05:11:51.565369 25757 ts_tablet_manager.cc:1905] T 9e0cfd6bc8024d10831e4892cd0de587 P 172d28c3c3c74db9ade0f3bd86dd9b0f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:11:51.567201 25757 ts_tablet_manager.cc:1918] T 9e0cfd6bc8024d10831e4892cd0de587 P 172d28c3c3c74db9ade0f3bd86dd9b0f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 05:11:51.567299 25757 log.cc:1196] T 9e0cfd6bc8024d10831e4892cd0de587 P 172d28c3c3c74db9ade0f3bd86dd9b0f: Deleting WAL directory at /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424853995437-27391-0/minicluster-data/ts-1/wal/wals/9e0cfd6bc8024d10831e4892cd0de587
I20260811 05:11:51.567538 25757 ts_tablet_manager.cc:1939] T 9e0cfd6bc8024d10831e4892cd0de587 P 172d28c3c3c74db9ade0f3bd86dd9b0f: Deleting consensus metadata
I20260811 05:11:51.569933 24936 catalog_manager.cc:4841] TS 172d28c3c3c74db9ade0f3bd86dd9b0f (127.26.191.194:42951): tablet 9e0cfd6bc8024d10831e4892cd0de587 (table test-table [id=47aedb117a11480f80bc2c459b371d97]) successfully deleted
I20260811 05:11:51.573457 25758 tablet_replica.cc:330] T 9e0cfd6bc8024d10831e4892cd0de587 P 2142c6b9560b4293958900b545d1dc8e: stopping tablet replica
I20260811 05:11:51.573611 25758 raft_consensus.cc:2229] T 9e0cfd6bc8024d10831e4892cd0de587 P 2142c6b9560b4293958900b545d1dc8e [term 1 LEADER]: Raft consensus shutting down.
I20260811 05:11:51.573736 25758 raft_consensus.cc:2258] T 9e0cfd6bc8024d10831e4892cd0de587 P 2142c6b9560b4293958900b545d1dc8e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:11:51.574196 25758 ts_tablet_manager.cc:1905] T 9e0cfd6bc8024d10831e4892cd0de587 P 2142c6b9560b4293958900b545d1dc8e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:11:51.575546 25758 ts_tablet_manager.cc:1918] T 9e0cfd6bc8024d10831e4892cd0de587 P 2142c6b9560b4293958900b545d1dc8e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 05:11:51.575645 25758 log.cc:1196] T 9e0cfd6bc8024d10831e4892cd0de587 P 2142c6b9560b4293958900b545d1dc8e: Deleting WAL directory at /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424853995437-27391-0/minicluster-data/ts-2/wal/wals/9e0cfd6bc8024d10831e4892cd0de587
I20260811 05:11:51.575896 25758 ts_tablet_manager.cc:1939] T 9e0cfd6bc8024d10831e4892cd0de587 P 2142c6b9560b4293958900b545d1dc8e: Deleting consensus metadata
I20260811 05:11:51.576362 24942 catalog_manager.cc:4841] TS 2142c6b9560b4293958900b545d1dc8e (127.26.191.195:42001): tablet 9e0cfd6bc8024d10831e4892cd0de587 (table test-table [id=47aedb117a11480f80bc2c459b371d97]) successfully deleted
W20260811 05:11:51.580120 24939 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.191.193:41341 (error 108)
I20260811 05:11:51.580714 25718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:51.580556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.193:41341 (local address 127.0.0.1:35522)
0811 05:11:51.580619 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:51.580670 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.193:41341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260811 05:11:51.580782 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 25277
W20260811 05:11:51.604318 24939 catalog_manager.cc:4584] TS 13d92edff82c4fafb0fbccf5dd963b56 (127.26.191.193:41341): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 9e0cfd6bc8024d10831e4892cd0de587: Network error: Client connection negotiation failed: client connection to 127.26.191.193:41341: connect: Connection refused (error 111)
I20260811 05:11:51.608696 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 25492
I20260811 05:11:51.619457 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 24911
2026-08-11T05:11:51Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (830 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424853995437-27391-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 05:11:51 dist-test-slave-x5fp krb5kdc[25767](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 05:11:51 dist-test-slave-x5fp krb5kdc[25767](info): set up 2 sockets
Aug 11 05:11:51 dist-test-slave-x5fp krb5kdc[25767](info): commencing operation
krb5kdc: starting...
W20260811 05:11:52.905714 27391 mini_kdc.cc:121] Time spent starting KDC: real 1.258s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424853995437-27391-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424853995437-27391-0/krb5kdc/test-user.keytab.
Aug 11 05:11:52 dist-test-slave-x5fp krb5kdc[25767](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425112, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T05:11:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:11:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.191.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.191.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.191.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab.
Entry for principal kudu/127.26.191.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab.
I20260811 05:11:53.044102 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424853995437-27391-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424853995437-27391-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424853995437-27391-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.254:39921
--webserver_interface=127.26.191.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab
--principal=kudu/127.26.191.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:44641
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.191.254:39921
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:11:53.128768 25789 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:11:53.129002 25789 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:11:53.129038 25789 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:11:53.130173 25789 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:11:53.130244 25789 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:11:53.130276 25789 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:11:53.130319 25789 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:11:53.130347 25789 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:11:53.131800 25789 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:44641
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424853995437-27391-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424853995437-27391-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.191.254:39921
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab
--principal=kudu/127.26.191.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.254:39921
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.191.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25789
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424853995437-27391-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:11:53.132066 25789 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:11:53.132290 25789 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:11:53.137300 25799 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:11:53.137341 25798 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:11:53.137310 25802 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:11:53.137548 25789 server_base.cc:1034] running on GCE node
I20260811 05:11:53.137856 25789 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:11:53.138154 25789 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:11:53.139335 25789 hybrid_clock.cc:648] HybridClock initialized: now 1786425113139326 us; error 36 us; skew 500 ppm
Aug 11 05:11:53 dist-test-slave-x5fp krb5kdc[25767](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425113, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:11:53.145380 25789 init.cc:377] Logged in from keytab as kudu/127.26.191.254@KRBTEST.COM (short username kudu)
I20260811 05:11:53.145890 25789 webserver.cc:460] Webserver started at http://127.26.191.254:45369/ using document root <none> and password file <none>
I20260811 05:11:53.146118 25789 fs_manager.cc:359] Metadata directory not provided
I20260811 05:11:53.146184 25789 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:11:53.146340 25789 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:11:53.147424 25789 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424853995437-27391-0/minicluster-data/master-0/data/instance:
uuid: "3c39806cfb9a4df1bbb691bccd642fe0"
format_stamp: "Formatted at 2026-08-11 05:11:53 on dist-test-slave-x5fp"
server_key: "841f3815cad78cfef3bb2b1a83255a37"
server_key_iv: "f712b789315ae0afd82dca5afd92ae02"
server_key_version: "encryptionkey@0"
I20260811 05:11:53.147789 25789 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424853995437-27391-0/minicluster-data/master-0/wal/instance:
uuid: "3c39806cfb9a4df1bbb691bccd642fe0"
format_stamp: "Formatted at 2026-08-11 05:11:53 on dist-test-slave-x5fp"
server_key: "841f3815cad78cfef3bb2b1a83255a37"
server_key_iv: "f712b789315ae0afd82dca5afd92ae02"
server_key_version: "encryptionkey@0"
I20260811 05:11:53.149224 25789 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 05:11:53.150053 25812 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:11:53.150245 25789 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 05:11:53.150364 25789 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424853995437-27391-0/minicluster-data/master-0/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424853995437-27391-0/minicluster-data/master-0/wal
uuid: "3c39806cfb9a4df1bbb691bccd642fe0"
format_stamp: "Formatted at 2026-08-11 05:11:53 on dist-test-slave-x5fp"
server_key: "841f3815cad78cfef3bb2b1a83255a37"
server_key_iv: "f712b789315ae0afd82dca5afd92ae02"
server_key_version: "encryptionkey@0"
I20260811 05:11:53.150439 25789 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424853995437-27391-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424853995437-27391-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424853995437-27391-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:11:53.177480 25789 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:11:53.179850 25789 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:11:53.180050 25789 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:11:53.184800 25789 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.254:39921
I20260811 05:11:53.184842 25890 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.254:39921 every 8 connection(s)
I20260811 05:11:53.185272 25789 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
I20260811 05:11:53.186273 25893 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:11:53.188706 25893 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3c39806cfb9a4df1bbb691bccd642fe0: Bootstrap starting.
I20260811 05:11:53.189378 25893 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3c39806cfb9a4df1bbb691bccd642fe0: Neither blocks nor log segments found. Creating new log.
I20260811 05:11:53.189680 25893 log.cc:824] T 00000000000000000000000000000000 P 3c39806cfb9a4df1bbb691bccd642fe0: Log is configured to *not* fsync() on all Append() calls
I20260811 05:11:53.190376 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 25789
I20260811 05:11:53.190514 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424853995437-27391-0/minicluster-data/master-0/wal/instance
I20260811 05:11:53.190577 25893 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3c39806cfb9a4df1bbb691bccd642fe0: No bootstrap required, opened a new log
I20260811 05:11:53.190757 27391 external_mini_cluster.cc:1428] Setting key ae35123fe0fda6d4d9910130a90f701d
I20260811 05:11:53.192587 25893 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3c39806cfb9a4df1bbb691bccd642fe0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c39806cfb9a4df1bbb691bccd642fe0" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 39921 } }
I20260811 05:11:53.192785 25893 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3c39806cfb9a4df1bbb691bccd642fe0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:11:53.192837 25893 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3c39806cfb9a4df1bbb691bccd642fe0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c39806cfb9a4df1bbb691bccd642fe0, State: Initialized, Role: FOLLOWER
I20260811 05:11:53.192970 25893 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3c39806cfb9a4df1bbb691bccd642fe0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c39806cfb9a4df1bbb691bccd642fe0" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 39921 } }
I20260811 05:11:53.193068 25893 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3c39806cfb9a4df1bbb691bccd642fe0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:11:53.193101 25893 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3c39806cfb9a4df1bbb691bccd642fe0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:11:53.193156 25893 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3c39806cfb9a4df1bbb691bccd642fe0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:11:53.194226 25893 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3c39806cfb9a4df1bbb691bccd642fe0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c39806cfb9a4df1bbb691bccd642fe0" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 39921 } }
I20260811 05:11:53.194317 25893 leader_election.cc:302] T 00000000000000000000000000000000 P 3c39806cfb9a4df1bbb691bccd642fe0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3c39806cfb9a4df1bbb691bccd642fe0; no voters:
I20260811 05:11:53.194501 25893 leader_election.cc:288] T 00000000000000000000000000000000 P 3c39806cfb9a4df1bbb691bccd642fe0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 05:11:53.194523 25905 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3c39806cfb9a4df1bbb691bccd642fe0 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:11:53.194646 25905 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3c39806cfb9a4df1bbb691bccd642fe0 [term 1 LEADER]: Becoming Leader. State: Replica: 3c39806cfb9a4df1bbb691bccd642fe0, State: Running, Role: LEADER
I20260811 05:11:53.194818 25893 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3c39806cfb9a4df1bbb691bccd642fe0 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:11:53.194815 25905 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3c39806cfb9a4df1bbb691bccd642fe0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c39806cfb9a4df1bbb691bccd642fe0" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 39921 } }
I20260811 05:11:53.196782 25909 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3c39806cfb9a4df1bbb691bccd642fe0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3c39806cfb9a4df1bbb691bccd642fe0. Latest consensus state: current_term: 1 leader_uuid: "3c39806cfb9a4df1bbb691bccd642fe0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c39806cfb9a4df1bbb691bccd642fe0" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 39921 } } }
I20260811 05:11:53.196915 25909 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3c39806cfb9a4df1bbb691bccd642fe0 [sys.catalog]: This master's current role is: LEADER
I20260811 05:11:53.197151 25908 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3c39806cfb9a4df1bbb691bccd642fe0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3c39806cfb9a4df1bbb691bccd642fe0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c39806cfb9a4df1bbb691bccd642fe0" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 39921 } } }
I20260811 05:11:53.197245 25908 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3c39806cfb9a4df1bbb691bccd642fe0 [sys.catalog]: This master's current role is: LEADER
W20260811 05:11:53.197865 25932 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3c39806cfb9a4df1bbb691bccd642fe0: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 05:11:53.197925 25932 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 05:11:53.198026 25928 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:11:53.198271 25928 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 11 05:11:53 dist-test-slave-x5fp krb5kdc[25767](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425112, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
I20260811 05:11:53.199854 25928 catalog_manager.cc:1347] Generated new cluster ID: 2c876847b06d46568b58a175217194f2
I20260811 05:11:53.199908 25928 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:11:53.202584 25904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:53.191362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40242 (local address 127.26.191.254:39921)
0811 05:11:53.191576 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0811 05:11:53.191586 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 05:11:53.191614 (+ 28us) server_negotiation.cc:407] Connection header received
0811 05:11:53.192576 (+ 962us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:11:53.192584 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:11:53.192643 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:11:53.192922 (+ 279us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:11:53.193751 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:53.194869 (+ 1118us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:53.195694 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:53.196146 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:53.196223 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:53.199213 (+ 2990us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:11:53.199216 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:11:53.199217 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:11:53.199229 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:11:53.201025 (+ 1796us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:11:53.201415 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:11:53.201424 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:11:53.201424 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:11:53.201529 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:11:53.201751 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:11:53.201752 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:11:53.201752 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:11:53.201987 (+ 235us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:11:53.202166 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0811 05:11:53.202233 (+ 67us) server_negotiation.cc:299] Negotiation successful
0811 05:11:53.202375 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":109,"threads_started":1}
I20260811 05:11:53.213265 25928 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:11:53.213827 25928 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:11:53.220175 25928 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3c39806cfb9a4df1bbb691bccd642fe0: Generated new TSK 0
I20260811 05:11:53.220408 25928 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.191.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.191.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.191.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.193.keytab.
Entry for principal kudu/127.26.191.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.193.keytab.
I20260811 05:11:53.259732 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424853995437-27391-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424853995437-27391-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424853995437-27391-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424853995437-27391-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.191.193:0
--local_ip_for_outbound_sockets=127.26.191.193
--webserver_interface=127.26.191.193
--webserver_port=0
--tserver_master_addrs=127.26.191.254:39921
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.193.keytab
--principal=kudu/127.26.191.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:44641
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:11:53.346994 25938 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:11:53.347240 25938 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:11:53.347283 25938 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:11:53.348423 25938 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:11:53.348482 25938 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:11:53.348526 25938 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.191.193
I20260811 05:11:53.350031 25938 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:44641
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424853995437-27391-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424853995437-27391-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.193.keytab
--principal=kudu/127.26.191.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.191.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424853995437-27391-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.191.193
--webserver_port=0
--tserver_master_addrs=127.26.191.254:39921
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25938
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.191.193
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424853995437-27391-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:11:53.350301 25938 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:11:53.350533 25938 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:11:53.356032 25950 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:11:53.356077 25945 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:11:53.356184 25946 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:11:53.356050 25938 server_base.cc:1034] running on GCE node
I20260811 05:11:53.356482 25938 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:11:53.356743 25938 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:11:53.357930 25938 hybrid_clock.cc:648] HybridClock initialized: now 1786425113357899 us; error 47 us; skew 500 ppm
Aug 11 05:11:53 dist-test-slave-x5fp krb5kdc[25767](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425113, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:11:53.360852 25938 init.cc:377] Logged in from keytab as kudu/127.26.191.193@KRBTEST.COM (short username kudu)
I20260811 05:11:53.361312 25938 webserver.cc:460] Webserver started at http://127.26.191.193:39281/ using document root <none> and password file <none>
I20260811 05:11:53.361552 25938 fs_manager.cc:359] Metadata directory not provided
I20260811 05:11:53.361620 25938 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:11:53.361769 25938 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:11:53.362865 25938 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424853995437-27391-0/minicluster-data/ts-0/data/instance:
uuid: "1ebcd0e45067475d9ff9bac8c68b1a0d"
format_stamp: "Formatted at 2026-08-11 05:11:53 on dist-test-slave-x5fp"
server_key: "0c3b780dcf809ac56de0e57da7ad0d5f"
server_key_iv: "f87c8b87bfe1a19bc310caa666c0e12b"
server_key_version: "encryptionkey@0"
I20260811 05:11:53.363240 25938 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424853995437-27391-0/minicluster-data/ts-0/wal/instance:
uuid: "1ebcd0e45067475d9ff9bac8c68b1a0d"
format_stamp: "Formatted at 2026-08-11 05:11:53 on dist-test-slave-x5fp"
server_key: "0c3b780dcf809ac56de0e57da7ad0d5f"
server_key_iv: "f87c8b87bfe1a19bc310caa666c0e12b"
server_key_version: "encryptionkey@0"
I20260811 05:11:53.364615 25938 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 05:11:53.365410 25959 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:11:53.365579 25938 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 05:11:53.365689 25938 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424853995437-27391-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424853995437-27391-0/minicluster-data/ts-0/wal
uuid: "1ebcd0e45067475d9ff9bac8c68b1a0d"
format_stamp: "Formatted at 2026-08-11 05:11:53 on dist-test-slave-x5fp"
server_key: "0c3b780dcf809ac56de0e57da7ad0d5f"
server_key_iv: "f87c8b87bfe1a19bc310caa666c0e12b"
server_key_version: "encryptionkey@0"
I20260811 05:11:53.365764 25938 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424853995437-27391-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424853995437-27391-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424853995437-27391-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:11:53.383249 25938 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:11:53.385392 25938 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:11:53.385563 25938 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:11:53.385814 25938 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:11:53.386139 25938 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:11:53.386200 25938 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:11:53.386250 25938 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:11:53.386294 25938 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:11:53.392518 25938 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.193:39493
I20260811 05:11:53.392658 26146 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.193:39493 every 8 connection(s)
I20260811 05:11:53.392989 25938 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424853995437-27391-0/minicluster-data/ts-0/data/info.pb
I20260811 05:11:53.396555 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 25938
I20260811 05:11:53.396695 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424853995437-27391-0/minicluster-data/ts-0/wal/instance
I20260811 05:11:53.396945 27391 external_mini_cluster.cc:1428] Setting key 26115227e5aab0ef47cacf578d872775
Aug 11 05:11:53 dist-test-slave-x5fp krb5kdc[25767](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425113, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.193@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
I20260811 05:11:53.405234 25904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:53.394010 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.193:43083 (local address 127.26.191.254:39921)
0811 05:11:53.394105 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0811 05:11:53.394108 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:11:53.394270 (+ 162us) server_negotiation.cc:407] Connection header received
0811 05:11:53.394992 (+ 722us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:11:53.394994 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:11:53.395005 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:11:53.395045 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:11:53.396397 (+ 1352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:53.397218 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:53.398739 (+ 1521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:53.398950 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:53.399013 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:53.401615 (+ 2602us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:11:53.401617 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:11:53.401617 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:11:53.401626 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:11:53.403493 (+ 1867us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:11:53.403953 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:11:53.403955 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:11:53.403956 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:11:53.404028 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:11:53.404285 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:11:53.404286 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:11:53.404286 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:11:53.404484 (+ 198us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:11:53.404564 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 05:11:53.404965 (+ 401us) server_negotiation.cc:299] Negotiation successful
0811 05:11:53.405071 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 05:11:53.405295 26149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:53.393844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:39921 (local address 127.26.191.193:43083)
0811 05:11:53.394119 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:53.394169 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 05:11:53.394875 (+ 706us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:11:53.395117 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:11:53.395121 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:11:53.396023 (+ 902us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:11:53.396253 (+ 230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:53.396261 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:53.397350 (+ 1089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:53.397351 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:53.398596 (+ 1245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:53.398599 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:53.399040 (+ 441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:53.399042 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:53.399204 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:53.399798 (+ 594us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:11:53.399808 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:11:53.401514 (+ 1706us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:11:53.403587 (+ 2073us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:11:53.403594 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:11:53.403596 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:11:53.403870 (+ 274us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:11:53.404105 (+ 235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:11:53.404105 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:11:53.404106 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:11:53.404215 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:11:53.404586 (+ 371us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:11:53.404596 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:11:53.404800 (+ 204us) client_negotiation.cc:769] Sending connection context
0811 05:11:53.404920 (+ 120us) client_negotiation.cc:240] Negotiation successful
0811 05:11:53.405072 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":227,"thread_start_us":184,"threads_started":1}
I20260811 05:11:53.406044 26147 heartbeater.cc:347] Connected to a master server at 127.26.191.254:39921
I20260811 05:11:53.406167 26147 heartbeater.cc:464] Registering TS with master...
I20260811 05:11:53.406402 26147 heartbeater.cc:511] Master 127.26.191.254:39921 requested a full tablet report, sending...
I20260811 05:11:53.407045 25842 ts_manager.cc:194] Registered new tserver with Master: 1ebcd0e45067475d9ff9bac8c68b1a0d (127.26.191.193:39493)
WARNING: no policy specified for kudu/127.26.191.194@KRBTEST.COM; defaulting to no policy
I20260811 05:11:53.408042 25842 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.191.193@KRBTEST.COM'} at 127.26.191.193:43083
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.191.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.191.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.194.keytab.
Entry for principal kudu/127.26.191.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.194.keytab.
I20260811 05:11:53.428241 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424853995437-27391-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424853995437-27391-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424853995437-27391-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424853995437-27391-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.191.194:0
--local_ip_for_outbound_sockets=127.26.191.194
--webserver_interface=127.26.191.194
--webserver_port=0
--tserver_master_addrs=127.26.191.254:39921
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.194.keytab
--principal=kudu/127.26.191.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:44641
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:11:53.514448 26153 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:11:53.514705 26153 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:11:53.514756 26153 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:11:53.516007 26153 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:11:53.516081 26153 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:11:53.516125 26153 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.191.194
I20260811 05:11:53.517693 26153 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:44641
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424853995437-27391-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424853995437-27391-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.194.keytab
--principal=kudu/127.26.191.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.191.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424853995437-27391-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.191.194
--webserver_port=0
--tserver_master_addrs=127.26.191.254:39921
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26153
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.191.194
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424853995437-27391-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:11:53.517994 26153 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:11:53.518234 26153 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:11:53.524128 26165 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:11:53.524120 26168 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:11:53.524204 26164 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:11:53.524147 26153 server_base.cc:1034] running on GCE node
I20260811 05:11:53.524545 26153 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:11:53.524847 26153 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:11:53.526006 26153 hybrid_clock.cc:648] HybridClock initialized: now 1786425113525990 us; error 30 us; skew 500 ppm
Aug 11 05:11:53 dist-test-slave-x5fp krb5kdc[25767](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425113, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:11:53.528944 26153 init.cc:377] Logged in from keytab as kudu/127.26.191.194@KRBTEST.COM (short username kudu)
I20260811 05:11:53.529479 26153 webserver.cc:460] Webserver started at http://127.26.191.194:45611/ using document root <none> and password file <none>
I20260811 05:11:53.529757 26153 fs_manager.cc:359] Metadata directory not provided
I20260811 05:11:53.529835 26153 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:11:53.530005 26153 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:11:53.531221 26153 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424853995437-27391-0/minicluster-data/ts-1/data/instance:
uuid: "6b8c5fc09d4d4271a7834c62fe2fe3b6"
format_stamp: "Formatted at 2026-08-11 05:11:53 on dist-test-slave-x5fp"
server_key: "5c6441f46ce8988d8f7f2f7e8426aae3"
server_key_iv: "145ce9fb9ad47271c60a5c35e0a7b79c"
server_key_version: "encryptionkey@0"
I20260811 05:11:53.531647 26153 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424853995437-27391-0/minicluster-data/ts-1/wal/instance:
uuid: "6b8c5fc09d4d4271a7834c62fe2fe3b6"
format_stamp: "Formatted at 2026-08-11 05:11:53 on dist-test-slave-x5fp"
server_key: "5c6441f46ce8988d8f7f2f7e8426aae3"
server_key_iv: "145ce9fb9ad47271c60a5c35e0a7b79c"
server_key_version: "encryptionkey@0"
I20260811 05:11:53.533186 26153 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 05:11:53.534063 26179 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:11:53.534235 26153 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:11:53.534343 26153 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424853995437-27391-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424853995437-27391-0/minicluster-data/ts-1/wal
uuid: "6b8c5fc09d4d4271a7834c62fe2fe3b6"
format_stamp: "Formatted at 2026-08-11 05:11:53 on dist-test-slave-x5fp"
server_key: "5c6441f46ce8988d8f7f2f7e8426aae3"
server_key_iv: "145ce9fb9ad47271c60a5c35e0a7b79c"
server_key_version: "encryptionkey@0"
I20260811 05:11:53.534427 26153 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424853995437-27391-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424853995437-27391-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424853995437-27391-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:11:53.558108 26153 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:11:53.560354 26153 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:11:53.560500 26153 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:11:53.560789 26153 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:11:53.561128 26153 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:11:53.561164 26153 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:11:53.561187 26153 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:11:53.561240 26153 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:11:53.567847 26153 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.194:40875
I20260811 05:11:53.567936 26356 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.194:40875 every 8 connection(s)
I20260811 05:11:53.568265 26153 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424853995437-27391-0/minicluster-data/ts-1/data/info.pb
I20260811 05:11:53.574910 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 26153
I20260811 05:11:53.575067 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424853995437-27391-0/minicluster-data/ts-1/wal/instance
I20260811 05:11:53.575260 27391 external_mini_cluster.cc:1428] Setting key 764e6bde46c2b2a7a5550554ae0c80c9
Aug 11 05:11:53 dist-test-slave-x5fp krb5kdc[25767](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425113, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.194@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
I20260811 05:11:53.579267 25904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:53.569186 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.194:38625 (local address 127.26.191.254:39921)
0811 05:11:53.569259 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0811 05:11:53.569261 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:11:53.569495 (+ 234us) server_negotiation.cc:407] Connection header received
0811 05:11:53.570143 (+ 648us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:11:53.570145 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:11:53.570160 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:11:53.570219 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:11:53.571346 (+ 1127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:53.571908 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:53.573098 (+ 1190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:53.573328 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:53.573411 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:53.575955 (+ 2544us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:11:53.575957 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:11:53.575957 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:11:53.575966 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:11:53.577602 (+ 1636us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:11:53.578178 (+ 576us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:11:53.578179 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:11:53.578179 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:11:53.578245 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:11:53.578571 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:11:53.578572 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:11:53.578572 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:11:53.578682 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:11:53.578734 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 05:11:53.579107 (+ 373us) server_negotiation.cc:299] Negotiation successful
0811 05:11:53.579189 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 05:11:53.579510 26362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:53.569165 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:39921 (local address 127.26.191.194:38625)
0811 05:11:53.569363 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:53.569404 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 05:11:53.569999 (+ 595us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:11:53.570301 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:11:53.570306 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:11:53.570997 (+ 691us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:11:53.571216 (+ 219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:53.571221 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:53.572012 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:53.572013 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:53.572990 (+ 977us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:53.572993 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:53.573422 (+ 429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:53.573423 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:53.573561 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:53.574242 (+ 681us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:11:53.574250 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:11:53.575851 (+ 1601us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:11:53.577728 (+ 1877us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:11:53.577735 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:11:53.577738 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:11:53.578093 (+ 355us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:11:53.578342 (+ 249us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:11:53.578343 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:11:53.578344 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:11:53.578498 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:11:53.578743 (+ 245us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:11:53.578749 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:11:53.578933 (+ 184us) client_negotiation.cc:769] Sending connection context
0811 05:11:53.579061 (+ 128us) client_negotiation.cc:240] Negotiation successful
0811 05:11:53.579261 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":81,"threads_started":1}
I20260811 05:11:53.580020 26358 heartbeater.cc:347] Connected to a master server at 127.26.191.254:39921
I20260811 05:11:53.580138 26358 heartbeater.cc:464] Registering TS with master...
I20260811 05:11:53.580346 26358 heartbeater.cc:511] Master 127.26.191.254:39921 requested a full tablet report, sending...
I20260811 05:11:53.580817 25842 ts_manager.cc:194] Registered new tserver with Master: 6b8c5fc09d4d4271a7834c62fe2fe3b6 (127.26.191.194:40875)
I20260811 05:11:53.581403 25842 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.191.194@KRBTEST.COM'} at 127.26.191.194:38625
WARNING: no policy specified for kudu/127.26.191.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.191.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.191.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.195.keytab.
Entry for principal kudu/127.26.191.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.195.keytab.
I20260811 05:11:53.605897 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424853995437-27391-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424853995437-27391-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424853995437-27391-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424853995437-27391-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.191.195:0
--local_ip_for_outbound_sockets=127.26.191.195
--webserver_interface=127.26.191.195
--webserver_port=0
--tserver_master_addrs=127.26.191.254:39921
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.195.keytab
--principal=kudu/127.26.191.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:44641
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:11:53.691962 26366 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:11:53.692183 26366 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:11:53.692210 26366 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:11:53.693552 26366 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:11:53.693608 26366 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:11:53.693636 26366 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.191.195
I20260811 05:11:53.695256 26366 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:44641
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424853995437-27391-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424853995437-27391-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.195.keytab
--principal=kudu/127.26.191.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.191.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424853995437-27391-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.191.195
--webserver_port=0
--tserver_master_addrs=127.26.191.254:39921
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26366
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.191.195
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424853995437-27391-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:11:53.695477 26366 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:11:53.695709 26366 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 05:11:53.701503 26366 server_base.cc:1034] running on GCE node
W20260811 05:11:53.701439 26376 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:11:53.701467 26380 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:11:53.701438 26375 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:11:53.702006 26366 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:11:53.702255 26366 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:11:53.703400 26366 hybrid_clock.cc:648] HybridClock initialized: now 1786425113703384 us; error 30 us; skew 500 ppm
Aug 11 05:11:53 dist-test-slave-x5fp krb5kdc[25767](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425113, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:11:53.706357 26366 init.cc:377] Logged in from keytab as kudu/127.26.191.195@KRBTEST.COM (short username kudu)
I20260811 05:11:53.706835 26366 webserver.cc:460] Webserver started at http://127.26.191.195:46351/ using document root <none> and password file <none>
I20260811 05:11:53.707087 26366 fs_manager.cc:359] Metadata directory not provided
I20260811 05:11:53.707162 26366 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:11:53.707334 26366 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:11:53.708513 26366 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424853995437-27391-0/minicluster-data/ts-2/data/instance:
uuid: "fa3ea604b8e8482d8089a00de5a22179"
format_stamp: "Formatted at 2026-08-11 05:11:53 on dist-test-slave-x5fp"
server_key: "70924619eeb34232f27d7244b1f89b94"
server_key_iv: "87230f588c57e3c87e8d1db32faf2bf6"
server_key_version: "encryptionkey@0"
I20260811 05:11:53.708948 26366 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424853995437-27391-0/minicluster-data/ts-2/wal/instance:
uuid: "fa3ea604b8e8482d8089a00de5a22179"
format_stamp: "Formatted at 2026-08-11 05:11:53 on dist-test-slave-x5fp"
server_key: "70924619eeb34232f27d7244b1f89b94"
server_key_iv: "87230f588c57e3c87e8d1db32faf2bf6"
server_key_version: "encryptionkey@0"
I20260811 05:11:53.710431 26366 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 05:11:53.711195 26388 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:11:53.711404 26366 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 05:11:53.711519 26366 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424853995437-27391-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424853995437-27391-0/minicluster-data/ts-2/wal
uuid: "fa3ea604b8e8482d8089a00de5a22179"
format_stamp: "Formatted at 2026-08-11 05:11:53 on dist-test-slave-x5fp"
server_key: "70924619eeb34232f27d7244b1f89b94"
server_key_iv: "87230f588c57e3c87e8d1db32faf2bf6"
server_key_version: "encryptionkey@0"
I20260811 05:11:53.711599 26366 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424853995437-27391-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424853995437-27391-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424853995437-27391-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:11:53.727078 26366 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:11:53.729770 26366 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:11:53.729959 26366 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:11:53.730237 26366 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:11:53.730618 26366 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:11:53.730660 26366 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:11:53.730701 26366 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:11:53.730731 26366 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:11:53.737793 26366 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.195:36659
I20260811 05:11:53.737856 26565 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.195:36659 every 8 connection(s)
I20260811 05:11:53.738303 26366 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424853995437-27391-0/minicluster-data/ts-2/data/info.pb
I20260811 05:11:53.742252 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 26366
I20260811 05:11:53.742372 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424853995437-27391-0/minicluster-data/ts-2/wal/instance
I20260811 05:11:53.742569 27391 external_mini_cluster.cc:1428] Setting key 5ab86c33c4996818d857586e9bd2b1be
Aug 11 05:11:53 dist-test-slave-x5fp krb5kdc[25767](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425113, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.195@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
I20260811 05:11:53.749825 25904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:53.739097 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.195:48021 (local address 127.26.191.254:39921)
0811 05:11:53.739159 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 05:11:53.739161 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:11:53.739393 (+ 232us) server_negotiation.cc:407] Connection header received
0811 05:11:53.740009 (+ 616us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:11:53.740011 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:11:53.740025 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:11:53.740082 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:11:53.741238 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:53.741849 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:53.743501 (+ 1652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:53.743757 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:53.743839 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:53.746566 (+ 2727us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:11:53.746567 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:11:53.746568 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:11:53.746575 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:11:53.748196 (+ 1621us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:11:53.748716 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:11:53.748736 (+ 20us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:11:53.748736 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:11:53.748808 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:11:53.749100 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:11:53.749101 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:11:53.749102 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:11:53.749235 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:11:53.749326 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 05:11:53.749624 (+ 298us) server_negotiation.cc:299] Negotiation successful
0811 05:11:53.749720 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260811 05:11:53.750061 26572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:53.739079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:39921 (local address 127.26.191.195:48021)
0811 05:11:53.739257 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:53.739300 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 05:11:53.739882 (+ 582us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:11:53.740164 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:11:53.740175 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:11:53.740897 (+ 722us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:11:53.741118 (+ 221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:53.741124 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:53.741957 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:53.741958 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:53.743401 (+ 1443us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:53.743404 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:53.743848 (+ 444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:53.743850 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:53.743998 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:53.744593 (+ 595us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:11:53.744602 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:11:53.746440 (+ 1838us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:11:53.748342 (+ 1902us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:11:53.748350 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:11:53.748353 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:11:53.748627 (+ 274us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:11:53.748894 (+ 267us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:11:53.748894 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:11:53.748895 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:11:53.749025 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:11:53.749314 (+ 289us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:11:53.749321 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:11:53.749480 (+ 159us) client_negotiation.cc:769] Sending connection context
0811 05:11:53.749599 (+ 119us) client_negotiation.cc:240] Negotiation successful
0811 05:11:53.749791 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":103,"threads_started":1}
I20260811 05:11:53.750638 26567 heartbeater.cc:347] Connected to a master server at 127.26.191.254:39921
I20260811 05:11:53.750761 26567 heartbeater.cc:464] Registering TS with master...
I20260811 05:11:53.750958 26567 heartbeater.cc:511] Master 127.26.191.254:39921 requested a full tablet report, sending...
I20260811 05:11:53.751430 25842 ts_manager.cc:194] Registered new tserver with Master: fa3ea604b8e8482d8089a00de5a22179 (127.26.191.195:36659)
I20260811 05:11:53.751978 25842 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.191.195@KRBTEST.COM'} at 127.26.191.195:48021
I20260811 05:11:53.754518 27391 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 05:11:53.762543 25904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:53.755913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40254 (local address 127.26.191.254:39921)
0811 05:11:53.755955 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 05:11:53.755957 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:11:53.756090 (+ 133us) server_negotiation.cc:407] Connection header received
0811 05:11:53.756186 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:11:53.756187 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:11:53.756198 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:11:53.756261 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:11:53.756859 (+ 598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:53.757356 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:53.758087 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:53.758305 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:53.758378 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:53.759735 (+ 1357us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:11:53.759737 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:11:53.759737 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:11:53.759745 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:11:53.761310 (+ 1565us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:11:53.761672 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:11:53.761673 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:11:53.761673 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:11:53.761744 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:11:53.761964 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:11:53.761965 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:11:53.761965 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:11:53.762123 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:11:53.762233 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0811 05:11:53.762348 (+ 115us) server_negotiation.cc:299] Negotiation successful
0811 05:11:53.762434 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 05:11:53.764178 25842 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40254:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 05:11:53.766342 25842 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 05:11:53.779163 26592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:53.774498 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58602 (local address 127.26.191.194:40875)
0811 05:11:53.774671 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0811 05:11:53.774677 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 05:11:53.774688 (+ 11us) server_negotiation.cc:407] Connection header received
0811 05:11:53.774741 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:11:53.774743 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:11:53.774762 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:11:53.774846 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:11:53.775062 (+ 216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:53.776246 (+ 1184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:53.777887 (+ 1641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:53.778629 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:53.778708 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:53.778771 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 05:11:53.779044 (+ 273us) server_negotiation.cc:299] Negotiation successful
0811 05:11:53.779086 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":94,"threads_started":1}
I20260811 05:11:53.779150 26591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:53.774214 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.193:39493 (local address 127.0.0.1:56462)
0811 05:11:53.774834 (+ 620us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:53.774843 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 05:11:53.775133 (+ 290us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:11:53.775444 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:11:53.775445 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:11:53.775447 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:11:53.775497 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:53.775498 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:53.776754 (+ 1256us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:53.776755 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:53.777913 (+ 1158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:53.777915 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:53.778813 (+ 898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:53.778814 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:53.778908 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:53.778923 (+ 15us) client_negotiation.cc:769] Sending connection context
0811 05:11:53.778995 (+ 72us) client_negotiation.cc:240] Negotiation successful
0811 05:11:53.779058 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":606,"thread_start_us":117,"threads_started":1}
I20260811 05:11:53.779395 26588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:53.774200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.194:40875 (local address 127.0.0.1:58602)
0811 05:11:53.774338 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:53.774385 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 05:11:53.774461 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:11:53.774908 (+ 447us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:11:53.774911 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:11:53.774914 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:11:53.774997 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:53.775000 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:53.776378 (+ 1378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:53.776379 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:53.777785 (+ 1406us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:53.777788 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:53.778811 (+ 1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:53.778812 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:53.778908 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:53.778923 (+ 15us) client_negotiation.cc:769] Sending connection context
0811 05:11:53.778995 (+ 72us) client_negotiation.cc:240] Negotiation successful
0811 05:11:53.779321 (+ 326us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":105,"mutex_wait_us":284,"thread_start_us":79,"threads_started":1}
I20260811 05:11:53.779407 26593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:53.774488 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56462 (local address 127.26.191.193:39493)
0811 05:11:53.775001 (+ 513us) server_negotiation.cc:206] Beginning negotiation
0811 05:11:53.775006 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:11:53.775017 (+ 11us) server_negotiation.cc:407] Connection header received
0811 05:11:53.775235 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:11:53.775238 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:11:53.775284 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:11:53.775352 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:11:53.775573 (+ 221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:53.776608 (+ 1035us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:53.777997 (+ 1389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:53.778676 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:53.778733 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:53.778778 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0811 05:11:53.779283 (+ 505us) server_negotiation.cc:299] Negotiation successful
0811 05:11:53.779328 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":476,"thread_start_us":109,"threads_started":1}
I20260811 05:11:53.780313 26038 tablet_service.cc:1467] Processing CreateTablet for tablet 80737d90a70547ca8711ab378a1d044e (DEFAULT_TABLE table=test-table [id=706a1321829846db92afcc8283bf68ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:11:53.780700 26038 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 80737d90a70547ca8711ab378a1d044e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:11:53.781092 26590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:53.774200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.195:36659 (local address 127.0.0.1:54334)
0811 05:11:53.774689 (+ 489us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:53.774701 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 05:11:53.774755 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:11:53.775092 (+ 337us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:11:53.775092 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:11:53.775094 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:11:53.775129 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:53.775130 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:53.776582 (+ 1452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:53.776583 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:53.777839 (+ 1256us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:53.777843 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:53.778952 (+ 1109us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:53.778953 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:53.779027 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:53.779031 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 05:11:53.779079 (+ 48us) client_negotiation.cc:240] Negotiation successful
0811 05:11:53.779131 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":463,"mutex_wait_us":2,"thread_start_us":97,"threads_started":1}
I20260811 05:11:53.781206 26264 tablet_service.cc:1467] Processing CreateTablet for tablet 80737d90a70547ca8711ab378a1d044e (DEFAULT_TABLE table=test-table [id=706a1321829846db92afcc8283bf68ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:11:53.781397 26594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:53.774703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54334 (local address 127.26.191.195:36659)
0811 05:11:53.774871 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0811 05:11:53.774876 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:11:53.774885 (+ 9us) server_negotiation.cc:407] Connection header received
0811 05:11:53.774922 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:11:53.774924 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:11:53.774939 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:11:53.775018 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:11:53.775226 (+ 208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:53.776455 (+ 1229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:53.777951 (+ 1496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:53.778796 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:53.778868 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:53.778917 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 05:11:53.779204 (+ 287us) server_negotiation.cc:299] Negotiation successful
0811 05:11:53.781309 (+ 2105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":103,"threads_started":1}
I20260811 05:11:53.781567 26264 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 80737d90a70547ca8711ab378a1d044e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:11:53.782019 26468 tablet_service.cc:1467] Processing CreateTablet for tablet 80737d90a70547ca8711ab378a1d044e (DEFAULT_TABLE table=test-table [id=706a1321829846db92afcc8283bf68ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:11:53.782337 26468 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 80737d90a70547ca8711ab378a1d044e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:11:53.784663 26597 tablet_bootstrap.cc:492] T 80737d90a70547ca8711ab378a1d044e P 1ebcd0e45067475d9ff9bac8c68b1a0d: Bootstrap starting.
I20260811 05:11:53.785087 26599 tablet_bootstrap.cc:492] T 80737d90a70547ca8711ab378a1d044e P 6b8c5fc09d4d4271a7834c62fe2fe3b6: Bootstrap starting.
I20260811 05:11:53.785766 26599 tablet_bootstrap.cc:654] T 80737d90a70547ca8711ab378a1d044e P 6b8c5fc09d4d4271a7834c62fe2fe3b6: Neither blocks nor log segments found. Creating new log.
I20260811 05:11:53.785842 26603 tablet_bootstrap.cc:492] T 80737d90a70547ca8711ab378a1d044e P fa3ea604b8e8482d8089a00de5a22179: Bootstrap starting.
I20260811 05:11:53.785995 26597 tablet_bootstrap.cc:654] T 80737d90a70547ca8711ab378a1d044e P 1ebcd0e45067475d9ff9bac8c68b1a0d: Neither blocks nor log segments found. Creating new log.
I20260811 05:11:53.786439 26599 log.cc:824] T 80737d90a70547ca8711ab378a1d044e P 6b8c5fc09d4d4271a7834c62fe2fe3b6: Log is configured to *not* fsync() on all Append() calls
I20260811 05:11:53.786484 26603 tablet_bootstrap.cc:654] T 80737d90a70547ca8711ab378a1d044e P fa3ea604b8e8482d8089a00de5a22179: Neither blocks nor log segments found. Creating new log.
I20260811 05:11:53.786768 26597 log.cc:824] T 80737d90a70547ca8711ab378a1d044e P 1ebcd0e45067475d9ff9bac8c68b1a0d: Log is configured to *not* fsync() on all Append() calls
I20260811 05:11:53.787005 26603 log.cc:824] T 80737d90a70547ca8711ab378a1d044e P fa3ea604b8e8482d8089a00de5a22179: Log is configured to *not* fsync() on all Append() calls
I20260811 05:11:53.787345 26599 tablet_bootstrap.cc:492] T 80737d90a70547ca8711ab378a1d044e P 6b8c5fc09d4d4271a7834c62fe2fe3b6: No bootstrap required, opened a new log
I20260811 05:11:53.787429 26599 ts_tablet_manager.cc:1397] T 80737d90a70547ca8711ab378a1d044e P 6b8c5fc09d4d4271a7834c62fe2fe3b6: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 05:11:53.787663 26597 tablet_bootstrap.cc:492] T 80737d90a70547ca8711ab378a1d044e P 1ebcd0e45067475d9ff9bac8c68b1a0d: No bootstrap required, opened a new log
I20260811 05:11:53.787766 26603 tablet_bootstrap.cc:492] T 80737d90a70547ca8711ab378a1d044e P fa3ea604b8e8482d8089a00de5a22179: No bootstrap required, opened a new log
I20260811 05:11:53.787839 26603 ts_tablet_manager.cc:1397] T 80737d90a70547ca8711ab378a1d044e P fa3ea604b8e8482d8089a00de5a22179: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 05:11:53.787802 26597 ts_tablet_manager.cc:1397] T 80737d90a70547ca8711ab378a1d044e P 1ebcd0e45067475d9ff9bac8c68b1a0d: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 05:11:53.789507 26599 raft_consensus.cc:348] T 80737d90a70547ca8711ab378a1d044e P 6b8c5fc09d4d4271a7834c62fe2fe3b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ebcd0e45067475d9ff9bac8c68b1a0d" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 39493 } } peers { permanent_uuid: "6b8c5fc09d4d4271a7834c62fe2fe3b6" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40875 } } peers { permanent_uuid: "fa3ea604b8e8482d8089a00de5a22179" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 36659 } }
I20260811 05:11:53.789712 26599 raft_consensus.cc:374] T 80737d90a70547ca8711ab378a1d044e P 6b8c5fc09d4d4271a7834c62fe2fe3b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:11:53.789760 26599 raft_consensus.cc:729] T 80737d90a70547ca8711ab378a1d044e P 6b8c5fc09d4d4271a7834c62fe2fe3b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b8c5fc09d4d4271a7834c62fe2fe3b6, State: Initialized, Role: FOLLOWER
I20260811 05:11:53.789883 26599 consensus_queue.cc:260] T 80737d90a70547ca8711ab378a1d044e P 6b8c5fc09d4d4271a7834c62fe2fe3b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ebcd0e45067475d9ff9bac8c68b1a0d" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 39493 } } peers { permanent_uuid: "6b8c5fc09d4d4271a7834c62fe2fe3b6" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40875 } } peers { permanent_uuid: "fa3ea604b8e8482d8089a00de5a22179" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 36659 } }
I20260811 05:11:53.789942 26603 raft_consensus.cc:348] T 80737d90a70547ca8711ab378a1d044e P fa3ea604b8e8482d8089a00de5a22179 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ebcd0e45067475d9ff9bac8c68b1a0d" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 39493 } } peers { permanent_uuid: "6b8c5fc09d4d4271a7834c62fe2fe3b6" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40875 } } peers { permanent_uuid: "fa3ea604b8e8482d8089a00de5a22179" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 36659 } }
I20260811 05:11:53.790114 26603 raft_consensus.cc:374] T 80737d90a70547ca8711ab378a1d044e P fa3ea604b8e8482d8089a00de5a22179 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:11:53.790151 26603 raft_consensus.cc:729] T 80737d90a70547ca8711ab378a1d044e P fa3ea604b8e8482d8089a00de5a22179 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa3ea604b8e8482d8089a00de5a22179, State: Initialized, Role: FOLLOWER
I20260811 05:11:53.790195 26358 heartbeater.cc:503] Master 127.26.191.254:39921 was elected leader, sending a full tablet report...
I20260811 05:11:53.790199 26599 ts_tablet_manager.cc:1428] T 80737d90a70547ca8711ab378a1d044e P 6b8c5fc09d4d4271a7834c62fe2fe3b6: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 05:11:53.790252 26603 consensus_queue.cc:260] T 80737d90a70547ca8711ab378a1d044e P fa3ea604b8e8482d8089a00de5a22179 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ebcd0e45067475d9ff9bac8c68b1a0d" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 39493 } } peers { permanent_uuid: "6b8c5fc09d4d4271a7834c62fe2fe3b6" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40875 } } peers { permanent_uuid: "fa3ea604b8e8482d8089a00de5a22179" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 36659 } }
I20260811 05:11:53.790508 26603 ts_tablet_manager.cc:1428] T 80737d90a70547ca8711ab378a1d044e P fa3ea604b8e8482d8089a00de5a22179: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 05:11:53.790560 26567 heartbeater.cc:503] Master 127.26.191.254:39921 was elected leader, sending a full tablet report...
I20260811 05:11:53.791586 26597 raft_consensus.cc:348] T 80737d90a70547ca8711ab378a1d044e P 1ebcd0e45067475d9ff9bac8c68b1a0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ebcd0e45067475d9ff9bac8c68b1a0d" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 39493 } } peers { permanent_uuid: "6b8c5fc09d4d4271a7834c62fe2fe3b6" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40875 } } peers { permanent_uuid: "fa3ea604b8e8482d8089a00de5a22179" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 36659 } }
I20260811 05:11:53.791765 26597 raft_consensus.cc:374] T 80737d90a70547ca8711ab378a1d044e P 1ebcd0e45067475d9ff9bac8c68b1a0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:11:53.791813 26597 raft_consensus.cc:729] T 80737d90a70547ca8711ab378a1d044e P 1ebcd0e45067475d9ff9bac8c68b1a0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ebcd0e45067475d9ff9bac8c68b1a0d, State: Initialized, Role: FOLLOWER
I20260811 05:11:53.791921 26597 consensus_queue.cc:260] T 80737d90a70547ca8711ab378a1d044e P 1ebcd0e45067475d9ff9bac8c68b1a0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ebcd0e45067475d9ff9bac8c68b1a0d" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 39493 } } peers { permanent_uuid: "6b8c5fc09d4d4271a7834c62fe2fe3b6" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40875 } } peers { permanent_uuid: "fa3ea604b8e8482d8089a00de5a22179" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 36659 } }
I20260811 05:11:53.792165 26597 ts_tablet_manager.cc:1428] T 80737d90a70547ca8711ab378a1d044e P 1ebcd0e45067475d9ff9bac8c68b1a0d: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260811 05:11:53.792220 26147 heartbeater.cc:503] Master 127.26.191.254:39921 was elected leader, sending a full tablet report...
W20260811 05:11:53.819015 26361 tablet.cc:2369] T 80737d90a70547ca8711ab378a1d044e P 6b8c5fc09d4d4271a7834c62fe2fe3b6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 05:11:53.845180 26610 raft_consensus.cc:482] T 80737d90a70547ca8711ab378a1d044e P fa3ea604b8e8482d8089a00de5a22179 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 05:11:53.845343 26610 raft_consensus.cc:504] T 80737d90a70547ca8711ab378a1d044e P fa3ea604b8e8482d8089a00de5a22179 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ebcd0e45067475d9ff9bac8c68b1a0d" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 39493 } } peers { permanent_uuid: "6b8c5fc09d4d4271a7834c62fe2fe3b6" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40875 } } peers { permanent_uuid: "fa3ea604b8e8482d8089a00de5a22179" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 36659 } }
I20260811 05:11:53.845903 26610 leader_election.cc:288] T 80737d90a70547ca8711ab378a1d044e P fa3ea604b8e8482d8089a00de5a22179 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ebcd0e45067475d9ff9bac8c68b1a0d (127.26.191.193:39493), 6b8c5fc09d4d4271a7834c62fe2fe3b6 (127.26.191.194:40875)
I20260811 05:11:53.849174 26572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:53.846100 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.194:40875 (local address 127.26.191.195:38321)
0811 05:11:53.846192 (+ 92us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:53.846206 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 05:11:53.846263 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:11:53.846442 (+ 179us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:11:53.846443 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:11:53.846445 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:11:53.846552 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:53.846555 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:53.847325 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:53.847327 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:53.848197 (+ 870us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:53.848200 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:53.848914 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:53.848915 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:53.849002 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:53.849006 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 05:11:53.849066 (+ 60us) client_negotiation.cc:240] Negotiation successful
0811 05:11:53.849116 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":47}
I20260811 05:11:53.849277 26592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:53.846242 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.195:38321 (local address 127.26.191.194:40875)
0811 05:11:53.846295 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 05:11:53.846297 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:11:53.846309 (+ 12us) server_negotiation.cc:407] Connection header received
0811 05:11:53.846346 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:11:53.846347 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:11:53.846355 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:11:53.846410 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:11:53.846632 (+ 222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:53.847228 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:53.848301 (+ 1073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:53.848829 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:53.848904 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:53.848913 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 05:11:53.849101 (+ 188us) server_negotiation.cc:299] Negotiation successful
0811 05:11:53.849152 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 05:11:53.849442 26593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:53.846165 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.195:60475 (local address 127.26.191.193:39493)
0811 05:11:53.846219 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 05:11:53.846222 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:11:53.846453 (+ 231us) server_negotiation.cc:407] Connection header received
0811 05:11:53.846489 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:11:53.846490 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:11:53.846500 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:11:53.846551 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:11:53.846763 (+ 212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:53.847471 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:53.848457 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:53.848965 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:53.849047 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:53.849058 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0811 05:11:53.849308 (+ 250us) server_negotiation.cc:299] Negotiation successful
0811 05:11:53.849363 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 05:11:53.849710 26612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:53.846104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.193:39493 (local address 127.26.191.195:60475)
0811 05:11:53.846343 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:53.846359 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 05:11:53.846437 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:11:53.846595 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:11:53.846596 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:11:53.846598 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:11:53.846673 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:53.846675 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:53.847565 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:53.847566 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:53.848353 (+ 787us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:53.848356 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:53.849105 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:53.849107 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:53.849188 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:53.849194 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 05:11:53.849538 (+ 344us) client_negotiation.cc:240] Negotiation successful
0811 05:11:53.849585 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":213,"mutex_wait_us":15,"thread_start_us":135,"threads_started":1}
I20260811 05:11:53.849692 26298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "80737d90a70547ca8711ab378a1d044e" candidate_uuid: "fa3ea604b8e8482d8089a00de5a22179" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b8c5fc09d4d4271a7834c62fe2fe3b6" is_pre_election: true
I20260811 05:11:53.850096 26298 raft_consensus.cc:2454] T 80737d90a70547ca8711ab378a1d044e P 6b8c5fc09d4d4271a7834c62fe2fe3b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa3ea604b8e8482d8089a00de5a22179 in term 0.
I20260811 05:11:53.850463 26392 leader_election.cc:302] T 80737d90a70547ca8711ab378a1d044e P fa3ea604b8e8482d8089a00de5a22179 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b8c5fc09d4d4271a7834c62fe2fe3b6, fa3ea604b8e8482d8089a00de5a22179; no voters:
I20260811 05:11:53.850521 26074 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "80737d90a70547ca8711ab378a1d044e" candidate_uuid: "fa3ea604b8e8482d8089a00de5a22179" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ebcd0e45067475d9ff9bac8c68b1a0d" is_pre_election: true
I20260811 05:11:53.850600 26610 raft_consensus.cc:2781] T 80737d90a70547ca8711ab378a1d044e P fa3ea604b8e8482d8089a00de5a22179 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 05:11:53.850657 26610 raft_consensus.cc:482] T 80737d90a70547ca8711ab378a1d044e P fa3ea604b8e8482d8089a00de5a22179 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 05:11:53.850711 26610 raft_consensus.cc:3037] T 80737d90a70547ca8711ab378a1d044e P fa3ea604b8e8482d8089a00de5a22179 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:11:53.850764 26074 raft_consensus.cc:2454] T 80737d90a70547ca8711ab378a1d044e P 1ebcd0e45067475d9ff9bac8c68b1a0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa3ea604b8e8482d8089a00de5a22179 in term 0.
I20260811 05:11:53.851608 26610 raft_consensus.cc:504] T 80737d90a70547ca8711ab378a1d044e P fa3ea604b8e8482d8089a00de5a22179 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ebcd0e45067475d9ff9bac8c68b1a0d" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 39493 } } peers { permanent_uuid: "6b8c5fc09d4d4271a7834c62fe2fe3b6" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40875 } } peers { permanent_uuid: "fa3ea604b8e8482d8089a00de5a22179" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 36659 } }
I20260811 05:11:53.851790 26610 leader_election.cc:288] T 80737d90a70547ca8711ab378a1d044e P fa3ea604b8e8482d8089a00de5a22179 [CANDIDATE]: Term 1 election: Requested vote from peers 1ebcd0e45067475d9ff9bac8c68b1a0d (127.26.191.193:39493), 6b8c5fc09d4d4271a7834c62fe2fe3b6 (127.26.191.194:40875)
I20260811 05:11:53.851969 26298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "80737d90a70547ca8711ab378a1d044e" candidate_uuid: "fa3ea604b8e8482d8089a00de5a22179" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b8c5fc09d4d4271a7834c62fe2fe3b6"
I20260811 05:11:53.851981 26074 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "80737d90a70547ca8711ab378a1d044e" candidate_uuid: "fa3ea604b8e8482d8089a00de5a22179" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ebcd0e45067475d9ff9bac8c68b1a0d"
I20260811 05:11:53.852059 26298 raft_consensus.cc:3037] T 80737d90a70547ca8711ab378a1d044e P 6b8c5fc09d4d4271a7834c62fe2fe3b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:11:53.852074 26074 raft_consensus.cc:3037] T 80737d90a70547ca8711ab378a1d044e P 1ebcd0e45067475d9ff9bac8c68b1a0d [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:11:53.852902 26074 raft_consensus.cc:2454] T 80737d90a70547ca8711ab378a1d044e P 1ebcd0e45067475d9ff9bac8c68b1a0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa3ea604b8e8482d8089a00de5a22179 in term 1.
I20260811 05:11:53.852910 26298 raft_consensus.cc:2454] T 80737d90a70547ca8711ab378a1d044e P 6b8c5fc09d4d4271a7834c62fe2fe3b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa3ea604b8e8482d8089a00de5a22179 in term 1.
I20260811 05:11:53.853077 26395 leader_election.cc:302] T 80737d90a70547ca8711ab378a1d044e P fa3ea604b8e8482d8089a00de5a22179 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ebcd0e45067475d9ff9bac8c68b1a0d, fa3ea604b8e8482d8089a00de5a22179; no voters:
I20260811 05:11:53.853166 26610 raft_consensus.cc:2781] T 80737d90a70547ca8711ab378a1d044e P fa3ea604b8e8482d8089a00de5a22179 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:11:53.853358 26610 raft_consensus.cc:686] T 80737d90a70547ca8711ab378a1d044e P fa3ea604b8e8482d8089a00de5a22179 [term 1 LEADER]: Becoming Leader. State: Replica: fa3ea604b8e8482d8089a00de5a22179, State: Running, Role: LEADER
I20260811 05:11:53.853574 26610 consensus_queue.cc:237] T 80737d90a70547ca8711ab378a1d044e P fa3ea604b8e8482d8089a00de5a22179 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ebcd0e45067475d9ff9bac8c68b1a0d" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 39493 } } peers { permanent_uuid: "6b8c5fc09d4d4271a7834c62fe2fe3b6" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40875 } } peers { permanent_uuid: "fa3ea604b8e8482d8089a00de5a22179" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 36659 } }
I20260811 05:11:53.854647 25842 catalog_manager.cc:5495] T 80737d90a70547ca8711ab378a1d044e P fa3ea604b8e8482d8089a00de5a22179 reported cstate change: term changed from 0 to 1, leader changed from <none> to fa3ea604b8e8482d8089a00de5a22179 (127.26.191.195). New cstate: current_term: 1 leader_uuid: "fa3ea604b8e8482d8089a00de5a22179" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ebcd0e45067475d9ff9bac8c68b1a0d" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 39493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b8c5fc09d4d4271a7834c62fe2fe3b6" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa3ea604b8e8482d8089a00de5a22179" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 36659 } health_report { overall_health: HEALTHY } } }
I20260811 05:11:53.870774 26594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:53.867998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54344 (local address 127.26.191.195:36659)
0811 05:11:53.868058 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0811 05:11:53.868061 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:11:53.868071 (+ 10us) server_negotiation.cc:407] Connection header received
0811 05:11:53.868117 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:11:53.868118 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:11:53.868143 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:11:53.868225 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:11:53.868418 (+ 193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:53.868977 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:53.869869 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:53.870092 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:53.870170 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:53.870370 (+ 200us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:11:53.870488 (+ 118us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:11:53.870593 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0811 05:11:53.870613 (+ 20us) server_negotiation.cc:299] Negotiation successful
0811 05:11:53.870635 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 05:11:53.872992 26298 raft_consensus.cc:1261] T 80737d90a70547ca8711ab378a1d044e P 6b8c5fc09d4d4271a7834c62fe2fe3b6 [term 1 FOLLOWER]: Refusing update from remote peer fa3ea604b8e8482d8089a00de5a22179: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:11:53.872992 26074 raft_consensus.cc:1261] T 80737d90a70547ca8711ab378a1d044e P 1ebcd0e45067475d9ff9bac8c68b1a0d [term 1 FOLLOWER]: Refusing update from remote peer fa3ea604b8e8482d8089a00de5a22179: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:11:53.873441 26610 consensus_queue.cc:1035] T 80737d90a70547ca8711ab378a1d044e P fa3ea604b8e8482d8089a00de5a22179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ebcd0e45067475d9ff9bac8c68b1a0d" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 39493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:11:53.873589 26613 consensus_queue.cc:1035] T 80737d90a70547ca8711ab378a1d044e P fa3ea604b8e8482d8089a00de5a22179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b8c5fc09d4d4271a7834c62fe2fe3b6" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 40875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:11:53.876312 26618 mvcc.cc:205] Tried to move back new op lower bound from 7317197266420219904 to 7317197266345603072. Current Snapshot: MvccSnapshot[applied={T|T < 7317197266420219904}]
I20260811 05:11:53.876480 26626 mvcc.cc:205] Tried to move back new op lower bound from 7317197266420219904 to 7317197266345603072. Current Snapshot: MvccSnapshot[applied={T|T < 7317197266420219904}]
I20260811 05:11:53.877348 26619 mvcc.cc:205] Tried to move back new op lower bound from 7317197266420219904 to 7317197266345603072. Current Snapshot: MvccSnapshot[applied={T|T < 7317197266420219904}]
I20260811 05:11:53.879347 25841 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40254:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:11:53.879460 25841 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40254:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:11:53.880313 25841 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3c39806cfb9a4df1bbb691bccd642fe0: Sending DeleteTablet for 3 replicas of tablet 80737d90a70547ca8711ab378a1d044e
I20260811 05:11:53.880743 26468 tablet_service.cc:1514] Processing DeleteTablet for tablet 80737d90a70547ca8711ab378a1d044e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:11:53 UTC) from {username='kudu', principal='kudu/127.26.191.254@KRBTEST.COM'} at 127.0.0.1:54334
I20260811 05:11:53.880695 26038 tablet_service.cc:1514] Processing DeleteTablet for tablet 80737d90a70547ca8711ab378a1d044e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:11:53 UTC) from {username='kudu', principal='kudu/127.26.191.254@KRBTEST.COM'} at 127.0.0.1:56462
I20260811 05:11:53.880846 26264 tablet_service.cc:1514] Processing DeleteTablet for tablet 80737d90a70547ca8711ab378a1d044e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:11:53 UTC) from {username='kudu', principal='kudu/127.26.191.254@KRBTEST.COM'} at 127.0.0.1:58602
I20260811 05:11:53.880995 26639 tablet_replica.cc:330] T 80737d90a70547ca8711ab378a1d044e P fa3ea604b8e8482d8089a00de5a22179: stopping tablet replica
I20260811 05:11:53.880986 26640 tablet_replica.cc:330] T 80737d90a70547ca8711ab378a1d044e P 1ebcd0e45067475d9ff9bac8c68b1a0d: stopping tablet replica
I20260811 05:11:53.881085 26639 raft_consensus.cc:2229] T 80737d90a70547ca8711ab378a1d044e P fa3ea604b8e8482d8089a00de5a22179 [term 1 LEADER]: Raft consensus shutting down.
I20260811 05:11:53.881085 26640 raft_consensus.cc:2229] T 80737d90a70547ca8711ab378a1d044e P 1ebcd0e45067475d9ff9bac8c68b1a0d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 05:11:53.881187 26639 raft_consensus.cc:2258] T 80737d90a70547ca8711ab378a1d044e P fa3ea604b8e8482d8089a00de5a22179 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:11:53.881196 26640 raft_consensus.cc:2258] T 80737d90a70547ca8711ab378a1d044e P 1ebcd0e45067475d9ff9bac8c68b1a0d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:11:53.881605 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 25938
I20260811 05:11:53.881673 26640 ts_tablet_manager.cc:1905] T 80737d90a70547ca8711ab378a1d044e P 1ebcd0e45067475d9ff9bac8c68b1a0d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:11:53.881673 26639 ts_tablet_manager.cc:1905] T 80737d90a70547ca8711ab378a1d044e P fa3ea604b8e8482d8089a00de5a22179: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:11:53.883104 26641 tablet_replica.cc:330] T 80737d90a70547ca8711ab378a1d044e P 6b8c5fc09d4d4271a7834c62fe2fe3b6: stopping tablet replica
I20260811 05:11:53.883288 26641 raft_consensus.cc:2229] T 80737d90a70547ca8711ab378a1d044e P 6b8c5fc09d4d4271a7834c62fe2fe3b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 05:11:53.883327 26639 ts_tablet_manager.cc:1918] T 80737d90a70547ca8711ab378a1d044e P fa3ea604b8e8482d8089a00de5a22179: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 05:11:53.883389 26639 log.cc:1196] T 80737d90a70547ca8711ab378a1d044e P fa3ea604b8e8482d8089a00de5a22179: Deleting WAL directory at /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424853995437-27391-0/minicluster-data/ts-2/wal/wals/80737d90a70547ca8711ab378a1d044e
I20260811 05:11:53.883435 26641 raft_consensus.cc:2258] T 80737d90a70547ca8711ab378a1d044e P 6b8c5fc09d4d4271a7834c62fe2fe3b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:11:53.883697 26639 ts_tablet_manager.cc:1939] T 80737d90a70547ca8711ab378a1d044e P fa3ea604b8e8482d8089a00de5a22179: Deleting consensus metadata
I20260811 05:11:53.884128 25817 catalog_manager.cc:4841] TS fa3ea604b8e8482d8089a00de5a22179 (127.26.191.195:36659): tablet 80737d90a70547ca8711ab378a1d044e (table test-table [id=706a1321829846db92afcc8283bf68ea]) successfully deleted
I20260811 05:11:53.884979 26641 ts_tablet_manager.cc:1905] T 80737d90a70547ca8711ab378a1d044e P 6b8c5fc09d4d4271a7834c62fe2fe3b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:11:53.886806 26641 ts_tablet_manager.cc:1918] T 80737d90a70547ca8711ab378a1d044e P 6b8c5fc09d4d4271a7834c62fe2fe3b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 05:11:53.886914 26641 log.cc:1196] T 80737d90a70547ca8711ab378a1d044e P 6b8c5fc09d4d4271a7834c62fe2fe3b6: Deleting WAL directory at /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424853995437-27391-0/minicluster-data/ts-1/wal/wals/80737d90a70547ca8711ab378a1d044e
I20260811 05:11:53.887285 26641 ts_tablet_manager.cc:1939] T 80737d90a70547ca8711ab378a1d044e P 6b8c5fc09d4d4271a7834c62fe2fe3b6: Deleting consensus metadata
I20260811 05:11:53.887961 25813 catalog_manager.cc:4841] TS 6b8c5fc09d4d4271a7834c62fe2fe3b6 (127.26.191.194:40875): tablet 80737d90a70547ca8711ab378a1d044e (table test-table [id=706a1321829846db92afcc8283bf68ea]) successfully deleted
W20260811 05:11:53.899518 25819 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.191.193:39493 (error 108)
I20260811 05:11:53.899857 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 26153
I20260811 05:11:53.904381 26590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:53.900091 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.193:39493 (local address 127.0.0.1:56476)
0811 05:11:53.904212 (+ 4121us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:53.904315 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.193:39493: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":4080}
W20260811 05:11:53.907035 25819 catalog_manager.cc:4584] TS 1ebcd0e45067475d9ff9bac8c68b1a0d (127.26.191.193:39493): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 80737d90a70547ca8711ab378a1d044e: Network error: Client connection negotiation failed: client connection to 127.26.191.193:39493: connect: Connection refused (error 111)
I20260811 05:11:53.918105 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 26366
I20260811 05:11:53.930950 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 25789
2026-08-11T05:11:53Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2316 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-11T05:11:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:11:53Z Disabled control of system clock
I20260811 05:11:53.974083 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424853995437-27391-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424853995437-27391-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424853995437-27391-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.254:35827
--webserver_interface=127.26.191.254
--webserver_port=0
--builtin_ntp_servers=127.26.191.212:45781
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.191.254:35827
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 05:11:54.061389 26649 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:11:54.061714 26649 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:11:54.061772 26649 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:11:54.063139 26649 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:11:54.063212 26649 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:11:54.063237 26649 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:11:54.063263 26649 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:11:54.063287 26649 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:11:54.064841 26649 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:45781
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424853995437-27391-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424853995437-27391-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.191.254:35827
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.254:35827
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.191.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26649
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424853995437-27391-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:11:54.065136 26649 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:11:54.065449 26649 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:11:54.070537 26656 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:11:54.070648 26649 server_base.cc:1034] running on GCE node
W20260811 05:11:54.070550 26659 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:11:54.070550 26654 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:11:54.071084 26649 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:11:54.071398 26649 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:11:54.072597 26649 hybrid_clock.cc:648] HybridClock initialized: now 1786425114072578 us; error 34 us; skew 500 ppm
I20260811 05:11:54.073997 26649 webserver.cc:460] Webserver started at http://127.26.191.254:46009/ using document root <none> and password file <none>
I20260811 05:11:54.074282 26649 fs_manager.cc:359] Metadata directory not provided
I20260811 05:11:54.074363 26649 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:11:54.074525 26649 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:11:54.075727 26649 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424853995437-27391-0/minicluster-data/master-0/data/instance:
uuid: "47896cc2e946416bbfde89b154b42acc"
format_stamp: "Formatted at 2026-08-11 05:11:54 on dist-test-slave-x5fp"
server_key: "ed7580533e8c5d7a6c639823afa83894"
server_key_iv: "f7fe0aa47c25dfbeecb0fc6456be58c6"
server_key_version: "encryptionkey@0"
I20260811 05:11:54.076156 26649 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424853995437-27391-0/minicluster-data/master-0/wal/instance:
uuid: "47896cc2e946416bbfde89b154b42acc"
format_stamp: "Formatted at 2026-08-11 05:11:54 on dist-test-slave-x5fp"
server_key: "ed7580533e8c5d7a6c639823afa83894"
server_key_iv: "f7fe0aa47c25dfbeecb0fc6456be58c6"
server_key_version: "encryptionkey@0"
I20260811 05:11:54.077821 26649 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.003s
I20260811 05:11:54.078678 26668 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:11:54.078917 26649 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:11:54.079046 26649 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424853995437-27391-0/minicluster-data/master-0/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424853995437-27391-0/minicluster-data/master-0/wal
uuid: "47896cc2e946416bbfde89b154b42acc"
format_stamp: "Formatted at 2026-08-11 05:11:54 on dist-test-slave-x5fp"
server_key: "ed7580533e8c5d7a6c639823afa83894"
server_key_iv: "f7fe0aa47c25dfbeecb0fc6456be58c6"
server_key_version: "encryptionkey@0"
I20260811 05:11:54.079110 26649 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424853995437-27391-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424853995437-27391-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424853995437-27391-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:11:54.093737 26649 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:11:54.094063 26649 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:11:54.094182 26649 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:11:54.098548 26649 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.254:35827
I20260811 05:11:54.098585 26746 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.254:35827 every 8 connection(s)
I20260811 05:11:54.098976 26649 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
I20260811 05:11:54.099429 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 26649
I20260811 05:11:54.099562 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424853995437-27391-0/minicluster-data/master-0/wal/instance
I20260811 05:11:54.099762 27391 external_mini_cluster.cc:1428] Setting key c75faa7914a677504649b209858212be
I20260811 05:11:54.100436 26748 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:11:54.103572 26748 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 47896cc2e946416bbfde89b154b42acc: Bootstrap starting.
I20260811 05:11:54.104310 26748 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 47896cc2e946416bbfde89b154b42acc: Neither blocks nor log segments found. Creating new log.
I20260811 05:11:54.104699 26748 log.cc:824] T 00000000000000000000000000000000 P 47896cc2e946416bbfde89b154b42acc: Log is configured to *not* fsync() on all Append() calls
I20260811 05:11:54.105671 26748 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 47896cc2e946416bbfde89b154b42acc: No bootstrap required, opened a new log
I20260811 05:11:54.105883 26752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:54.100359 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51126 (local address 127.26.191.254:35827)
0811 05:11:54.100668 (+ 309us) server_negotiation.cc:206] Beginning negotiation
0811 05:11:54.100678 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 05:11:54.100711 (+ 33us) server_negotiation.cc:407] Connection header received
0811 05:11:54.101259 (+ 548us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:11:54.101266 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:11:54.101331 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:11:54.101489 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:11:54.101715 (+ 226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:54.102622 (+ 907us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:54.103402 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:54.103893 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:54.104035 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:54.104981 (+ 946us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:11:54.104986 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:11:54.104986 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:11:54.105205 (+ 219us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:11:54.105243 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:11:54.105256 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:11:54.105376 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0811 05:11:54.105460 (+ 84us) server_negotiation.cc:299] Negotiation successful
0811 05:11:54.105551 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":216,"thread_start_us":130,"threads_started":1}
I20260811 05:11:54.108112 26748 raft_consensus.cc:348] T 00000000000000000000000000000000 P 47896cc2e946416bbfde89b154b42acc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47896cc2e946416bbfde89b154b42acc" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 35827 } }
I20260811 05:11:54.108301 26748 raft_consensus.cc:374] T 00000000000000000000000000000000 P 47896cc2e946416bbfde89b154b42acc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:11:54.108342 26748 raft_consensus.cc:729] T 00000000000000000000000000000000 P 47896cc2e946416bbfde89b154b42acc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47896cc2e946416bbfde89b154b42acc, State: Initialized, Role: FOLLOWER
I20260811 05:11:54.108476 26748 consensus_queue.cc:260] T 00000000000000000000000000000000 P 47896cc2e946416bbfde89b154b42acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47896cc2e946416bbfde89b154b42acc" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 35827 } }
I20260811 05:11:54.108564 26748 raft_consensus.cc:388] T 00000000000000000000000000000000 P 47896cc2e946416bbfde89b154b42acc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:11:54.108608 26748 raft_consensus.cc:482] T 00000000000000000000000000000000 P 47896cc2e946416bbfde89b154b42acc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:11:54.108667 26748 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 47896cc2e946416bbfde89b154b42acc [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:11:54.109335 26748 raft_consensus.cc:504] T 00000000000000000000000000000000 P 47896cc2e946416bbfde89b154b42acc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47896cc2e946416bbfde89b154b42acc" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 35827 } }
I20260811 05:11:54.109467 26748 leader_election.cc:302] T 00000000000000000000000000000000 P 47896cc2e946416bbfde89b154b42acc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 47896cc2e946416bbfde89b154b42acc; no voters:
I20260811 05:11:54.109678 26748 leader_election.cc:288] T 00000000000000000000000000000000 P 47896cc2e946416bbfde89b154b42acc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 05:11:54.109954 26755 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 47896cc2e946416bbfde89b154b42acc [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:11:54.110167 26755 raft_consensus.cc:686] T 00000000000000000000000000000000 P 47896cc2e946416bbfde89b154b42acc [term 1 LEADER]: Becoming Leader. State: Replica: 47896cc2e946416bbfde89b154b42acc, State: Running, Role: LEADER
I20260811 05:11:54.110214 26748 sys_catalog.cc:564] T 00000000000000000000000000000000 P 47896cc2e946416bbfde89b154b42acc [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:11:54.110275 26755 consensus_queue.cc:237] T 00000000000000000000000000000000 P 47896cc2e946416bbfde89b154b42acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47896cc2e946416bbfde89b154b42acc" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 35827 } }
I20260811 05:11:54.110697 26756 sys_catalog.cc:455] T 00000000000000000000000000000000 P 47896cc2e946416bbfde89b154b42acc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "47896cc2e946416bbfde89b154b42acc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47896cc2e946416bbfde89b154b42acc" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 35827 } } }
I20260811 05:11:54.110730 26757 sys_catalog.cc:455] T 00000000000000000000000000000000 P 47896cc2e946416bbfde89b154b42acc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 47896cc2e946416bbfde89b154b42acc. Latest consensus state: current_term: 1 leader_uuid: "47896cc2e946416bbfde89b154b42acc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47896cc2e946416bbfde89b154b42acc" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 35827 } } }
I20260811 05:11:54.110803 26756 sys_catalog.cc:458] T 00000000000000000000000000000000 P 47896cc2e946416bbfde89b154b42acc [sys.catalog]: This master's current role is: LEADER
I20260811 05:11:54.110862 26757 sys_catalog.cc:458] T 00000000000000000000000000000000 P 47896cc2e946416bbfde89b154b42acc [sys.catalog]: This master's current role is: LEADER
I20260811 05:11:54.111545 26766 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:11:54.112133 26766 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:11:54.113961 26766 catalog_manager.cc:1347] Generated new cluster ID: 73e7f40a9ca443d3b6975f12d8afe723
I20260811 05:11:54.114020 26766 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:11:54.151949 26766 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:11:54.152536 26766 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:11:54.160179 26766 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 47896cc2e946416bbfde89b154b42acc: Generated new TSK 0
I20260811 05:11:54.160463 26766 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 05:11:54.172349 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424853995437-27391-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424853995437-27391-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424853995437-27391-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424853995437-27391-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.191.193:0
--local_ip_for_outbound_sockets=127.26.191.193
--webserver_interface=127.26.191.193
--webserver_port=0
--tserver_master_addrs=127.26.191.254:35827
--builtin_ntp_servers=127.26.191.212:45781
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 05:11:54.259413 26780 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:11:54.259639 26780 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:11:54.259660 26780 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:11:54.260893 26780 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:11:54.260937 26780 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:11:54.260964 26780 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.191.193
I20260811 05:11:54.262355 26780 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:45781
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424853995437-27391-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424853995437-27391-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.191.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424853995437-27391-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.191.193
--webserver_port=0
--tserver_master_addrs=127.26.191.254:35827
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26780
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.191.193
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424853995437-27391-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:11:54.262626 26780 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:11:54.262984 26780 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:11:54.268555 26793 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:11:54.268555 26795 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:11:54.268661 26797 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:11:54.268782 26780 server_base.cc:1034] running on GCE node
I20260811 05:11:54.269168 26780 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:11:54.269444 26780 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:11:54.270602 26780 hybrid_clock.cc:648] HybridClock initialized: now 1786425114270590 us; error 30 us; skew 500 ppm
I20260811 05:11:54.272094 26780 webserver.cc:460] Webserver started at http://127.26.191.193:43035/ using document root <none> and password file <none>
I20260811 05:11:54.272392 26780 fs_manager.cc:359] Metadata directory not provided
I20260811 05:11:54.272486 26780 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:11:54.272646 26780 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:11:54.273900 26780 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424853995437-27391-0/minicluster-data/ts-0/data/instance:
uuid: "e318ed0fafff419f8e1ecf0f00d28f3d"
format_stamp: "Formatted at 2026-08-11 05:11:54 on dist-test-slave-x5fp"
server_key: "af75874c16cc4c053c13802e88e084f9"
server_key_iv: "66124c463a50e7cf907581267bfbf24a"
server_key_version: "encryptionkey@0"
I20260811 05:11:54.274362 26780 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424853995437-27391-0/minicluster-data/ts-0/wal/instance:
uuid: "e318ed0fafff419f8e1ecf0f00d28f3d"
format_stamp: "Formatted at 2026-08-11 05:11:54 on dist-test-slave-x5fp"
server_key: "af75874c16cc4c053c13802e88e084f9"
server_key_iv: "66124c463a50e7cf907581267bfbf24a"
server_key_version: "encryptionkey@0"
I20260811 05:11:54.275913 26780 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 05:11:54.276845 26807 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:11:54.277038 26780 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:11:54.277153 26780 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424853995437-27391-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424853995437-27391-0/minicluster-data/ts-0/wal
uuid: "e318ed0fafff419f8e1ecf0f00d28f3d"
format_stamp: "Formatted at 2026-08-11 05:11:54 on dist-test-slave-x5fp"
server_key: "af75874c16cc4c053c13802e88e084f9"
server_key_iv: "66124c463a50e7cf907581267bfbf24a"
server_key_version: "encryptionkey@0"
I20260811 05:11:54.277246 26780 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424853995437-27391-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424853995437-27391-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424853995437-27391-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:11:54.289037 26780 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:11:54.289400 26780 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:11:54.289565 26780 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:11:54.289824 26780 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:11:54.290218 26780 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:11:54.290285 26780 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:11:54.290333 26780 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:11:54.290367 26780 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:11:54.297179 26780 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.193:39195
I20260811 05:11:54.297272 27010 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.193:39195 every 8 connection(s)
I20260811 05:11:54.297688 26780 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424853995437-27391-0/minicluster-data/ts-0/data/info.pb
I20260811 05:11:54.298717 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 26780
I20260811 05:11:54.298823 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424853995437-27391-0/minicluster-data/ts-0/wal/instance
I20260811 05:11:54.299098 27391 external_mini_cluster.cc:1428] Setting key 855fad663ce6662f1639aa04a2caaed3
I20260811 05:11:54.300217 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424853995437-27391-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424853995437-27391-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424853995437-27391-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424853995437-27391-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.191.194:0
--local_ip_for_outbound_sockets=127.26.191.194
--webserver_interface=127.26.191.194
--webserver_port=0
--tserver_master_addrs=127.26.191.254:35827
--builtin_ntp_servers=127.26.191.212:45781
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 05:11:54.304540 26752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:54.298543 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.193:53819 (local address 127.26.191.254:35827)
0811 05:11:54.298771 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0811 05:11:54.298773 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:11:54.298988 (+ 215us) server_negotiation.cc:407] Connection header received
0811 05:11:54.299712 (+ 724us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:11:54.299714 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:11:54.299734 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:11:54.299796 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:11:54.300673 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:54.301273 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:54.302755 (+ 1482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:54.302962 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:54.303036 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:54.304144 (+ 1108us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:11:54.304147 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:11:54.304147 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:11:54.304154 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:11:54.304175 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:11:54.304181 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:11:54.304249 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 05:11:54.304353 (+ 104us) server_negotiation.cc:299] Negotiation successful
0811 05:11:54.304405 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":201}
I20260811 05:11:54.304615 27014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:54.298515 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:35827 (local address 127.26.191.193:53819)
0811 05:11:54.298788 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:54.298889 (+ 101us) client_negotiation.cc:174] Beginning negotiation
0811 05:11:54.299556 (+ 667us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:11:54.299894 (+ 338us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:11:54.299898 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:11:54.299907 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:11:54.300572 (+ 665us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:54.300579 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:54.301397 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:54.301399 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:54.302643 (+ 1244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:54.302647 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:54.303072 (+ 425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:54.303074 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:54.303271 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:54.303987 (+ 716us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 05:11:54.303988 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:11:54.304020 (+ 32us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 05:11:54.304047 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:11:54.304256 (+ 209us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:11:54.304261 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:11:54.304264 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 05:11:54.304328 (+ 64us) client_negotiation.cc:240] Negotiation successful
0811 05:11:54.304420 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":116,"threads_started":1}
I20260811 05:11:54.305207 27012 heartbeater.cc:347] Connected to a master server at 127.26.191.254:35827
I20260811 05:11:54.305326 27012 heartbeater.cc:464] Registering TS with master...
I20260811 05:11:54.305526 27012 heartbeater.cc:511] Master 127.26.191.254:35827 requested a full tablet report, sending...
I20260811 05:11:54.306102 26694 ts_manager.cc:194] Registered new tserver with Master: e318ed0fafff419f8e1ecf0f00d28f3d (127.26.191.193:39195)
I20260811 05:11:54.306718 26694 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.191.193:53819
W20260811 05:11:54.392447 27015 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:11:54.392699 27015 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:11:54.392796 27015 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:11:54.394083 27015 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:11:54.394136 27015 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:11:54.394164 27015 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.191.194
I20260811 05:11:54.395646 27015 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:45781
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424853995437-27391-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424853995437-27391-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.191.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424853995437-27391-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.191.194
--webserver_port=0
--tserver_master_addrs=127.26.191.254:35827
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27015
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.191.194
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424853995437-27391-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:11:54.396034 27015 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:11:54.396425 27015 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:11:54.402505 27027 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:11:54.402496 27030 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:11:54.402496 27026 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:11:54.402905 27015 server_base.cc:1034] running on GCE node
I20260811 05:11:54.403195 27015 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:11:54.403518 27015 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:11:54.404704 27015 hybrid_clock.cc:648] HybridClock initialized: now 1786425114404679 us; error 42 us; skew 500 ppm
I20260811 05:11:54.406250 27015 webserver.cc:460] Webserver started at http://127.26.191.194:37977/ using document root <none> and password file <none>
I20260811 05:11:54.406543 27015 fs_manager.cc:359] Metadata directory not provided
I20260811 05:11:54.406616 27015 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:11:54.406769 27015 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:11:54.408254 27015 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424853995437-27391-0/minicluster-data/ts-1/data/instance:
uuid: "818366e15f584f549991e8a56dd301be"
format_stamp: "Formatted at 2026-08-11 05:11:54 on dist-test-slave-x5fp"
server_key: "15e488d2533967a029db46bc5b9b5fee"
server_key_iv: "4f6abc00f3b18128e433decce7c134d4"
server_key_version: "encryptionkey@0"
I20260811 05:11:54.408691 27015 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424853995437-27391-0/minicluster-data/ts-1/wal/instance:
uuid: "818366e15f584f549991e8a56dd301be"
format_stamp: "Formatted at 2026-08-11 05:11:54 on dist-test-slave-x5fp"
server_key: "15e488d2533967a029db46bc5b9b5fee"
server_key_iv: "4f6abc00f3b18128e433decce7c134d4"
server_key_version: "encryptionkey@0"
I20260811 05:11:54.410818 27015 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.002s
I20260811 05:11:54.411804 27037 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:11:54.412040 27015 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 05:11:54.412168 27015 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424853995437-27391-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424853995437-27391-0/minicluster-data/ts-1/wal
uuid: "818366e15f584f549991e8a56dd301be"
format_stamp: "Formatted at 2026-08-11 05:11:54 on dist-test-slave-x5fp"
server_key: "15e488d2533967a029db46bc5b9b5fee"
server_key_iv: "4f6abc00f3b18128e433decce7c134d4"
server_key_version: "encryptionkey@0"
I20260811 05:11:54.412254 27015 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424853995437-27391-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424853995437-27391-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424853995437-27391-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:11:54.421607 27015 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:11:54.421932 27015 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:11:54.422084 27015 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:11:54.422338 27015 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:11:54.422688 27015 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:11:54.422739 27015 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:11:54.422773 27015 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:11:54.422813 27015 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:11:54.428957 27015 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.194:39083
I20260811 05:11:54.429006 27220 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.194:39083 every 8 connection(s)
I20260811 05:11:54.429368 27015 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424853995437-27391-0/minicluster-data/ts-1/data/info.pb
I20260811 05:11:54.435004 26752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:54.430164 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.194:53363 (local address 127.26.191.254:35827)
0811 05:11:54.430232 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 05:11:54.430233 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 05:11:54.430476 (+ 243us) server_negotiation.cc:407] Connection header received
0811 05:11:54.431114 (+ 638us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:11:54.431116 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:11:54.431129 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:11:54.431186 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:11:54.431894 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:54.432403 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:54.433503 (+ 1100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:54.433710 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:54.433785 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:54.434646 (+ 861us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:11:54.434647 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:11:54.434648 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:11:54.434653 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:11:54.434672 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:11:54.434676 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:11:54.434735 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 05:11:54.434885 (+ 150us) server_negotiation.cc:299] Negotiation successful
0811 05:11:54.434916 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 05:11:54.435245 27224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:54.430141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:35827 (local address 127.26.191.194:53363)
0811 05:11:54.430351 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:54.430388 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 05:11:54.431004 (+ 616us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:11:54.431261 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:11:54.431265 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:11:54.431275 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:11:54.431794 (+ 519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:54.431798 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:54.432512 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:54.432512 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:54.433388 (+ 876us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:54.433391 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:54.433795 (+ 404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:54.433796 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:54.433944 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:54.434503 (+ 559us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 05:11:54.434504 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:11:54.434533 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 05:11:54.434556 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:11:54.434736 (+ 180us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:11:54.434743 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:11:54.434747 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 05:11:54.434884 (+ 137us) client_negotiation.cc:240] Negotiation successful
0811 05:11:54.434997 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":93,"threads_started":1}
I20260811 05:11:54.435922 27221 heartbeater.cc:347] Connected to a master server at 127.26.191.254:35827
I20260811 05:11:54.436021 27221 heartbeater.cc:464] Registering TS with master...
I20260811 05:11:54.436224 27221 heartbeater.cc:511] Master 127.26.191.254:35827 requested a full tablet report, sending...
I20260811 05:11:54.436684 26694 ts_manager.cc:194] Registered new tserver with Master: 818366e15f584f549991e8a56dd301be (127.26.191.194:39083)
I20260811 05:11:54.437153 26694 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.191.194:53363
I20260811 05:11:54.437861 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 27015
I20260811 05:11:54.437989 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424853995437-27391-0/minicluster-data/ts-1/wal/instance
I20260811 05:11:54.438198 27391 external_mini_cluster.cc:1428] Setting key 3fcea2f879134d8a03f16c9671b175c4
I20260811 05:11:54.439293 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424853995437-27391-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424853995437-27391-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424853995437-27391-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424853995437-27391-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.191.195:0
--local_ip_for_outbound_sockets=127.26.191.195
--webserver_interface=127.26.191.195
--webserver_port=0
--tserver_master_addrs=127.26.191.254:35827
--builtin_ntp_servers=127.26.191.212:45781
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 05:11:54.527139 27230 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:11:54.527405 27230 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:11:54.527431 27230 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:11:54.528829 27230 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:11:54.528885 27230 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:11:54.528913 27230 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.191.195
I20260811 05:11:54.530370 27230 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:45781
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424853995437-27391-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424853995437-27391-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.191.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424853995437-27391-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.191.195
--webserver_port=0
--tserver_master_addrs=127.26.191.254:35827
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27230
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.191.195
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424853995437-27391-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:11:54.530675 27230 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:11:54.531103 27230 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:11:54.536641 27237 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:11:54.536649 27238 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:11:54.536669 27230 server_base.cc:1034] running on GCE node
W20260811 05:11:54.536649 27242 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:11:54.537072 27230 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:11:54.537349 27230 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:11:54.538512 27230 hybrid_clock.cc:648] HybridClock initialized: now 1786425114538504 us; error 40 us; skew 500 ppm
I20260811 05:11:54.539911 27230 webserver.cc:460] Webserver started at http://127.26.191.195:43123/ using document root <none> and password file <none>
I20260811 05:11:54.540187 27230 fs_manager.cc:359] Metadata directory not provided
I20260811 05:11:54.540257 27230 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:11:54.540411 27230 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:11:54.541575 27230 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424853995437-27391-0/minicluster-data/ts-2/data/instance:
uuid: "d161b402faf94a75a085a5cc52571303"
format_stamp: "Formatted at 2026-08-11 05:11:54 on dist-test-slave-x5fp"
server_key: "113f4987ad7ad9f9847be6c6d353bf12"
server_key_iv: "fa4ea2e042ee2de9ea97dccec542c2ae"
server_key_version: "encryptionkey@0"
I20260811 05:11:54.541954 27230 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424853995437-27391-0/minicluster-data/ts-2/wal/instance:
uuid: "d161b402faf94a75a085a5cc52571303"
format_stamp: "Formatted at 2026-08-11 05:11:54 on dist-test-slave-x5fp"
server_key: "113f4987ad7ad9f9847be6c6d353bf12"
server_key_iv: "fa4ea2e042ee2de9ea97dccec542c2ae"
server_key_version: "encryptionkey@0"
I20260811 05:11:54.543385 27230 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 05:11:54.544210 27254 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:11:54.544409 27230 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:11:54.544520 27230 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424853995437-27391-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424853995437-27391-0/minicluster-data/ts-2/wal
uuid: "d161b402faf94a75a085a5cc52571303"
format_stamp: "Formatted at 2026-08-11 05:11:54 on dist-test-slave-x5fp"
server_key: "113f4987ad7ad9f9847be6c6d353bf12"
server_key_iv: "fa4ea2e042ee2de9ea97dccec542c2ae"
server_key_version: "encryptionkey@0"
I20260811 05:11:54.544601 27230 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424853995437-27391-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424853995437-27391-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424853995437-27391-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:11:54.569370 27230 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:11:54.569770 27230 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:11:54.569948 27230 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:11:54.570207 27230 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:11:54.570573 27230 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:11:54.570628 27230 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:11:54.570667 27230 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:11:54.570709 27230 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:11:54.577032 27230 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.195:38739
I20260811 05:11:54.577117 27439 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.195:38739 every 8 connection(s)
I20260811 05:11:54.577520 27230 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424853995437-27391-0/minicluster-data/ts-2/data/info.pb
I20260811 05:11:54.583628 26752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:54.578502 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.195:52353 (local address 127.26.191.254:35827)
0811 05:11:54.578577 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0811 05:11:54.578580 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:11:54.578766 (+ 186us) server_negotiation.cc:407] Connection header received
0811 05:11:54.579273 (+ 507us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:11:54.579274 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:11:54.579287 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:11:54.579364 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:11:54.580288 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:54.581002 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:54.582059 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:54.582287 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:54.582353 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:54.583383 (+ 1030us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:11:54.583385 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:11:54.583385 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:11:54.583390 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:11:54.583407 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:11:54.583411 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:11:54.583463 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 05:11:54.583534 (+ 71us) server_negotiation.cc:299] Negotiation successful
0811 05:11:54.583560 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 05:11:54.583877 27443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:54.578412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:35827 (local address 127.26.191.195:52353)
0811 05:11:54.578603 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:54.578648 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 05:11:54.579148 (+ 500us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:11:54.579483 (+ 335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:11:54.579487 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:11:54.579496 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:11:54.580160 (+ 664us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:54.580165 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:54.581082 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:54.581083 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:54.581972 (+ 889us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:54.581975 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:54.582370 (+ 395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:54.582370 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:54.582491 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:54.583208 (+ 717us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 05:11:54.583208 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:11:54.583247 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 05:11:54.583273 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:11:54.583463 (+ 190us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:11:54.583465 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:11:54.583468 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 05:11:54.583520 (+ 52us) client_negotiation.cc:240] Negotiation successful
0811 05:11:54.583608 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":91,"threads_started":1}
I20260811 05:11:54.584607 27441 heartbeater.cc:347] Connected to a master server at 127.26.191.254:35827
I20260811 05:11:54.584707 27441 heartbeater.cc:464] Registering TS with master...
I20260811 05:11:54.584941 27441 heartbeater.cc:511] Master 127.26.191.254:35827 requested a full tablet report, sending...
I20260811 05:11:54.585386 26694 ts_manager.cc:194] Registered new tserver with Master: d161b402faf94a75a085a5cc52571303 (127.26.191.195:38739)
I20260811 05:11:54.585708 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 27230
I20260811 05:11:54.585737 26694 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.191.195:52353
I20260811 05:11:54.585830 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424853995437-27391-0/minicluster-data/ts-2/wal/instance
I20260811 05:11:54.586017 27391 external_mini_cluster.cc:1428] Setting key 3b1563ad8750f3d3ae51ccecf9799538
I20260811 05:11:54.586934 27391 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 05:11:54.591213 26752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:54.588357 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51134 (local address 127.26.191.254:35827)
0811 05:11:54.588417 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0811 05:11:54.588418 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 05:11:54.588527 (+ 109us) server_negotiation.cc:407] Connection header received
0811 05:11:54.588567 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:11:54.588568 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:11:54.588576 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:11:54.588629 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:11:54.588821 (+ 192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:54.589279 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:54.590003 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:54.590191 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:54.590254 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:54.591017 (+ 763us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:11:54.591018 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:11:54.591019 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:11:54.591023 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:11:54.591038 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:11:54.591041 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:11:54.591087 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0811 05:11:54.591139 (+ 52us) server_negotiation.cc:299] Negotiation successful
0811 05:11:54.591159 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260811 05:11:54.592693 26694 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51134:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 05:11:54.594316 26694 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 05:11:54.601505 27456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:54.596944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49720 (local address 127.26.191.193:39195)
0811 05:11:54.597301 (+ 357us) server_negotiation.cc:206] Beginning negotiation
0811 05:11:54.597307 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 05:11:54.597317 (+ 10us) server_negotiation.cc:407] Connection header received
0811 05:11:54.597357 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:11:54.597359 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:11:54.597376 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:11:54.597475 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:11:54.597690 (+ 215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:54.598848 (+ 1158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:54.600450 (+ 1602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:54.601055 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:54.601149 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:54.601255 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0811 05:11:54.601359 (+ 104us) server_negotiation.cc:299] Negotiation successful
0811 05:11:54.601401 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":310,"thread_start_us":138,"threads_started":1}
I20260811 05:11:54.601492 27453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:54.596588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.193:39195 (local address 127.0.0.1:49720)
0811 05:11:54.596922 (+ 334us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:54.596967 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 05:11:54.597040 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:11:54.597550 (+ 510us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:11:54.597550 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:11:54.597552 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:11:54.597601 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:54.597602 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:54.598956 (+ 1354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:54.598957 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:54.600338 (+ 1381us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:54.600341 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:54.601147 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:54.601148 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:54.601234 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:54.601248 (+ 14us) client_negotiation.cc:769] Sending connection context
0811 05:11:54.601343 (+ 95us) client_negotiation.cc:240] Negotiation successful
0811 05:11:54.601405 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":310,"mutex_wait_us":99,"thread_start_us":70,"threads_started":1}
I20260811 05:11:54.601933 27451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:54.596588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.195:38739 (local address 127.0.0.1:58448)
0811 05:11:54.596806 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:54.597188 (+ 382us) client_negotiation.cc:174] Beginning negotiation
0811 05:11:54.597234 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:11:54.597470 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:11:54.597473 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:11:54.597477 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:11:54.597555 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:54.597557 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:54.598951 (+ 1394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:54.598953 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:54.600183 (+ 1230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:54.600187 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:54.601464 (+ 1277us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:54.601466 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:54.601542 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:54.601546 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 05:11:54.601785 (+ 239us) client_negotiation.cc:240] Negotiation successful
0811 05:11:54.601834 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":187,"mutex_wait_us":28,"thread_start_us":67,"threads_started":1}
I20260811 05:11:54.602223 27454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:54.596695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33266 (local address 127.26.191.194:39083)
0811 05:11:54.597622 (+ 927us) server_negotiation.cc:206] Beginning negotiation
0811 05:11:54.597627 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:11:54.597638 (+ 11us) server_negotiation.cc:407] Connection header received
0811 05:11:54.597681 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:11:54.597683 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:11:54.597699 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:11:54.597793 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:11:54.597991 (+ 198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:54.598939 (+ 948us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:54.600432 (+ 1493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:54.601285 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:54.601374 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:54.601459 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0811 05:11:54.601986 (+ 527us) server_negotiation.cc:299] Negotiation successful
0811 05:11:54.602133 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":881,"thread_start_us":124,"threads_started":1}
I20260811 05:11:54.602314 27455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:54.596874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58448 (local address 127.26.191.195:38739)
0811 05:11:54.597092 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0811 05:11:54.597098 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 05:11:54.597252 (+ 154us) server_negotiation.cc:407] Connection header received
0811 05:11:54.597320 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:11:54.597323 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:11:54.597341 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:11:54.597436 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:11:54.597645 (+ 209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:54.598848 (+ 1203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:54.600287 (+ 1439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:54.601185 (+ 898us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:54.601285 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:54.601417 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0811 05:11:54.602158 (+ 741us) server_negotiation.cc:299] Negotiation successful
0811 05:11:54.602215 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":170,"thread_start_us":109,"threads_started":1}
I20260811 05:11:54.602355 27452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:54.596594 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.194:39083 (local address 127.0.0.1:33266)
0811 05:11:54.597074 (+ 480us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:54.597084 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 05:11:54.597127 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:11:54.597870 (+ 743us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:11:54.597871 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:11:54.597873 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:11:54.597912 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:54.597913 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:54.599014 (+ 1101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:54.599015 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:54.600338 (+ 1323us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:54.600341 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:54.601492 (+ 1151us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:54.601493 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:54.601548 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:54.601552 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 05:11:54.601847 (+ 295us) client_negotiation.cc:240] Negotiation successful
0811 05:11:54.601889 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":467,"mutex_wait_us":104,"thread_start_us":115,"threads_started":1}
I20260811 05:11:54.602375 26896 tablet_service.cc:1467] Processing CreateTablet for tablet ce0f990f391a4b8d92d58e149068a03c (DEFAULT_TABLE table=test-table [id=0c5f199fe8a54271ad0e284269d150b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:11:54.602849 26896 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce0f990f391a4b8d92d58e149068a03c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:11:54.603077 27320 tablet_service.cc:1467] Processing CreateTablet for tablet ce0f990f391a4b8d92d58e149068a03c (DEFAULT_TABLE table=test-table [id=0c5f199fe8a54271ad0e284269d150b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:11:54.603415 27320 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce0f990f391a4b8d92d58e149068a03c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:11:54.605986 27459 tablet_bootstrap.cc:492] T ce0f990f391a4b8d92d58e149068a03c P e318ed0fafff419f8e1ecf0f00d28f3d: Bootstrap starting.
I20260811 05:11:54.606257 27460 tablet_bootstrap.cc:492] T ce0f990f391a4b8d92d58e149068a03c P d161b402faf94a75a085a5cc52571303: Bootstrap starting.
I20260811 05:11:54.606791 27459 tablet_bootstrap.cc:654] T ce0f990f391a4b8d92d58e149068a03c P e318ed0fafff419f8e1ecf0f00d28f3d: Neither blocks nor log segments found. Creating new log.
I20260811 05:11:54.606709 27115 tablet_service.cc:1467] Processing CreateTablet for tablet ce0f990f391a4b8d92d58e149068a03c (DEFAULT_TABLE table=test-table [id=0c5f199fe8a54271ad0e284269d150b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:11:54.607003 27460 tablet_bootstrap.cc:654] T ce0f990f391a4b8d92d58e149068a03c P d161b402faf94a75a085a5cc52571303: Neither blocks nor log segments found. Creating new log.
I20260811 05:11:54.607074 27115 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce0f990f391a4b8d92d58e149068a03c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:11:54.607151 27459 log.cc:824] T ce0f990f391a4b8d92d58e149068a03c P e318ed0fafff419f8e1ecf0f00d28f3d: Log is configured to *not* fsync() on all Append() calls
I20260811 05:11:54.607334 27460 log.cc:824] T ce0f990f391a4b8d92d58e149068a03c P d161b402faf94a75a085a5cc52571303: Log is configured to *not* fsync() on all Append() calls
I20260811 05:11:54.607959 27459 tablet_bootstrap.cc:492] T ce0f990f391a4b8d92d58e149068a03c P e318ed0fafff419f8e1ecf0f00d28f3d: No bootstrap required, opened a new log
I20260811 05:11:54.608042 27459 ts_tablet_manager.cc:1397] T ce0f990f391a4b8d92d58e149068a03c P e318ed0fafff419f8e1ecf0f00d28f3d: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 05:11:54.608107 27460 tablet_bootstrap.cc:492] T ce0f990f391a4b8d92d58e149068a03c P d161b402faf94a75a085a5cc52571303: No bootstrap required, opened a new log
I20260811 05:11:54.608182 27460 ts_tablet_manager.cc:1397] T ce0f990f391a4b8d92d58e149068a03c P d161b402faf94a75a085a5cc52571303: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 05:11:54.610004 27459 raft_consensus.cc:348] T ce0f990f391a4b8d92d58e149068a03c P e318ed0fafff419f8e1ecf0f00d28f3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d161b402faf94a75a085a5cc52571303" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 38739 } } peers { permanent_uuid: "e318ed0fafff419f8e1ecf0f00d28f3d" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 39195 } } peers { permanent_uuid: "818366e15f584f549991e8a56dd301be" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 39083 } }
I20260811 05:11:54.610186 27459 raft_consensus.cc:374] T ce0f990f391a4b8d92d58e149068a03c P e318ed0fafff419f8e1ecf0f00d28f3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:11:54.610234 27459 raft_consensus.cc:729] T ce0f990f391a4b8d92d58e149068a03c P e318ed0fafff419f8e1ecf0f00d28f3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e318ed0fafff419f8e1ecf0f00d28f3d, State: Initialized, Role: FOLLOWER
I20260811 05:11:54.610349 27459 consensus_queue.cc:260] T ce0f990f391a4b8d92d58e149068a03c P e318ed0fafff419f8e1ecf0f00d28f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d161b402faf94a75a085a5cc52571303" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 38739 } } peers { permanent_uuid: "e318ed0fafff419f8e1ecf0f00d28f3d" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 39195 } } peers { permanent_uuid: "818366e15f584f549991e8a56dd301be" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 39083 } }
I20260811 05:11:54.610632 27459 ts_tablet_manager.cc:1428] T ce0f990f391a4b8d92d58e149068a03c P e318ed0fafff419f8e1ecf0f00d28f3d: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 05:11:54.610888 27012 heartbeater.cc:503] Master 127.26.191.254:35827 was elected leader, sending a full tablet report...
I20260811 05:11:54.610899 27466 tablet_bootstrap.cc:492] T ce0f990f391a4b8d92d58e149068a03c P 818366e15f584f549991e8a56dd301be: Bootstrap starting.
I20260811 05:11:54.611135 27460 raft_consensus.cc:348] T ce0f990f391a4b8d92d58e149068a03c P d161b402faf94a75a085a5cc52571303 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d161b402faf94a75a085a5cc52571303" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 38739 } } peers { permanent_uuid: "e318ed0fafff419f8e1ecf0f00d28f3d" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 39195 } } peers { permanent_uuid: "818366e15f584f549991e8a56dd301be" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 39083 } }
I20260811 05:11:54.611362 27460 raft_consensus.cc:374] T ce0f990f391a4b8d92d58e149068a03c P d161b402faf94a75a085a5cc52571303 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:11:54.611406 27460 raft_consensus.cc:729] T ce0f990f391a4b8d92d58e149068a03c P d161b402faf94a75a085a5cc52571303 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d161b402faf94a75a085a5cc52571303, State: Initialized, Role: FOLLOWER
I20260811 05:11:54.611574 27466 tablet_bootstrap.cc:654] T ce0f990f391a4b8d92d58e149068a03c P 818366e15f584f549991e8a56dd301be: Neither blocks nor log segments found. Creating new log.
I20260811 05:11:54.611630 27460 consensus_queue.cc:260] T ce0f990f391a4b8d92d58e149068a03c P d161b402faf94a75a085a5cc52571303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d161b402faf94a75a085a5cc52571303" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 38739 } } peers { permanent_uuid: "e318ed0fafff419f8e1ecf0f00d28f3d" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 39195 } } peers { permanent_uuid: "818366e15f584f549991e8a56dd301be" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 39083 } }
I20260811 05:11:54.611923 27460 ts_tablet_manager.cc:1428] T ce0f990f391a4b8d92d58e149068a03c P d161b402faf94a75a085a5cc52571303: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260811 05:11:54.611932 27466 log.cc:824] T ce0f990f391a4b8d92d58e149068a03c P 818366e15f584f549991e8a56dd301be: Log is configured to *not* fsync() on all Append() calls
I20260811 05:11:54.612087 27441 heartbeater.cc:503] Master 127.26.191.254:35827 was elected leader, sending a full tablet report...
I20260811 05:11:54.612699 27466 tablet_bootstrap.cc:492] T ce0f990f391a4b8d92d58e149068a03c P 818366e15f584f549991e8a56dd301be: No bootstrap required, opened a new log
I20260811 05:11:54.612809 27466 ts_tablet_manager.cc:1397] T ce0f990f391a4b8d92d58e149068a03c P 818366e15f584f549991e8a56dd301be: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 05:11:54.614630 27466 raft_consensus.cc:348] T ce0f990f391a4b8d92d58e149068a03c P 818366e15f584f549991e8a56dd301be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d161b402faf94a75a085a5cc52571303" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 38739 } } peers { permanent_uuid: "e318ed0fafff419f8e1ecf0f00d28f3d" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 39195 } } peers { permanent_uuid: "818366e15f584f549991e8a56dd301be" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 39083 } }
I20260811 05:11:54.614794 27466 raft_consensus.cc:374] T ce0f990f391a4b8d92d58e149068a03c P 818366e15f584f549991e8a56dd301be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:11:54.614837 27466 raft_consensus.cc:729] T ce0f990f391a4b8d92d58e149068a03c P 818366e15f584f549991e8a56dd301be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 818366e15f584f549991e8a56dd301be, State: Initialized, Role: FOLLOWER
I20260811 05:11:54.614944 27466 consensus_queue.cc:260] T ce0f990f391a4b8d92d58e149068a03c P 818366e15f584f549991e8a56dd301be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d161b402faf94a75a085a5cc52571303" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 38739 } } peers { permanent_uuid: "e318ed0fafff419f8e1ecf0f00d28f3d" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 39195 } } peers { permanent_uuid: "818366e15f584f549991e8a56dd301be" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 39083 } }
I20260811 05:11:54.615159 27466 ts_tablet_manager.cc:1428] T ce0f990f391a4b8d92d58e149068a03c P 818366e15f584f549991e8a56dd301be: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260811 05:11:54.615281 27221 heartbeater.cc:503] Master 127.26.191.254:35827 was elected leader, sending a full tablet report...
I20260811 05:11:54.645494 27471 raft_consensus.cc:482] T ce0f990f391a4b8d92d58e149068a03c P 818366e15f584f549991e8a56dd301be [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 05:11:54.645689 27471 raft_consensus.cc:504] T ce0f990f391a4b8d92d58e149068a03c P 818366e15f584f549991e8a56dd301be [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d161b402faf94a75a085a5cc52571303" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 38739 } } peers { permanent_uuid: "e318ed0fafff419f8e1ecf0f00d28f3d" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 39195 } } peers { permanent_uuid: "818366e15f584f549991e8a56dd301be" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 39083 } }
I20260811 05:11:54.646188 27471 leader_election.cc:288] T ce0f990f391a4b8d92d58e149068a03c P 818366e15f584f549991e8a56dd301be [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d161b402faf94a75a085a5cc52571303 (127.26.191.195:38739), e318ed0fafff419f8e1ecf0f00d28f3d (127.26.191.193:39195)
I20260811 05:11:54.649948 27455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:54.646497 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.194:47731 (local address 127.26.191.195:38739)
0811 05:11:54.646577 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0811 05:11:54.646579 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:11:54.646687 (+ 108us) server_negotiation.cc:407] Connection header received
0811 05:11:54.646808 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:11:54.646809 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:11:54.646820 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:11:54.646852 (+ 32us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:11:54.647049 (+ 197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:54.647630 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:54.649196 (+ 1566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:54.649574 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:54.649663 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:54.649672 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 05:11:54.649830 (+ 158us) server_negotiation.cc:299] Negotiation successful
0811 05:11:54.649874 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 05:11:54.649962 27472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:54.646362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.195:38739 (local address 127.26.191.194:47731)
0811 05:11:54.646625 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:54.646634 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 05:11:54.646700 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:11:54.646922 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:11:54.646922 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:11:54.646924 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:11:54.646980 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:54.646981 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:54.647726 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:54.647728 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:54.649127 (+ 1399us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:54.649130 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:54.649660 (+ 530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:54.649661 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:54.649750 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:54.649754 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 05:11:54.649823 (+ 69us) client_negotiation.cc:240] Negotiation successful
0811 05:11:54.649868 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":251,"mutex_wait_us":86,"thread_start_us":127,"threads_started":1}
I20260811 05:11:54.650285 27456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:54.646570 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.191.194:57227 (local address 127.26.191.193:39195)
0811 05:11:54.646619 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 05:11:54.646622 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:11:54.646632 (+ 10us) server_negotiation.cc:407] Connection header received
0811 05:11:54.646663 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:11:54.646664 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:11:54.646678 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:11:54.646753 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:11:54.646931 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:54.647796 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:54.649150 (+ 1354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:54.649831 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:54.649928 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:54.649937 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 05:11:54.650165 (+ 228us) server_negotiation.cc:299] Negotiation successful
0811 05:11:54.650214 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 05:11:54.650308 27224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:54.646360 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.193:39195 (local address 127.26.191.194:57227)
0811 05:11:54.646423 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:54.646435 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 05:11:54.646478 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:11:54.646765 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:11:54.646766 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:11:54.646768 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:11:54.646851 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:54.646853 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:54.647893 (+ 1040us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:54.647894 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:54.649055 (+ 1161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:11:54.649059 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:11:54.649980 (+ 921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:11:54.649982 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:11:54.650076 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:54.650080 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 05:11:54.650143 (+ 63us) client_negotiation.cc:240] Negotiation successful
0811 05:11:54.650197 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43,"mutex_wait_us":4}
I20260811 05:11:54.650640 27349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce0f990f391a4b8d92d58e149068a03c" candidate_uuid: "818366e15f584f549991e8a56dd301be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d161b402faf94a75a085a5cc52571303" is_pre_election: true
I20260811 05:11:54.650695 26928 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce0f990f391a4b8d92d58e149068a03c" candidate_uuid: "818366e15f584f549991e8a56dd301be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e318ed0fafff419f8e1ecf0f00d28f3d" is_pre_election: true
I20260811 05:11:54.650836 27349 raft_consensus.cc:2454] T ce0f990f391a4b8d92d58e149068a03c P d161b402faf94a75a085a5cc52571303 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 818366e15f584f549991e8a56dd301be in term 0.
I20260811 05:11:54.650879 26928 raft_consensus.cc:2454] T ce0f990f391a4b8d92d58e149068a03c P e318ed0fafff419f8e1ecf0f00d28f3d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 818366e15f584f549991e8a56dd301be in term 0.
I20260811 05:11:54.651124 27043 leader_election.cc:302] T ce0f990f391a4b8d92d58e149068a03c P 818366e15f584f549991e8a56dd301be [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 818366e15f584f549991e8a56dd301be, e318ed0fafff419f8e1ecf0f00d28f3d; no voters:
I20260811 05:11:54.651271 27471 raft_consensus.cc:2781] T ce0f990f391a4b8d92d58e149068a03c P 818366e15f584f549991e8a56dd301be [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 05:11:54.651331 27471 raft_consensus.cc:482] T ce0f990f391a4b8d92d58e149068a03c P 818366e15f584f549991e8a56dd301be [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 05:11:54.651357 27471 raft_consensus.cc:3037] T ce0f990f391a4b8d92d58e149068a03c P 818366e15f584f549991e8a56dd301be [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:11:54.652104 27471 raft_consensus.cc:504] T ce0f990f391a4b8d92d58e149068a03c P 818366e15f584f549991e8a56dd301be [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d161b402faf94a75a085a5cc52571303" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 38739 } } peers { permanent_uuid: "e318ed0fafff419f8e1ecf0f00d28f3d" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 39195 } } peers { permanent_uuid: "818366e15f584f549991e8a56dd301be" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 39083 } }
I20260811 05:11:54.652272 27471 leader_election.cc:288] T ce0f990f391a4b8d92d58e149068a03c P 818366e15f584f549991e8a56dd301be [CANDIDATE]: Term 1 election: Requested vote from peers d161b402faf94a75a085a5cc52571303 (127.26.191.195:38739), e318ed0fafff419f8e1ecf0f00d28f3d (127.26.191.193:39195)
I20260811 05:11:54.652459 27349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce0f990f391a4b8d92d58e149068a03c" candidate_uuid: "818366e15f584f549991e8a56dd301be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d161b402faf94a75a085a5cc52571303"
I20260811 05:11:54.652463 26928 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce0f990f391a4b8d92d58e149068a03c" candidate_uuid: "818366e15f584f549991e8a56dd301be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e318ed0fafff419f8e1ecf0f00d28f3d"
I20260811 05:11:54.652541 27349 raft_consensus.cc:3037] T ce0f990f391a4b8d92d58e149068a03c P d161b402faf94a75a085a5cc52571303 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:11:54.652542 26928 raft_consensus.cc:3037] T ce0f990f391a4b8d92d58e149068a03c P e318ed0fafff419f8e1ecf0f00d28f3d [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:11:54.653491 27349 raft_consensus.cc:2454] T ce0f990f391a4b8d92d58e149068a03c P d161b402faf94a75a085a5cc52571303 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 818366e15f584f549991e8a56dd301be in term 1.
I20260811 05:11:54.653491 26928 raft_consensus.cc:2454] T ce0f990f391a4b8d92d58e149068a03c P e318ed0fafff419f8e1ecf0f00d28f3d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 818366e15f584f549991e8a56dd301be in term 1.
I20260811 05:11:54.653667 27044 leader_election.cc:302] T ce0f990f391a4b8d92d58e149068a03c P 818366e15f584f549991e8a56dd301be [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 818366e15f584f549991e8a56dd301be, d161b402faf94a75a085a5cc52571303; no voters:
I20260811 05:11:54.653752 27471 raft_consensus.cc:2781] T ce0f990f391a4b8d92d58e149068a03c P 818366e15f584f549991e8a56dd301be [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:11:54.653946 27471 raft_consensus.cc:686] T ce0f990f391a4b8d92d58e149068a03c P 818366e15f584f549991e8a56dd301be [term 1 LEADER]: Becoming Leader. State: Replica: 818366e15f584f549991e8a56dd301be, State: Running, Role: LEADER
I20260811 05:11:54.654050 27471 consensus_queue.cc:237] T ce0f990f391a4b8d92d58e149068a03c P 818366e15f584f549991e8a56dd301be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d161b402faf94a75a085a5cc52571303" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 38739 } } peers { permanent_uuid: "e318ed0fafff419f8e1ecf0f00d28f3d" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 39195 } } peers { permanent_uuid: "818366e15f584f549991e8a56dd301be" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 39083 } }
I20260811 05:11:54.655036 26693 catalog_manager.cc:5495] T ce0f990f391a4b8d92d58e149068a03c P 818366e15f584f549991e8a56dd301be reported cstate change: term changed from 0 to 1, leader changed from <none> to 818366e15f584f549991e8a56dd301be (127.26.191.194). New cstate: current_term: 1 leader_uuid: "818366e15f584f549991e8a56dd301be" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d161b402faf94a75a085a5cc52571303" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 38739 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e318ed0fafff419f8e1ecf0f00d28f3d" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 39195 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "818366e15f584f549991e8a56dd301be" member_type: VOTER last_known_addr { host: "127.26.191.194" port: 39083 } health_report { overall_health: HEALTHY } } }
I20260811 05:11:54.663612 27454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:54.660280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33274 (local address 127.26.191.194:39083)
0811 05:11:54.660356 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0811 05:11:54.660358 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:11:54.660367 (+ 9us) server_negotiation.cc:407] Connection header received
0811 05:11:54.660400 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:11:54.660400 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:11:54.660420 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:11:54.660493 (+ 73us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:11:54.660664 (+ 171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:54.661364 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:54.662691 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:54.662929 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:54.663001 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:54.663226 (+ 225us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:11:54.663339 (+ 113us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:11:54.663418 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 05:11:54.663475 (+ 57us) server_negotiation.cc:299] Negotiation successful
0811 05:11:54.663497 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 05:11:54.665696 26928 raft_consensus.cc:1261] T ce0f990f391a4b8d92d58e149068a03c P e318ed0fafff419f8e1ecf0f00d28f3d [term 1 FOLLOWER]: Refusing update from remote peer 818366e15f584f549991e8a56dd301be: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:11:54.665804 27349 raft_consensus.cc:1261] T ce0f990f391a4b8d92d58e149068a03c P d161b402faf94a75a085a5cc52571303 [term 1 FOLLOWER]: Refusing update from remote peer 818366e15f584f549991e8a56dd301be: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:11:54.666102 27471 consensus_queue.cc:1035] T ce0f990f391a4b8d92d58e149068a03c P 818366e15f584f549991e8a56dd301be [LEADER]: Connected to new peer: Peer: permanent_uuid: "e318ed0fafff419f8e1ecf0f00d28f3d" member_type: VOTER last_known_addr { host: "127.26.191.193" port: 39195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:11:54.666270 27473 consensus_queue.cc:1035] T ce0f990f391a4b8d92d58e149068a03c P 818366e15f584f549991e8a56dd301be [LEADER]: Connected to new peer: Peer: permanent_uuid: "d161b402faf94a75a085a5cc52571303" member_type: VOTER last_known_addr { host: "127.26.191.195" port: 38739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:11:54.669320 27477 mvcc.cc:205] Tried to move back new op lower bound from 7317197269667799040 to 7317197269623717888. Current Snapshot: MvccSnapshot[applied={T|T < 7317197269667799040}]
I20260811 05:11:54.669699 27478 mvcc.cc:205] Tried to move back new op lower bound from 7317197269667799040 to 7317197269623717888. Current Snapshot: MvccSnapshot[applied={T|T < 7317197269667799040}]
I20260811 05:11:54.670889 27480 mvcc.cc:205] Tried to move back new op lower bound from 7317197269667799040 to 7317197269623717888. Current Snapshot: MvccSnapshot[applied={T|T < 7317197269667799040}]
I20260811 05:11:54.672645 26694 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51134:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:11:54.672776 26694 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51134:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:11:54.673677 26694 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 47896cc2e946416bbfde89b154b42acc: Sending DeleteTablet for 3 replicas of tablet ce0f990f391a4b8d92d58e149068a03c
I20260811 05:11:54.674129 26896 tablet_service.cc:1514] Processing DeleteTablet for tablet ce0f990f391a4b8d92d58e149068a03c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:11:54 UTC) from {username='slave'} at 127.0.0.1:49720
I20260811 05:11:54.674140 27320 tablet_service.cc:1514] Processing DeleteTablet for tablet ce0f990f391a4b8d92d58e149068a03c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:11:54 UTC) from {username='slave'} at 127.0.0.1:58448
I20260811 05:11:54.674479 27493 tablet_replica.cc:330] T ce0f990f391a4b8d92d58e149068a03c P e318ed0fafff419f8e1ecf0f00d28f3d: stopping tablet replica
I20260811 05:11:54.674546 27115 tablet_service.cc:1514] Processing DeleteTablet for tablet ce0f990f391a4b8d92d58e149068a03c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:11:54 UTC) from {username='slave'} at 127.0.0.1:33266
I20260811 05:11:54.674682 27493 raft_consensus.cc:2229] T ce0f990f391a4b8d92d58e149068a03c P e318ed0fafff419f8e1ecf0f00d28f3d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 05:11:54.674856 27493 raft_consensus.cc:2258] T ce0f990f391a4b8d92d58e149068a03c P e318ed0fafff419f8e1ecf0f00d28f3d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:11:54.674964 27497 tablet_replica.cc:330] T ce0f990f391a4b8d92d58e149068a03c P 818366e15f584f549991e8a56dd301be: stopping tablet replica
I20260811 05:11:54.675073 27497 raft_consensus.cc:2229] T ce0f990f391a4b8d92d58e149068a03c P 818366e15f584f549991e8a56dd301be [term 1 LEADER]: Raft consensus shutting down.
I20260811 05:11:54.675153 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 26780
I20260811 05:11:54.675184 27497 raft_consensus.cc:2258] T ce0f990f391a4b8d92d58e149068a03c P 818366e15f584f549991e8a56dd301be [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:11:54.675338 27494 tablet_replica.cc:330] T ce0f990f391a4b8d92d58e149068a03c P d161b402faf94a75a085a5cc52571303: stopping tablet replica
I20260811 05:11:54.675442 27494 raft_consensus.cc:2229] T ce0f990f391a4b8d92d58e149068a03c P d161b402faf94a75a085a5cc52571303 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 05:11:54.675546 27494 raft_consensus.cc:2258] T ce0f990f391a4b8d92d58e149068a03c P d161b402faf94a75a085a5cc52571303 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:11:54.676095 27497 ts_tablet_manager.cc:1905] T ce0f990f391a4b8d92d58e149068a03c P 818366e15f584f549991e8a56dd301be: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:11:54.678462 27497 ts_tablet_manager.cc:1918] T ce0f990f391a4b8d92d58e149068a03c P 818366e15f584f549991e8a56dd301be: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 05:11:54.678544 27497 log.cc:1196] T ce0f990f391a4b8d92d58e149068a03c P 818366e15f584f549991e8a56dd301be: Deleting WAL directory at /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424853995437-27391-0/minicluster-data/ts-1/wal/wals/ce0f990f391a4b8d92d58e149068a03c
I20260811 05:11:54.678781 27497 ts_tablet_manager.cc:1939] T ce0f990f391a4b8d92d58e149068a03c P 818366e15f584f549991e8a56dd301be: Deleting consensus metadata
I20260811 05:11:54.680907 26670 catalog_manager.cc:4841] TS 818366e15f584f549991e8a56dd301be (127.26.191.194:39083): tablet ce0f990f391a4b8d92d58e149068a03c (table test-table [id=0c5f199fe8a54271ad0e284269d150b3]) successfully deleted
I20260811 05:11:54.687619 27494 ts_tablet_manager.cc:1905] T ce0f990f391a4b8d92d58e149068a03c P d161b402faf94a75a085a5cc52571303: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:11:54.689318 27494 ts_tablet_manager.cc:1918] T ce0f990f391a4b8d92d58e149068a03c P d161b402faf94a75a085a5cc52571303: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 05:11:54.689425 27494 log.cc:1196] T ce0f990f391a4b8d92d58e149068a03c P d161b402faf94a75a085a5cc52571303: Deleting WAL directory at /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424853995437-27391-0/minicluster-data/ts-2/wal/wals/ce0f990f391a4b8d92d58e149068a03c
I20260811 05:11:54.689680 27494 ts_tablet_manager.cc:1939] T ce0f990f391a4b8d92d58e149068a03c P d161b402faf94a75a085a5cc52571303: Deleting consensus metadata
I20260811 05:11:54.690234 26673 catalog_manager.cc:4841] TS d161b402faf94a75a085a5cc52571303 (127.26.191.195:38739): tablet ce0f990f391a4b8d92d58e149068a03c (table test-table [id=0c5f199fe8a54271ad0e284269d150b3]) successfully deleted
W20260811 05:11:54.693339 26672 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.191.193:39195 (error 108)
I20260811 05:11:54.694029 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 27015
I20260811 05:11:54.694365 27452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:54.694195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.193:39195 (local address 127.0.0.1:49724)
0811 05:11:54.694265 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0811 05:11:54.694317 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.193:39195: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260811 05:11:54.694494 26672 catalog_manager.cc:4584] TS e318ed0fafff419f8e1ecf0f00d28f3d (127.26.191.193:39195): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ce0f990f391a4b8d92d58e149068a03c: Network error: Client connection negotiation failed: client connection to 127.26.191.193:39195: connect: Connection refused (error 111)
I20260811 05:11:54.711215 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 27230
I20260811 05:11:54.730674 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 26649
2026-08-11T05:11:54Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (796 ms)
[----------] 6 tests from EncryptionPolicyTest (9490 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786424853995437-27391-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 05:11:54 dist-test-slave-x5fp krb5kdc[27501](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 05:11:54 dist-test-slave-x5fp krb5kdc[27501](info): set up 2 sockets
Aug 11 05:11:54 dist-test-slave-x5fp krb5kdc[27501](info): commencing operation
krb5kdc: starting...
W20260811 05:11:56.079404 27391 mini_kdc.cc:121] Time spent starting KDC: real 1.318s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786424853995437-27391-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786424853995437-27391-0/krb5kdc/test-user.keytab.
Aug 11 05:11:56 dist-test-slave-x5fp krb5kdc[27501](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425116, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T05:11:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:11:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786424853995437-27391-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786424853995437-27391-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 05:11:56.220703 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786424853995437-27391-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786424853995437-27391-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786424853995437-27391-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43027
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786424853995437-27391-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41537
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43027
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:11:56.307654 27521 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:11:56.307904 27521 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:11:56.307928 27521 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:11:56.309247 27521 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:11:56.309302 27521 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:11:56.309319 27521 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:11:56.309331 27521 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:11:56.309343 27521 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:11:56.310910 27521 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41537
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786424853995437-27391-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786424853995437-27391-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43027
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786424853995437-27391-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43027
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27521
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786424853995437-27391-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:11:56.311180 27521 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:11:56.311450 27521 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:11:56.316694 27530 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:11:56.316666 27533 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:11:56.316675 27529 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:11:56.316962 27521 server_base.cc:1034] running on GCE node
I20260811 05:11:56.317318 27521 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:11:56.317623 27521 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:11:56.318804 27521 hybrid_clock.cc:648] HybridClock initialized: now 1786425116318780 us; error 38 us; skew 500 ppm
Aug 11 05:11:56 dist-test-slave-x5fp krb5kdc[27501](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425116, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:11:56.321496 27521 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 05:11:56.321970 27521 webserver.cc:460] Webserver started at http://127.0.0.1:34325/ using document root <none> and password file <none>
I20260811 05:11:56.322202 27521 fs_manager.cc:359] Metadata directory not provided
I20260811 05:11:56.322266 27521 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:11:56.322417 27521 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:11:56.323498 27521 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786424853995437-27391-0/minicluster-data/master-0/data/instance:
uuid: "03488238bcc44c2798dd18595a2a11ca"
format_stamp: "Formatted at 2026-08-11 05:11:56 on dist-test-slave-x5fp"
server_key: "7bf36548ff6419bfea82fe9c4901307f"
server_key_iv: "24e182f74979cf9ac2174e52f64534c0"
server_key_version: "encryptionkey@0"
I20260811 05:11:56.323868 27521 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786424853995437-27391-0/minicluster-data/master-0/wal/instance:
uuid: "03488238bcc44c2798dd18595a2a11ca"
format_stamp: "Formatted at 2026-08-11 05:11:56 on dist-test-slave-x5fp"
server_key: "7bf36548ff6419bfea82fe9c4901307f"
server_key_iv: "24e182f74979cf9ac2174e52f64534c0"
server_key_version: "encryptionkey@0"
I20260811 05:11:56.325344 27521 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 05:11:56.326073 27542 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:11:56.326249 27521 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 05:11:56.326370 27521 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786424853995437-27391-0/minicluster-data/master-0/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786424853995437-27391-0/minicluster-data/master-0/wal
uuid: "03488238bcc44c2798dd18595a2a11ca"
format_stamp: "Formatted at 2026-08-11 05:11:56 on dist-test-slave-x5fp"
server_key: "7bf36548ff6419bfea82fe9c4901307f"
server_key_iv: "24e182f74979cf9ac2174e52f64534c0"
server_key_version: "encryptionkey@0"
I20260811 05:11:56.326445 27521 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786424853995437-27391-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786424853995437-27391-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786424853995437-27391-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:11:56.337208 27521 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:11:56.339613 27521 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:11:56.339784 27521 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:11:56.344115 27521 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43027
I20260811 05:11:56.344151 27639 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43027 every 8 connection(s)
I20260811 05:11:56.344543 27521 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
I20260811 05:11:56.345497 27640 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:11:56.347105 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 27521
I20260811 05:11:56.347270 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786424853995437-27391-0/minicluster-data/master-0/wal/instance
I20260811 05:11:56.347461 27391 external_mini_cluster.cc:1428] Setting key 51d94f62d54e3395c0a8d4b6632b1a55
I20260811 05:11:56.347992 27640 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 03488238bcc44c2798dd18595a2a11ca: Bootstrap starting.
I20260811 05:11:56.348627 27640 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 03488238bcc44c2798dd18595a2a11ca: Neither blocks nor log segments found. Creating new log.
I20260811 05:11:56.348970 27640 log.cc:824] T 00000000000000000000000000000000 P 03488238bcc44c2798dd18595a2a11ca: Log is configured to *not* fsync() on all Append() calls
I20260811 05:11:56.349694 27640 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 03488238bcc44c2798dd18595a2a11ca: No bootstrap required, opened a new log
I20260811 05:11:56.351518 27640 raft_consensus.cc:348] T 00000000000000000000000000000000 P 03488238bcc44c2798dd18595a2a11ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03488238bcc44c2798dd18595a2a11ca" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43027 } }
I20260811 05:11:56.351682 27640 raft_consensus.cc:374] T 00000000000000000000000000000000 P 03488238bcc44c2798dd18595a2a11ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:11:56.351730 27640 raft_consensus.cc:729] T 00000000000000000000000000000000 P 03488238bcc44c2798dd18595a2a11ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03488238bcc44c2798dd18595a2a11ca, State: Initialized, Role: FOLLOWER
I20260811 05:11:56.351902 27640 consensus_queue.cc:260] T 00000000000000000000000000000000 P 03488238bcc44c2798dd18595a2a11ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03488238bcc44c2798dd18595a2a11ca" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43027 } }
I20260811 05:11:56.351996 27640 raft_consensus.cc:388] T 00000000000000000000000000000000 P 03488238bcc44c2798dd18595a2a11ca [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:11:56.352036 27640 raft_consensus.cc:482] T 00000000000000000000000000000000 P 03488238bcc44c2798dd18595a2a11ca [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:11:56.352078 27640 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 03488238bcc44c2798dd18595a2a11ca [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:11:56.352910 27640 raft_consensus.cc:504] T 00000000000000000000000000000000 P 03488238bcc44c2798dd18595a2a11ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03488238bcc44c2798dd18595a2a11ca" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43027 } }
I20260811 05:11:56.353039 27640 leader_election.cc:302] T 00000000000000000000000000000000 P 03488238bcc44c2798dd18595a2a11ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 03488238bcc44c2798dd18595a2a11ca; no voters:
I20260811 05:11:56.353222 27640 leader_election.cc:288] T 00000000000000000000000000000000 P 03488238bcc44c2798dd18595a2a11ca [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 05:11:56.353282 27647 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 03488238bcc44c2798dd18595a2a11ca [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:11:56.353466 27647 raft_consensus.cc:686] T 00000000000000000000000000000000 P 03488238bcc44c2798dd18595a2a11ca [term 1 LEADER]: Becoming Leader. State: Replica: 03488238bcc44c2798dd18595a2a11ca, State: Running, Role: LEADER
I20260811 05:11:56.353502 27640 sys_catalog.cc:564] T 00000000000000000000000000000000 P 03488238bcc44c2798dd18595a2a11ca [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:11:56.353572 27647 consensus_queue.cc:237] T 00000000000000000000000000000000 P 03488238bcc44c2798dd18595a2a11ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03488238bcc44c2798dd18595a2a11ca" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43027 } }
I20260811 05:11:56.353917 27647 sys_catalog.cc:455] T 00000000000000000000000000000000 P 03488238bcc44c2798dd18595a2a11ca [sys.catalog]: SysCatalogTable state changed. Reason: New leader 03488238bcc44c2798dd18595a2a11ca. Latest consensus state: current_term: 1 leader_uuid: "03488238bcc44c2798dd18595a2a11ca" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03488238bcc44c2798dd18595a2a11ca" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43027 } } }
I20260811 05:11:56.354000 27647 sys_catalog.cc:458] T 00000000000000000000000000000000 P 03488238bcc44c2798dd18595a2a11ca [sys.catalog]: This master's current role is: LEADER
I20260811 05:11:56.353930 27648 sys_catalog.cc:455] T 00000000000000000000000000000000 P 03488238bcc44c2798dd18595a2a11ca [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "03488238bcc44c2798dd18595a2a11ca" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03488238bcc44c2798dd18595a2a11ca" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43027 } } }
I20260811 05:11:56.354043 27648 sys_catalog.cc:458] T 00000000000000000000000000000000 P 03488238bcc44c2798dd18595a2a11ca [sys.catalog]: This master's current role is: LEADER
Aug 11 05:11:56 dist-test-slave-x5fp krb5kdc[27501](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425116, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 05:11:56.354424 27654 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:11:56.354964 27654 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:11:56.357822 27654 catalog_manager.cc:1347] Generated new cluster ID: b8cd00e4fe17431f9617671d900a702a
I20260811 05:11:56.357885 27654 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:11:56.358700 27645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:56.348042 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52879 (local address 127.0.0.1:43027)
0811 05:11:56.348222 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0811 05:11:56.348230 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 05:11:56.348256 (+ 26us) server_negotiation.cc:407] Connection header received
0811 05:11:56.348694 (+ 438us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:11:56.348700 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:11:56.348811 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:11:56.348963 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:11:56.349660 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:56.350603 (+ 943us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:56.351362 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:56.351857 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:56.351977 (+ 120us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:56.355034 (+ 3057us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:11:56.355038 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:11:56.355039 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:11:56.355053 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:11:56.357028 (+ 1975us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:11:56.357546 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:11:56.357549 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:11:56.357550 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:11:56.357656 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:11:56.357934 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:11:56.357935 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:11:56.357935 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:11:56.358194 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:11:56.358325 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0811 05:11:56.358465 (+ 140us) server_negotiation.cc:299] Negotiation successful
0811 05:11:56.358547 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":88,"threads_started":1}
I20260811 05:11:56.359915 27391 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 05:11:56.363067 27654 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:11:56.363761 27654 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:11:56.368655 27645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:56.361428 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50067 (local address 127.0.0.1:43027)
0811 05:11:56.361478 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 05:11:56.361480 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:11:56.361673 (+ 193us) server_negotiation.cc:407] Connection header received
0811 05:11:56.361716 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:11:56.361717 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:11:56.361729 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:11:56.361811 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:11:56.362434 (+ 623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:56.362959 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:56.363957 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:56.364281 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:56.364315 (+ 34us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:56.365839 (+ 1524us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:11:56.365840 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:11:56.365840 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:11:56.365846 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:11:56.367471 (+ 1625us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:11:56.367872 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:11:56.367873 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:11:56.367873 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:11:56.367921 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:11:56.368116 (+ 195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:11:56.368117 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:11:56.368117 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:11:56.368226 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:11:56.368296 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 05:11:56.368504 (+ 208us) server_negotiation.cc:299] Negotiation successful
0811 05:11:56.368565 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260811 05:11:56.369556 27654 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 03488238bcc44c2798dd18595a2a11ca: Generated new TSK 0
I20260811 05:11:56.369738 27654 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 05:11:56.373803 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 27521
W20260811 05:11:56.386404 27499 connection.cc:535] client connection to 127.0.0.1:43027 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:43027): Connection reset by peer (error 104)
2026-08-11T05:11:56Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1639 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786424853995437-27391-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 05:11:56 dist-test-slave-x5fp krb5kdc[27679](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 05:11:56 dist-test-slave-x5fp krb5kdc[27679](info): set up 2 sockets
Aug 11 05:11:56 dist-test-slave-x5fp krb5kdc[27679](info): commencing operation
krb5kdc: starting...
W20260811 05:11:57.719484 27391 mini_kdc.cc:121] Time spent starting KDC: real 1.319s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786424853995437-27391-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786424853995437-27391-0/krb5kdc/test-user.keytab.
Aug 11 05:11:57 dist-test-slave-x5fp krb5kdc[27679](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425117, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T05:11:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:11:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786424853995437-27391-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786424853995437-27391-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 05:11:57.853485 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786424853995437-27391-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786424853995437-27391-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786424853995437-27391-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34013
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786424853995437-27391-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37597
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34013
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:11:57.937561 27701 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:11:57.937786 27701 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:11:57.937810 27701 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:11:57.938992 27701 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:11:57.939038 27701 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:11:57.939051 27701 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:11:57.939064 27701 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:11:57.939076 27701 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:11:57.940588 27701 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37597
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786424853995437-27391-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786424853995437-27391-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34013
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786424853995437-27391-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34013
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27701
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786424853995437-27391-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:11:57.940869 27701 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:11:57.941097 27701 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:11:57.946199 27715 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:11:57.946307 27701 server_base.cc:1034] running on GCE node
W20260811 05:11:57.946184 27711 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:11:57.946183 27710 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:11:57.946712 27701 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:11:57.947014 27701 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:11:57.948180 27701 hybrid_clock.cc:648] HybridClock initialized: now 1786425117948134 us; error 68 us; skew 500 ppm
Aug 11 05:11:57 dist-test-slave-x5fp krb5kdc[27679](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425117, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:11:57.950878 27701 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 05:11:57.951401 27701 webserver.cc:460] Webserver started at http://127.0.0.1:37913/ using document root <none> and password file <none>
I20260811 05:11:57.951633 27701 fs_manager.cc:359] Metadata directory not provided
I20260811 05:11:57.951699 27701 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:11:57.951824 27701 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:11:57.953016 27701 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786424853995437-27391-0/minicluster-data/master-0/data/instance:
uuid: "e2fb70cb89774540b45dc4501b77bbe1"
format_stamp: "Formatted at 2026-08-11 05:11:57 on dist-test-slave-x5fp"
server_key: "9abd722fd0c3d35fb54bd867c27479cf"
server_key_iv: "5ccd1b3a10dfc1bd5d6ef79d391f8c08"
server_key_version: "encryptionkey@0"
I20260811 05:11:57.953397 27701 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786424853995437-27391-0/minicluster-data/master-0/wal/instance:
uuid: "e2fb70cb89774540b45dc4501b77bbe1"
format_stamp: "Formatted at 2026-08-11 05:11:57 on dist-test-slave-x5fp"
server_key: "9abd722fd0c3d35fb54bd867c27479cf"
server_key_iv: "5ccd1b3a10dfc1bd5d6ef79d391f8c08"
server_key_version: "encryptionkey@0"
I20260811 05:11:57.954849 27701 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 05:11:57.955793 27726 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:11:57.955993 27701 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:11:57.956120 27701 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786424853995437-27391-0/minicluster-data/master-0/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786424853995437-27391-0/minicluster-data/master-0/wal
uuid: "e2fb70cb89774540b45dc4501b77bbe1"
format_stamp: "Formatted at 2026-08-11 05:11:57 on dist-test-slave-x5fp"
server_key: "9abd722fd0c3d35fb54bd867c27479cf"
server_key_iv: "5ccd1b3a10dfc1bd5d6ef79d391f8c08"
server_key_version: "encryptionkey@0"
I20260811 05:11:57.956213 27701 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786424853995437-27391-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786424853995437-27391-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786424853995437-27391-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:11:57.969719 27701 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:11:57.972182 27701 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:11:57.972369 27701 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:11:57.976598 27701 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34013
I20260811 05:11:57.976652 27812 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34013 every 8 connection(s)
I20260811 05:11:57.977077 27701 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
I20260811 05:11:57.977993 27813 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:11:57.978649 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 27701
I20260811 05:11:57.978785 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786424853995437-27391-0/minicluster-data/master-0/wal/instance
I20260811 05:11:57.978971 27391 external_mini_cluster.cc:1428] Setting key b0975805fae9f9759f61f24de85e53e5
I20260811 05:11:57.981374 27813 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e2fb70cb89774540b45dc4501b77bbe1: Bootstrap starting.
I20260811 05:11:57.982139 27813 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e2fb70cb89774540b45dc4501b77bbe1: Neither blocks nor log segments found. Creating new log.
I20260811 05:11:57.982467 27813 log.cc:824] T 00000000000000000000000000000000 P e2fb70cb89774540b45dc4501b77bbe1: Log is configured to *not* fsync() on all Append() calls
I20260811 05:11:57.983265 27813 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e2fb70cb89774540b45dc4501b77bbe1: No bootstrap required, opened a new log
I20260811 05:11:57.985477 27821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:57.979543 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60417 (local address 127.0.0.1:34013)
0811 05:11:57.979795 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0811 05:11:57.979806 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 05:11:57.979841 (+ 35us) server_negotiation.cc:407] Connection header received
0811 05:11:57.980432 (+ 591us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:11:57.980441 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:11:57.980509 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:11:57.980665 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:11:57.980957 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:57.982360 (+ 1403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:57.983173 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:57.983785 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:57.983892 (+ 107us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:57.984621 (+ 729us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:11:57.984626 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:11:57.984626 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:11:57.984890 (+ 264us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:11:57.984939 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:11:57.984960 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:11:57.985058 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0811 05:11:57.985176 (+ 118us) server_negotiation.cc:299] Negotiation successful
0811 05:11:57.985211 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":196,"thread_start_us":133,"threads_started":1}
I20260811 05:11:57.985749 27813 raft_consensus.cc:348] T 00000000000000000000000000000000 P e2fb70cb89774540b45dc4501b77bbe1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2fb70cb89774540b45dc4501b77bbe1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34013 } }
I20260811 05:11:57.985949 27813 raft_consensus.cc:374] T 00000000000000000000000000000000 P e2fb70cb89774540b45dc4501b77bbe1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:11:57.985987 27813 raft_consensus.cc:729] T 00000000000000000000000000000000 P e2fb70cb89774540b45dc4501b77bbe1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2fb70cb89774540b45dc4501b77bbe1, State: Initialized, Role: FOLLOWER
I20260811 05:11:57.986102 27813 consensus_queue.cc:260] T 00000000000000000000000000000000 P e2fb70cb89774540b45dc4501b77bbe1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2fb70cb89774540b45dc4501b77bbe1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34013 } }
I20260811 05:11:57.986188 27813 raft_consensus.cc:388] T 00000000000000000000000000000000 P e2fb70cb89774540b45dc4501b77bbe1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:11:57.986228 27813 raft_consensus.cc:482] T 00000000000000000000000000000000 P e2fb70cb89774540b45dc4501b77bbe1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:11:57.986267 27813 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e2fb70cb89774540b45dc4501b77bbe1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:11:57.986742 27391 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 05:11:57.987051 27813 raft_consensus.cc:504] T 00000000000000000000000000000000 P e2fb70cb89774540b45dc4501b77bbe1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2fb70cb89774540b45dc4501b77bbe1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34013 } }
I20260811 05:11:57.987169 27813 leader_election.cc:302] T 00000000000000000000000000000000 P e2fb70cb89774540b45dc4501b77bbe1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e2fb70cb89774540b45dc4501b77bbe1; no voters:
I20260811 05:11:57.987361 27813 leader_election.cc:288] T 00000000000000000000000000000000 P e2fb70cb89774540b45dc4501b77bbe1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 05:11:57.987396 27823 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e2fb70cb89774540b45dc4501b77bbe1 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:11:57.987519 27823 raft_consensus.cc:686] T 00000000000000000000000000000000 P e2fb70cb89774540b45dc4501b77bbe1 [term 1 LEADER]: Becoming Leader. State: Replica: e2fb70cb89774540b45dc4501b77bbe1, State: Running, Role: LEADER
I20260811 05:11:57.987604 27823 consensus_queue.cc:237] T 00000000000000000000000000000000 P e2fb70cb89774540b45dc4501b77bbe1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2fb70cb89774540b45dc4501b77bbe1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34013 } }
I20260811 05:11:57.987632 27813 sys_catalog.cc:564] T 00000000000000000000000000000000 P e2fb70cb89774540b45dc4501b77bbe1 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:11:57.987934 27823 sys_catalog.cc:455] T 00000000000000000000000000000000 P e2fb70cb89774540b45dc4501b77bbe1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e2fb70cb89774540b45dc4501b77bbe1. Latest consensus state: current_term: 1 leader_uuid: "e2fb70cb89774540b45dc4501b77bbe1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2fb70cb89774540b45dc4501b77bbe1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34013 } } }
I20260811 05:11:57.988021 27823 sys_catalog.cc:458] T 00000000000000000000000000000000 P e2fb70cb89774540b45dc4501b77bbe1 [sys.catalog]: This master's current role is: LEADER
I20260811 05:11:57.987949 27824 sys_catalog.cc:455] T 00000000000000000000000000000000 P e2fb70cb89774540b45dc4501b77bbe1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e2fb70cb89774540b45dc4501b77bbe1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2fb70cb89774540b45dc4501b77bbe1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34013 } } }
I20260811 05:11:57.988222 27824 sys_catalog.cc:458] T 00000000000000000000000000000000 P e2fb70cb89774540b45dc4501b77bbe1 [sys.catalog]: This master's current role is: LEADER
I20260811 05:11:57.988245 27836 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:11:57.989311 27836 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:11:57.992491 27821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:57.988521 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46523 (local address 127.0.0.1:34013)
0811 05:11:57.988562 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 05:11:57.988564 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:11:57.988788 (+ 224us) server_negotiation.cc:407] Connection header received
0811 05:11:57.988952 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:11:57.988953 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:11:57.988967 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:11:57.988998 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:11:57.989277 (+ 279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:57.990106 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:57.991281 (+ 1175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:11:57.991488 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:11:57.991543 (+ 55us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:11:57.992239 (+ 696us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:11:57.992240 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:11:57.992240 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:11:57.992244 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:11:57.992257 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:11:57.992260 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:11:57.992308 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 05:11:57.992429 (+ 121us) server_negotiation.cc:299] Negotiation successful
0811 05:11:57.992439 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 05:11:57.996368 27836 catalog_manager.cc:1347] Generated new cluster ID: 6a0485ee1e284ff198e0dfb21b22794f
I20260811 05:11:57.996452 27836 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:11:58.002705 27836 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:11:58.003548 27836 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:11:58.016083 27836 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e2fb70cb89774540b45dc4501b77bbe1: Generated new TSK 0
I20260811 05:11:58.016319 27836 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 05:11:58.018584 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 27701
W20260811 05:11:58.034428 27676 connection.cc:535] client connection to 127.0.0.1:34013 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:34013): Connection reset by peer (error 104)
2026-08-11T05:11:58Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1648 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786424853995437-27391-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 05:11:58 dist-test-slave-x5fp krb5kdc[27863](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 05:11:58 dist-test-slave-x5fp krb5kdc[27863](info): set up 2 sockets
Aug 11 05:11:58 dist-test-slave-x5fp krb5kdc[27863](info): commencing operation
krb5kdc: starting...
W20260811 05:11:59.288408 27391 mini_kdc.cc:121] Time spent starting KDC: real 1.240s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786424853995437-27391-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786424853995437-27391-0/krb5kdc/test-user.keytab.
Aug 11 05:11:59 dist-test-slave-x5fp krb5kdc[27863](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425119, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T05:11:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:11:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786424853995437-27391-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786424853995437-27391-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 05:11:59.420492 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786424853995437-27391-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786424853995437-27391-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786424853995437-27391-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38681
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786424853995437-27391-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33687
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38681
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:11:59.503949 27888 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:11:59.504182 27888 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:11:59.504206 27888 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:11:59.505435 27888 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:11:59.505486 27888 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:11:59.505501 27888 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:11:59.505513 27888 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:11:59.505525 27888 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:11:59.506987 27888 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33687
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786424853995437-27391-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786424853995437-27391-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38681
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786424853995437-27391-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38681
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27888
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786424853995437-27391-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:11:59.507202 27888 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:11:59.507390 27888 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:11:59.512514 27893 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:11:59.512486 27895 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:11:59.512770 27888 server_base.cc:1034] running on GCE node
W20260811 05:11:59.512486 27897 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:11:59.513257 27888 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:11:59.513624 27888 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:11:59.514829 27888 hybrid_clock.cc:648] HybridClock initialized: now 1786425119514822 us; error 41 us; skew 500 ppm
Aug 11 05:11:59 dist-test-slave-x5fp krb5kdc[27863](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425119, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:11:59.523098 27888 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 05:11:59.523684 27888 webserver.cc:460] Webserver started at http://127.0.0.1:39257/ using document root <none> and password file <none>
I20260811 05:11:59.524008 27888 fs_manager.cc:359] Metadata directory not provided
I20260811 05:11:59.524087 27888 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:11:59.524253 27888 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:11:59.525518 27888 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786424853995437-27391-0/minicluster-data/master-0/data/instance:
uuid: "7ef8286a5fce4c569abb232107a67730"
format_stamp: "Formatted at 2026-08-11 05:11:59 on dist-test-slave-x5fp"
server_key: "5c2ea297ab256c4d47ac7d65e8e5ca9c"
server_key_iv: "2a31d08ec199abad5a37033cd69376c8"
server_key_version: "encryptionkey@0"
I20260811 05:11:59.525934 27888 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786424853995437-27391-0/minicluster-data/master-0/wal/instance:
uuid: "7ef8286a5fce4c569abb232107a67730"
format_stamp: "Formatted at 2026-08-11 05:11:59 on dist-test-slave-x5fp"
server_key: "5c2ea297ab256c4d47ac7d65e8e5ca9c"
server_key_iv: "2a31d08ec199abad5a37033cd69376c8"
server_key_version: "encryptionkey@0"
I20260811 05:11:59.527491 27888 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 05:11:59.528292 27911 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:11:59.528503 27888 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:11:59.528630 27888 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786424853995437-27391-0/minicluster-data/master-0/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786424853995437-27391-0/minicluster-data/master-0/wal
uuid: "7ef8286a5fce4c569abb232107a67730"
format_stamp: "Formatted at 2026-08-11 05:11:59 on dist-test-slave-x5fp"
server_key: "5c2ea297ab256c4d47ac7d65e8e5ca9c"
server_key_iv: "2a31d08ec199abad5a37033cd69376c8"
server_key_version: "encryptionkey@0"
I20260811 05:11:59.528714 27888 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786424853995437-27391-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786424853995437-27391-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786424853995437-27391-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:11:59.532531 27888 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:11:59.534725 27888 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:11:59.534929 27888 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:11:59.539480 27888 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38681
I20260811 05:11:59.539515 27994 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38681 every 8 connection(s)
I20260811 05:11:59.539915 27888 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
I20260811 05:11:59.541148 27995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:11:59.543635 27995 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7ef8286a5fce4c569abb232107a67730: Bootstrap starting.
I20260811 05:11:59.544250 27995 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7ef8286a5fce4c569abb232107a67730: Neither blocks nor log segments found. Creating new log.
I20260811 05:11:59.544508 27995 log.cc:824] T 00000000000000000000000000000000 P 7ef8286a5fce4c569abb232107a67730: Log is configured to *not* fsync() on all Append() calls
I20260811 05:11:59.545306 27995 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7ef8286a5fce4c569abb232107a67730: No bootstrap required, opened a new log
I20260811 05:11:59.545970 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 27888
I20260811 05:11:59.546108 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786424853995437-27391-0/minicluster-data/master-0/wal/instance
I20260811 05:11:59.546337 27391 external_mini_cluster.cc:1428] Setting key 760488bd810f46676d86574fc2cfe0b6
I20260811 05:11:59.547734 27995 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7ef8286a5fce4c569abb232107a67730 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ef8286a5fce4c569abb232107a67730" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38681 } }
I20260811 05:11:59.547936 27995 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7ef8286a5fce4c569abb232107a67730 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:11:59.547984 27995 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7ef8286a5fce4c569abb232107a67730 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ef8286a5fce4c569abb232107a67730, State: Initialized, Role: FOLLOWER
I20260811 05:11:59.548141 27995 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7ef8286a5fce4c569abb232107a67730 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ef8286a5fce4c569abb232107a67730" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38681 } }
I20260811 05:11:59.548266 27995 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7ef8286a5fce4c569abb232107a67730 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:11:59.548314 27995 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7ef8286a5fce4c569abb232107a67730 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:11:59.548367 27995 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7ef8286a5fce4c569abb232107a67730 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:11:59.549347 28006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:59.546923 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60067 (local address 127.0.0.1:38681)
0811 05:11:59.547109 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0811 05:11:59.547116 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 05:11:59.547147 (+ 31us) server_negotiation.cc:407] Connection header received
0811 05:11:59.547730 (+ 583us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:11:59.547740 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:11:59.547774 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:11:59.547913 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:11:59.548715 (+ 802us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:11:59.548779 (+ 64us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:11:59.548779 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:11:59.548785 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:11:59.548839 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:11:59.548857 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:11:59.548920 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 05:11:59.549031 (+ 111us) server_negotiation.cc:299] Negotiation successful
0811 05:11:59.549067 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":85,"threads_started":1}
I20260811 05:11:59.549659 27995 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7ef8286a5fce4c569abb232107a67730 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ef8286a5fce4c569abb232107a67730" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38681 } }
I20260811 05:11:59.549782 27995 leader_election.cc:302] T 00000000000000000000000000000000 P 7ef8286a5fce4c569abb232107a67730 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7ef8286a5fce4c569abb232107a67730; no voters:
I20260811 05:11:59.549974 27995 leader_election.cc:288] T 00000000000000000000000000000000 P 7ef8286a5fce4c569abb232107a67730 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 05:11:59.549999 28011 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7ef8286a5fce4c569abb232107a67730 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:11:59.550120 28011 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7ef8286a5fce4c569abb232107a67730 [term 1 LEADER]: Becoming Leader. State: Replica: 7ef8286a5fce4c569abb232107a67730, State: Running, Role: LEADER
I20260811 05:11:59.550211 28011 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7ef8286a5fce4c569abb232107a67730 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ef8286a5fce4c569abb232107a67730" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38681 } }
I20260811 05:11:59.550290 27995 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7ef8286a5fce4c569abb232107a67730 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:11:59.550355 27391 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 05:11:59.550606 28012 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7ef8286a5fce4c569abb232107a67730 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7ef8286a5fce4c569abb232107a67730. Latest consensus state: current_term: 1 leader_uuid: "7ef8286a5fce4c569abb232107a67730" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ef8286a5fce4c569abb232107a67730" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38681 } } }
I20260811 05:11:59.550680 28012 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7ef8286a5fce4c569abb232107a67730 [sys.catalog]: This master's current role is: LEADER
I20260811 05:11:59.550901 28014 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7ef8286a5fce4c569abb232107a67730 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7ef8286a5fce4c569abb232107a67730" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ef8286a5fce4c569abb232107a67730" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38681 } } }
I20260811 05:11:59.550961 28014 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7ef8286a5fce4c569abb232107a67730 [sys.catalog]: This master's current role is: LEADER
I20260811 05:11:59.550959 28019 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:11:59.552699 28019 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:11:59.553434 28006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:11:59.552063 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56985 (local address 127.0.0.1:38681)
0811 05:11:59.552098 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0811 05:11:59.552100 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:11:59.552289 (+ 189us) server_negotiation.cc:407] Connection header received
0811 05:11:59.552374 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:11:59.552375 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:11:59.552380 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:11:59.552452 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:11:59.553192 (+ 740us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:11:59.553193 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:11:59.553194 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:11:59.553198 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:11:59.553214 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:11:59.553218 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:11:59.553249 (+ 31us) server_negotiation.cc:1035] Waiting for connection context
0811 05:11:59.553355 (+ 106us) server_negotiation.cc:299] Negotiation successful
0811 05:11:59.553370 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260811 05:11:59.554557 28019 catalog_manager.cc:1347] Generated new cluster ID: 1354a9ed8144452c9028d7f5752af9a6
I20260811 05:11:59.554617 28019 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:11:59.567276 28019 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:11:59.567490 28019 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:11:59.573197 28019 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7ef8286a5fce4c569abb232107a67730: Generated new TSK 0
I20260811 05:11:59.573407 28019 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 05:11:59.578693 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 27888
2026-08-11T05:11:59Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1559 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786424853995437-27391-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 05:11:59 dist-test-slave-x5fp krb5kdc[28057](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 05:11:59 dist-test-slave-x5fp krb5kdc[28057](info): set up 2 sockets
Aug 11 05:11:59 dist-test-slave-x5fp krb5kdc[28057](info): commencing operation
krb5kdc: starting...
W20260811 05:12:00.887095 27391 mini_kdc.cc:121] Time spent starting KDC: real 1.280s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786424853995437-27391-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786424853995437-27391-0/krb5kdc/test-user.keytab.
Aug 11 05:12:00 dist-test-slave-x5fp krb5kdc[28057](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425120, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T05:12:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:12:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786424853995437-27391-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786424853995437-27391-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 05:12:01.028707 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786424853995437-27391-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786424853995437-27391-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786424853995437-27391-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44333
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786424853995437-27391-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41781
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44333
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:12:01.116449 28080 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:12:01.116698 28080 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:12:01.116778 28080 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:12:01.118013 28080 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:12:01.118062 28080 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:12:01.118076 28080 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:12:01.118089 28080 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:12:01.118126 28080 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:12:01.119724 28080 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41781
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786424853995437-27391-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786424853995437-27391-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44333
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786424853995437-27391-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44333
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28080
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786424853995437-27391-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:12:01.120015 28080 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:12:01.120277 28080 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:12:01.125589 28090 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:12:01.125582 28099 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:12:01.125582 28088 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:12:01.126081 28080 server_base.cc:1034] running on GCE node
I20260811 05:12:01.126415 28080 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:12:01.126726 28080 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:12:01.127918 28080 hybrid_clock.cc:648] HybridClock initialized: now 1786425121127884 us; error 51 us; skew 500 ppm
Aug 11 05:12:01 dist-test-slave-x5fp krb5kdc[28057](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425121, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:12:01.130728 28080 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 05:12:01.131309 28080 webserver.cc:460] Webserver started at http://127.0.0.1:40531/ using document root <none> and password file <none>
I20260811 05:12:01.131577 28080 fs_manager.cc:359] Metadata directory not provided
I20260811 05:12:01.131655 28080 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:12:01.131814 28080 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:12:01.133030 28080 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786424853995437-27391-0/minicluster-data/master-0/data/instance:
uuid: "9ed17320cc0e446ca52303de8d0df2d6"
format_stamp: "Formatted at 2026-08-11 05:12:01 on dist-test-slave-x5fp"
server_key: "c56f766a1d92f5b7bb89dee9f4764606"
server_key_iv: "31e8e06b8d2d0e49a8be83c1a4554ee7"
server_key_version: "encryptionkey@0"
I20260811 05:12:01.133411 28080 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786424853995437-27391-0/minicluster-data/master-0/wal/instance:
uuid: "9ed17320cc0e446ca52303de8d0df2d6"
format_stamp: "Formatted at 2026-08-11 05:12:01 on dist-test-slave-x5fp"
server_key: "c56f766a1d92f5b7bb89dee9f4764606"
server_key_iv: "31e8e06b8d2d0e49a8be83c1a4554ee7"
server_key_version: "encryptionkey@0"
I20260811 05:12:01.134912 28080 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 05:12:01.135720 28110 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:12:01.135947 28080 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:12:01.136060 28080 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786424853995437-27391-0/minicluster-data/master-0/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786424853995437-27391-0/minicluster-data/master-0/wal
uuid: "9ed17320cc0e446ca52303de8d0df2d6"
format_stamp: "Formatted at 2026-08-11 05:12:01 on dist-test-slave-x5fp"
server_key: "c56f766a1d92f5b7bb89dee9f4764606"
server_key_iv: "31e8e06b8d2d0e49a8be83c1a4554ee7"
server_key_version: "encryptionkey@0"
I20260811 05:12:01.136138 28080 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786424853995437-27391-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786424853995437-27391-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786424853995437-27391-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:12:01.158432 28080 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:12:01.160586 28080 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:12:01.160820 28080 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:12:01.165275 28080 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44333
I20260811 05:12:01.165321 28189 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44333 every 8 connection(s)
I20260811 05:12:01.165715 28080 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
I20260811 05:12:01.166695 28191 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:12:01.169271 28191 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9ed17320cc0e446ca52303de8d0df2d6: Bootstrap starting.
I20260811 05:12:01.169883 28191 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9ed17320cc0e446ca52303de8d0df2d6: Neither blocks nor log segments found. Creating new log.
I20260811 05:12:01.170189 28191 log.cc:824] T 00000000000000000000000000000000 P 9ed17320cc0e446ca52303de8d0df2d6: Log is configured to *not* fsync() on all Append() calls
I20260811 05:12:01.170948 28191 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9ed17320cc0e446ca52303de8d0df2d6: No bootstrap required, opened a new log
I20260811 05:12:01.172569 28191 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9ed17320cc0e446ca52303de8d0df2d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ed17320cc0e446ca52303de8d0df2d6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44333 } }
I20260811 05:12:01.172709 28191 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9ed17320cc0e446ca52303de8d0df2d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:12:01.172820 28191 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9ed17320cc0e446ca52303de8d0df2d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ed17320cc0e446ca52303de8d0df2d6, State: Initialized, Role: FOLLOWER
I20260811 05:12:01.172971 28191 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9ed17320cc0e446ca52303de8d0df2d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ed17320cc0e446ca52303de8d0df2d6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44333 } }
I20260811 05:12:01.173038 28191 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9ed17320cc0e446ca52303de8d0df2d6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:12:01.173080 28191 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9ed17320cc0e446ca52303de8d0df2d6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:12:01.173133 28191 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9ed17320cc0e446ca52303de8d0df2d6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:12:01.173735 28191 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9ed17320cc0e446ca52303de8d0df2d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ed17320cc0e446ca52303de8d0df2d6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44333 } }
I20260811 05:12:01.173827 28191 leader_election.cc:302] T 00000000000000000000000000000000 P 9ed17320cc0e446ca52303de8d0df2d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9ed17320cc0e446ca52303de8d0df2d6; no voters:
I20260811 05:12:01.174003 28191 leader_election.cc:288] T 00000000000000000000000000000000 P 9ed17320cc0e446ca52303de8d0df2d6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 05:12:01.174149 28197 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9ed17320cc0e446ca52303de8d0df2d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:12:01.174325 28197 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9ed17320cc0e446ca52303de8d0df2d6 [term 1 LEADER]: Becoming Leader. State: Replica: 9ed17320cc0e446ca52303de8d0df2d6, State: Running, Role: LEADER
I20260811 05:12:01.174400 28191 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9ed17320cc0e446ca52303de8d0df2d6 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:12:01.174424 28197 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9ed17320cc0e446ca52303de8d0df2d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ed17320cc0e446ca52303de8d0df2d6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44333 } }
I20260811 05:12:01.174831 28200 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ed17320cc0e446ca52303de8d0df2d6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9ed17320cc0e446ca52303de8d0df2d6. Latest consensus state: current_term: 1 leader_uuid: "9ed17320cc0e446ca52303de8d0df2d6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ed17320cc0e446ca52303de8d0df2d6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44333 } } }
I20260811 05:12:01.174917 28200 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ed17320cc0e446ca52303de8d0df2d6 [sys.catalog]: This master's current role is: LEADER
I20260811 05:12:01.174984 28198 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ed17320cc0e446ca52303de8d0df2d6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9ed17320cc0e446ca52303de8d0df2d6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ed17320cc0e446ca52303de8d0df2d6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44333 } } }
I20260811 05:12:01.175076 28198 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ed17320cc0e446ca52303de8d0df2d6 [sys.catalog]: This master's current role is: LEADER
I20260811 05:12:01.175426 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 28080
I20260811 05:12:01.175556 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786424853995437-27391-0/minicluster-data/master-0/wal/instance
I20260811 05:12:01.175630 28205 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:12:01.175758 27391 external_mini_cluster.cc:1428] Setting key ef455c4037b8df9d91a3f4c3de5c6c2c
I20260811 05:12:01.176327 28205 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:12:01.178455 28205 catalog_manager.cc:1347] Generated new cluster ID: bc645cc0abe446dc9d440c359c1ac702
I20260811 05:12:01.178515 28205 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 05:12:01 dist-test-slave-x5fp krb5kdc[28057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425120, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 05:12:01.188856 28222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:01.176506 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36321 (local address 127.0.0.1:44333)
0811 05:12:01.176922 (+ 416us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:01.176931 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:01.177132 (+ 201us) server_negotiation.cc:407] Connection header received
0811 05:12:01.177253 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:01.177280 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:01.177341 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:01.177491 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:12:01.178346 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:01.179813 (+ 1467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:01.180929 (+ 1116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:01.181617 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:01.181744 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:12:01.184709 (+ 2965us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:12:01.184714 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:12:01.184714 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:12:01.184754 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:12:01.186860 (+ 2106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:12:01.187357 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:12:01.187360 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:12:01.187360 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:12:01.187478 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:12:01.187701 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:12:01.187701 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:12:01.187702 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:12:01.188023 (+ 321us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:12:01.188174 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0811 05:12:01.188317 (+ 143us) server_negotiation.cc:299] Negotiation successful
0811 05:12:01.188572 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":365,"thread_start_us":77,"threads_started":1}
I20260811 05:12:01.190093 27391 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 05:12:01.193490 28205 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:12:01.194147 28205 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:12:01.200949 28205 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9ed17320cc0e446ca52303de8d0df2d6: Generated new TSK 0
I20260811 05:12:01.201162 28205 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 05:12:01.201539 28222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:01.191590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43653 (local address 127.0.0.1:44333)
0811 05:12:01.191627 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:01.191628 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:01.192934 (+ 1306us) server_negotiation.cc:407] Connection header received
0811 05:12:01.193027 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:01.193028 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:01.193037 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:01.193084 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:12:01.193923 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:01.194718 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:01.195719 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:01.196063 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:01.196141 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:12:01.197561 (+ 1420us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:12:01.197563 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:12:01.197563 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:12:01.197571 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:12:01.199963 (+ 2392us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:12:01.200360 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:12:01.200361 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:12:01.200362 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:12:01.200431 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:12:01.200694 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:12:01.200695 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:12:01.200696 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:12:01.200870 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:12:01.200996 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0811 05:12:01.201329 (+ 333us) server_negotiation.cc:299] Negotiation successful
0811 05:12:01.201441 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":22,"server-negotiator.queue_time_us":17}
I20260811 05:12:01.203811 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 28080
2026-08-11T05:12:01Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1622 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786424853995437-27391-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 05:12:01 dist-test-slave-x5fp krb5kdc[28235](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 05:12:01 dist-test-slave-x5fp krb5kdc[28235](info): set up 2 sockets
Aug 11 05:12:01 dist-test-slave-x5fp krb5kdc[28235](info): commencing operation
krb5kdc: starting...
W20260811 05:12:02.549695 27391 mini_kdc.cc:121] Time spent starting KDC: real 1.319s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786424853995437-27391-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786424853995437-27391-0/krb5kdc/test-user.keytab.
Aug 11 05:12:02 dist-test-slave-x5fp krb5kdc[28235](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425122, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T05:12:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:12:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786424853995437-27391-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786424853995437-27391-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 05:12:02.689491 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786424853995437-27391-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786424853995437-27391-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786424853995437-27391-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45615
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786424853995437-27391-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37425
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45615
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:12:02.775291 28259 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:12:02.775514 28259 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:12:02.775537 28259 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:12:02.776753 28259 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:12:02.776803 28259 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:12:02.776819 28259 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:12:02.776831 28259 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:12:02.776844 28259 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:12:02.778373 28259 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37425
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786424853995437-27391-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786424853995437-27391-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45615
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786424853995437-27391-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45615
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28259
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786424853995437-27391-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:12:02.778647 28259 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:12:02.778887 28259 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:12:02.784375 28268 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:12:02.784394 28271 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:12:02.784461 28259 server_base.cc:1034] running on GCE node
W20260811 05:12:02.784396 28274 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:12:02.784955 28259 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:12:02.785312 28259 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:12:02.786499 28259 hybrid_clock.cc:648] HybridClock initialized: now 1786425122786466 us; error 51 us; skew 500 ppm
Aug 11 05:12:02 dist-test-slave-x5fp krb5kdc[28235](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425122, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:12:02.789345 28259 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 05:12:02.789750 28259 webserver.cc:460] Webserver started at http://127.0.0.1:40587/ using document root <none> and password file <none>
I20260811 05:12:02.789989 28259 fs_manager.cc:359] Metadata directory not provided
I20260811 05:12:02.790038 28259 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:12:02.790172 28259 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:12:02.791285 28259 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786424853995437-27391-0/minicluster-data/master-0/data/instance:
uuid: "30fc218faa7240fd96e36d697827458e"
format_stamp: "Formatted at 2026-08-11 05:12:02 on dist-test-slave-x5fp"
server_key: "03a39a2e113c9c8ae0001b1fbd8ff950"
server_key_iv: "c5761ef73e5a40f069abecb40c62ff73"
server_key_version: "encryptionkey@0"
I20260811 05:12:02.791659 28259 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786424853995437-27391-0/minicluster-data/master-0/wal/instance:
uuid: "30fc218faa7240fd96e36d697827458e"
format_stamp: "Formatted at 2026-08-11 05:12:02 on dist-test-slave-x5fp"
server_key: "03a39a2e113c9c8ae0001b1fbd8ff950"
server_key_iv: "c5761ef73e5a40f069abecb40c62ff73"
server_key_version: "encryptionkey@0"
I20260811 05:12:02.793260 28259 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 05:12:02.794054 28284 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:12:02.794230 28259 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:12:02.794342 28259 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786424853995437-27391-0/minicluster-data/master-0/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786424853995437-27391-0/minicluster-data/master-0/wal
uuid: "30fc218faa7240fd96e36d697827458e"
format_stamp: "Formatted at 2026-08-11 05:12:02 on dist-test-slave-x5fp"
server_key: "03a39a2e113c9c8ae0001b1fbd8ff950"
server_key_iv: "c5761ef73e5a40f069abecb40c62ff73"
server_key_version: "encryptionkey@0"
I20260811 05:12:02.794420 28259 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786424853995437-27391-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786424853995437-27391-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786424853995437-27391-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:12:02.805599 28259 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:12:02.807996 28259 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:12:02.808166 28259 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:12:02.813167 28259 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45615
I20260811 05:12:02.813208 28367 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45615 every 8 connection(s)
I20260811 05:12:02.813624 28259 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
I20260811 05:12:02.814608 28369 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:12:02.815729 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 28259
I20260811 05:12:02.815882 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786424853995437-27391-0/minicluster-data/master-0/wal/instance
I20260811 05:12:02.816093 27391 external_mini_cluster.cc:1428] Setting key 2989b0043b16b6a0ca2a313597a5d37a
I20260811 05:12:02.817879 28369 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 30fc218faa7240fd96e36d697827458e: Bootstrap starting.
I20260811 05:12:02.818718 28369 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 30fc218faa7240fd96e36d697827458e: Neither blocks nor log segments found. Creating new log.
I20260811 05:12:02.819092 28369 log.cc:824] T 00000000000000000000000000000000 P 30fc218faa7240fd96e36d697827458e: Log is configured to *not* fsync() on all Append() calls
I20260811 05:12:02.819900 28369 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 30fc218faa7240fd96e36d697827458e: No bootstrap required, opened a new log
I20260811 05:12:02.822630 28369 raft_consensus.cc:348] T 00000000000000000000000000000000 P 30fc218faa7240fd96e36d697827458e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "30fc218faa7240fd96e36d697827458e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45615 } }
I20260811 05:12:02.822834 28369 raft_consensus.cc:374] T 00000000000000000000000000000000 P 30fc218faa7240fd96e36d697827458e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:12:02.822875 28369 raft_consensus.cc:729] T 00000000000000000000000000000000 P 30fc218faa7240fd96e36d697827458e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30fc218faa7240fd96e36d697827458e, State: Initialized, Role: FOLLOWER
I20260811 05:12:02.823109 28369 consensus_queue.cc:260] T 00000000000000000000000000000000 P 30fc218faa7240fd96e36d697827458e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "30fc218faa7240fd96e36d697827458e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45615 } }
I20260811 05:12:02.823244 28369 raft_consensus.cc:388] T 00000000000000000000000000000000 P 30fc218faa7240fd96e36d697827458e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:12:02.823287 28369 raft_consensus.cc:482] T 00000000000000000000000000000000 P 30fc218faa7240fd96e36d697827458e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:12:02.823338 28369 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 30fc218faa7240fd96e36d697827458e [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:12:02.823812 28374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:02.816748 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58459 (local address 127.0.0.1:45615)
0811 05:12:02.816953 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:02.816962 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:02.817016 (+ 54us) server_negotiation.cc:407] Connection header received
0811 05:12:02.817627 (+ 611us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:02.817635 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:02.817705 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:02.817835 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:12:02.818117 (+ 282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:02.819573 (+ 1456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:02.820561 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:02.821290 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:02.821411 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:12:02.822859 (+ 1448us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:12:02.822864 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:12:02.822864 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:12:02.823153 (+ 289us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:12:02.823231 (+ 78us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:12:02.823249 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:12:02.823341 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0811 05:12:02.823466 (+ 125us) server_negotiation.cc:299] Negotiation successful
0811 05:12:02.823544 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":144,"thread_start_us":105,"threads_started":1}
I20260811 05:12:02.824276 28369 raft_consensus.cc:504] T 00000000000000000000000000000000 P 30fc218faa7240fd96e36d697827458e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "30fc218faa7240fd96e36d697827458e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45615 } }
I20260811 05:12:02.824417 28369 leader_election.cc:302] T 00000000000000000000000000000000 P 30fc218faa7240fd96e36d697827458e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 30fc218faa7240fd96e36d697827458e; no voters:
I20260811 05:12:02.824599 28369 leader_election.cc:288] T 00000000000000000000000000000000 P 30fc218faa7240fd96e36d697827458e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 05:12:02.824904 28369 sys_catalog.cc:564] T 00000000000000000000000000000000 P 30fc218faa7240fd96e36d697827458e [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:12:02.825029 27391 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 05:12:02.825331 28378 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 30fc218faa7240fd96e36d697827458e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:12:02.825534 28378 raft_consensus.cc:686] T 00000000000000000000000000000000 P 30fc218faa7240fd96e36d697827458e [term 1 LEADER]: Becoming Leader. State: Replica: 30fc218faa7240fd96e36d697827458e, State: Running, Role: LEADER
I20260811 05:12:02.825650 28378 consensus_queue.cc:237] T 00000000000000000000000000000000 P 30fc218faa7240fd96e36d697827458e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "30fc218faa7240fd96e36d697827458e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45615 } }
I20260811 05:12:02.826048 28378 sys_catalog.cc:455] T 00000000000000000000000000000000 P 30fc218faa7240fd96e36d697827458e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "30fc218faa7240fd96e36d697827458e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "30fc218faa7240fd96e36d697827458e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45615 } } }
I20260811 05:12:02.826141 28378 sys_catalog.cc:458] T 00000000000000000000000000000000 P 30fc218faa7240fd96e36d697827458e [sys.catalog]: This master's current role is: LEADER
I20260811 05:12:02.826303 28378 sys_catalog.cc:455] T 00000000000000000000000000000000 P 30fc218faa7240fd96e36d697827458e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 30fc218faa7240fd96e36d697827458e. Latest consensus state: current_term: 1 leader_uuid: "30fc218faa7240fd96e36d697827458e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "30fc218faa7240fd96e36d697827458e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45615 } } }
I20260811 05:12:02.826543 28378 sys_catalog.cc:458] T 00000000000000000000000000000000 P 30fc218faa7240fd96e36d697827458e [sys.catalog]: This master's current role is: LEADER
I20260811 05:12:02.826691 28405 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:12:02.827190 28405 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:12:02.834355 28405 catalog_manager.cc:1347] Generated new cluster ID: ef6031715b154367ad4d02f88b108a29
I20260811 05:12:02.834442 28405 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:12:02.837903 28374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:02.828103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39505 (local address 127.0.0.1:45615)
0811 05:12:02.828152 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:02.828154 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:02.833844 (+ 5690us) server_negotiation.cc:407] Connection header received
0811 05:12:02.833883 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:02.833884 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:02.833896 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:02.834006 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:12:02.834188 (+ 182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:02.835027 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:02.836198 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:02.836531 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:02.836611 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:12:02.837612 (+ 1001us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:12:02.837613 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:12:02.837614 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:12:02.837619 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:12:02.837637 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:12:02.837641 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:12:02.837671 (+ 30us) server_negotiation.cc:1035] Waiting for connection context
0811 05:12:02.837781 (+ 110us) server_negotiation.cc:299] Negotiation successful
0811 05:12:02.837813 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 05:12:02.841095 28405 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:12:02.841744 28405 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:12:02.845535 28405 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 30fc218faa7240fd96e36d697827458e: Generated new TSK 0
I20260811 05:12:02.845728 28405 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 05:12:02.849829 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 28259
2026-08-11T05:12:02Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1653 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786424853995437-27391-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 05:12:02 dist-test-slave-x5fp krb5kdc[28421](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 05:12:02 dist-test-slave-x5fp krb5kdc[28421](info): set up 2 sockets
Aug 11 05:12:02 dist-test-slave-x5fp krb5kdc[28421](info): commencing operation
krb5kdc: starting...
W20260811 05:12:04.146463 27391 mini_kdc.cc:121] Time spent starting KDC: real 1.262s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786424853995437-27391-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786424853995437-27391-0/krb5kdc/test-user.keytab.
Aug 11 05:12:04 dist-test-slave-x5fp krb5kdc[28421](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425124, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T05:12:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:12:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786424853995437-27391-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786424853995437-27391-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 05:12:04.276381 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786424853995437-27391-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786424853995437-27391-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786424853995437-27391-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40243
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786424853995437-27391-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40723
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40243
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:12:04.361156 28443 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:12:04.361443 28443 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:12:04.361492 28443 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:12:04.362681 28443 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:12:04.362751 28443 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:12:04.362775 28443 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:12:04.362804 28443 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:12:04.362833 28443 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:12:04.364339 28443 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40723
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786424853995437-27391-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786424853995437-27391-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40243
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786424853995437-27391-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40243
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28443
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786424853995437-27391-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:12:04.364615 28443 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:12:04.364868 28443 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:12:04.370023 28449 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:12:04.369989 28452 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:12:04.370013 28454 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:12:04.370050 28443 server_base.cc:1034] running on GCE node
I20260811 05:12:04.370556 28443 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:12:04.370872 28443 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:12:04.372078 28443 hybrid_clock.cc:648] HybridClock initialized: now 1786425124372057 us; error 45 us; skew 500 ppm
Aug 11 05:12:04 dist-test-slave-x5fp krb5kdc[28421](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425124, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:12:04.374990 28443 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 05:12:04.375500 28443 webserver.cc:460] Webserver started at http://127.0.0.1:38191/ using document root <none> and password file <none>
I20260811 05:12:04.375787 28443 fs_manager.cc:359] Metadata directory not provided
I20260811 05:12:04.375842 28443 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:12:04.376026 28443 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:12:04.377308 28443 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786424853995437-27391-0/minicluster-data/master-0/data/instance:
uuid: "b71b303ea0cf4e0796c673dd128b833c"
format_stamp: "Formatted at 2026-08-11 05:12:04 on dist-test-slave-x5fp"
server_key: "f7cffaa8f7ffc4b9a25bbda8d1e6258f"
server_key_iv: "afec15adab555d6fe1884720af0ec433"
server_key_version: "encryptionkey@0"
I20260811 05:12:04.377714 28443 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786424853995437-27391-0/minicluster-data/master-0/wal/instance:
uuid: "b71b303ea0cf4e0796c673dd128b833c"
format_stamp: "Formatted at 2026-08-11 05:12:04 on dist-test-slave-x5fp"
server_key: "f7cffaa8f7ffc4b9a25bbda8d1e6258f"
server_key_iv: "afec15adab555d6fe1884720af0ec433"
server_key_version: "encryptionkey@0"
I20260811 05:12:04.379225 28443 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 05:12:04.380041 28466 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:12:04.380290 28443 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:12:04.380388 28443 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786424853995437-27391-0/minicluster-data/master-0/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786424853995437-27391-0/minicluster-data/master-0/wal
uuid: "b71b303ea0cf4e0796c673dd128b833c"
format_stamp: "Formatted at 2026-08-11 05:12:04 on dist-test-slave-x5fp"
server_key: "f7cffaa8f7ffc4b9a25bbda8d1e6258f"
server_key_iv: "afec15adab555d6fe1884720af0ec433"
server_key_version: "encryptionkey@0"
I20260811 05:12:04.380445 28443 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786424853995437-27391-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786424853995437-27391-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786424853995437-27391-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:12:04.383795 28443 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:12:04.386250 28443 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:12:04.386409 28443 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:12:04.390455 28443 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40243
I20260811 05:12:04.390515 28553 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40243 every 8 connection(s)
I20260811 05:12:04.390837 28443 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
I20260811 05:12:04.391963 28554 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:12:04.392426 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 28443
I20260811 05:12:04.392572 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786424853995437-27391-0/minicluster-data/master-0/wal/instance
I20260811 05:12:04.392809 27391 external_mini_cluster.cc:1428] Setting key dde5d082ddd5ee9388719782fbcc0fa5
I20260811 05:12:04.395295 28554 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b71b303ea0cf4e0796c673dd128b833c: Bootstrap starting.
I20260811 05:12:04.395504 28558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:04.393378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45465 (local address 127.0.0.1:40243)
0811 05:12:04.393568 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:04.393579 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:04.393616 (+ 37us) server_negotiation.cc:407] Connection header received
0811 05:12:04.394200 (+ 584us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:04.394209 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:04.394244 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:04.394409 (+ 165us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:12:04.395059 (+ 650us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:12:04.395063 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:12:04.395063 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:12:04.395068 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:12:04.395114 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:12:04.395129 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:12:04.395213 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0811 05:12:04.395250 (+ 37us) server_negotiation.cc:299] Negotiation successful
0811 05:12:04.395290 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":79,"threads_started":1}
I20260811 05:12:04.395985 28554 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b71b303ea0cf4e0796c673dd128b833c: Neither blocks nor log segments found. Creating new log.
I20260811 05:12:04.396335 28554 log.cc:824] T 00000000000000000000000000000000 P b71b303ea0cf4e0796c673dd128b833c: Log is configured to *not* fsync() on all Append() calls
I20260811 05:12:04.396526 27391 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 05:12:04.397176 28554 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b71b303ea0cf4e0796c673dd128b833c: No bootstrap required, opened a new log
I20260811 05:12:04.399214 28558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:04.397999 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60117 (local address 127.0.0.1:40243)
0811 05:12:04.398032 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:04.398034 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:04.398267 (+ 233us) server_negotiation.cc:407] Connection header received
0811 05:12:04.398341 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:04.398342 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:04.398348 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:04.398403 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:12:04.399018 (+ 615us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:12:04.399019 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:12:04.399019 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:12:04.399023 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:12:04.399038 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:12:04.399042 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:12:04.399088 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0811 05:12:04.399133 (+ 45us) server_negotiation.cc:299] Negotiation successful
0811 05:12:04.399148 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260811 05:12:04.399546 28554 raft_consensus.cc:348] T 00000000000000000000000000000000 P b71b303ea0cf4e0796c673dd128b833c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b71b303ea0cf4e0796c673dd128b833c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40243 } }
I20260811 05:12:04.399762 28554 raft_consensus.cc:374] T 00000000000000000000000000000000 P b71b303ea0cf4e0796c673dd128b833c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:12:04.399812 28554 raft_consensus.cc:729] T 00000000000000000000000000000000 P b71b303ea0cf4e0796c673dd128b833c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b71b303ea0cf4e0796c673dd128b833c, State: Initialized, Role: FOLLOWER
I20260811 05:12:04.399940 28554 consensus_queue.cc:260] T 00000000000000000000000000000000 P b71b303ea0cf4e0796c673dd128b833c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b71b303ea0cf4e0796c673dd128b833c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40243 } }
I20260811 05:12:04.400032 28554 raft_consensus.cc:388] T 00000000000000000000000000000000 P b71b303ea0cf4e0796c673dd128b833c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:12:04.400077 28554 raft_consensus.cc:482] T 00000000000000000000000000000000 P b71b303ea0cf4e0796c673dd128b833c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:12:04.400130 28554 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b71b303ea0cf4e0796c673dd128b833c [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:12:04.400707 28554 raft_consensus.cc:504] T 00000000000000000000000000000000 P b71b303ea0cf4e0796c673dd128b833c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b71b303ea0cf4e0796c673dd128b833c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40243 } }
I20260811 05:12:04.400892 28554 leader_election.cc:302] T 00000000000000000000000000000000 P b71b303ea0cf4e0796c673dd128b833c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b71b303ea0cf4e0796c673dd128b833c; no voters:
I20260811 05:12:04.401062 28554 leader_election.cc:288] T 00000000000000000000000000000000 P b71b303ea0cf4e0796c673dd128b833c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 05:12:04.401108 28567 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b71b303ea0cf4e0796c673dd128b833c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:12:04.401324 28567 raft_consensus.cc:686] T 00000000000000000000000000000000 P b71b303ea0cf4e0796c673dd128b833c [term 1 LEADER]: Becoming Leader. State: Replica: b71b303ea0cf4e0796c673dd128b833c, State: Running, Role: LEADER
I20260811 05:12:04.401351 28554 sys_catalog.cc:564] T 00000000000000000000000000000000 P b71b303ea0cf4e0796c673dd128b833c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:12:04.401485 28567 consensus_queue.cc:237] T 00000000000000000000000000000000 P b71b303ea0cf4e0796c673dd128b833c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b71b303ea0cf4e0796c673dd128b833c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40243 } }
I20260811 05:12:04.401911 28570 sys_catalog.cc:455] T 00000000000000000000000000000000 P b71b303ea0cf4e0796c673dd128b833c [sys.catalog]: SysCatalogTable state changed. Reason: New leader b71b303ea0cf4e0796c673dd128b833c. Latest consensus state: current_term: 1 leader_uuid: "b71b303ea0cf4e0796c673dd128b833c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b71b303ea0cf4e0796c673dd128b833c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40243 } } }
I20260811 05:12:04.401902 28568 sys_catalog.cc:455] T 00000000000000000000000000000000 P b71b303ea0cf4e0796c673dd128b833c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b71b303ea0cf4e0796c673dd128b833c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b71b303ea0cf4e0796c673dd128b833c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40243 } } }
I20260811 05:12:04.402159 28570 sys_catalog.cc:458] T 00000000000000000000000000000000 P b71b303ea0cf4e0796c673dd128b833c [sys.catalog]: This master's current role is: LEADER
I20260811 05:12:04.402179 28568 sys_catalog.cc:458] T 00000000000000000000000000000000 P b71b303ea0cf4e0796c673dd128b833c [sys.catalog]: This master's current role is: LEADER
I20260811 05:12:04.402777 28583 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:12:04.403337 28583 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:12:04.405220 28583 catalog_manager.cc:1347] Generated new cluster ID: 296a76dd6ca84d73987287554cdb4aa6
I20260811 05:12:04.405277 28583 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:12:04.411358 28583 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:12:04.411561 28583 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:12:04.418395 28583 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b71b303ea0cf4e0796c673dd128b833c: Generated new TSK 0
I20260811 05:12:04.418618 28583 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 05:12:04.422875 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 28443
2026-08-11T05:12:04Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1560 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786424853995437-27391-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 05:12:04 dist-test-slave-x5fp krb5kdc[28601](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 05:12:04 dist-test-slave-x5fp krb5kdc[28601](info): set up 2 sockets
Aug 11 05:12:04 dist-test-slave-x5fp krb5kdc[28601](info): commencing operation
krb5kdc: starting...
W20260811 05:12:05.705130 27391 mini_kdc.cc:121] Time spent starting KDC: real 1.260s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786424853995437-27391-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786424853995437-27391-0/krb5kdc/test-user.keytab.
Aug 11 05:12:05 dist-test-slave-x5fp krb5kdc[28601](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425125, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T05:12:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:12:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786424853995437-27391-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786424853995437-27391-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 05:12:05.839890 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786424853995437-27391-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786424853995437-27391-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786424853995437-27391-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36701
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786424853995437-27391-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40873
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36701
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:12:05.926790 28630 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:12:05.927063 28630 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:12:05.927101 28630 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:12:05.928292 28630 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:12:05.928364 28630 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:12:05.928386 28630 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:12:05.928406 28630 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:12:05.928434 28630 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:12:05.930008 28630 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40873
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786424853995437-27391-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786424853995437-27391-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36701
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786424853995437-27391-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36701
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28630
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786424853995437-27391-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:12:05.930320 28630 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:12:05.930568 28630 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:12:05.935753 28646 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:12:05.935770 28640 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:12:05.935786 28636 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:12:05.936051 28630 server_base.cc:1034] running on GCE node
I20260811 05:12:05.936363 28630 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:12:05.936662 28630 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:12:05.937841 28630 hybrid_clock.cc:648] HybridClock initialized: now 1786425125937826 us; error 31 us; skew 500 ppm
Aug 11 05:12:05 dist-test-slave-x5fp krb5kdc[28601](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425125, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:12:05.944469 28630 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 05:12:05.945061 28630 webserver.cc:460] Webserver started at http://127.0.0.1:35885/ using document root <none> and password file <none>
I20260811 05:12:05.945364 28630 fs_manager.cc:359] Metadata directory not provided
I20260811 05:12:05.945430 28630 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:12:05.945576 28630 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:12:05.946702 28630 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786424853995437-27391-0/minicluster-data/master-0/data/instance:
uuid: "ed85263812d444c5825b9916f164cd27"
format_stamp: "Formatted at 2026-08-11 05:12:05 on dist-test-slave-x5fp"
server_key: "5106f256c476d689530d82c7116a7767"
server_key_iv: "3fd03219cb6cef40d492524adb531906"
server_key_version: "encryptionkey@0"
I20260811 05:12:05.947101 28630 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786424853995437-27391-0/minicluster-data/master-0/wal/instance:
uuid: "ed85263812d444c5825b9916f164cd27"
format_stamp: "Formatted at 2026-08-11 05:12:05 on dist-test-slave-x5fp"
server_key: "5106f256c476d689530d82c7116a7767"
server_key_iv: "3fd03219cb6cef40d492524adb531906"
server_key_version: "encryptionkey@0"
I20260811 05:12:05.948673 28630 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 05:12:05.949613 28660 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:12:05.949905 28630 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:12:05.950023 28630 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786424853995437-27391-0/minicluster-data/master-0/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786424853995437-27391-0/minicluster-data/master-0/wal
uuid: "ed85263812d444c5825b9916f164cd27"
format_stamp: "Formatted at 2026-08-11 05:12:05 on dist-test-slave-x5fp"
server_key: "5106f256c476d689530d82c7116a7767"
server_key_iv: "3fd03219cb6cef40d492524adb531906"
server_key_version: "encryptionkey@0"
I20260811 05:12:05.950111 28630 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786424853995437-27391-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786424853995437-27391-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786424853995437-27391-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:12:05.959306 28630 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:12:05.962765 28630 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:12:05.962977 28630 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:12:05.971680 28630 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36701
I20260811 05:12:05.971724 28749 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36701 every 8 connection(s)
I20260811 05:12:05.972220 28630 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
I20260811 05:12:05.973606 28752 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:12:05.977545 28752 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ed85263812d444c5825b9916f164cd27: Bootstrap starting.
I20260811 05:12:05.981036 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 28630
I20260811 05:12:05.981177 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786424853995437-27391-0/minicluster-data/master-0/wal/instance
I20260811 05:12:05.981397 27391 external_mini_cluster.cc:1428] Setting key 7b2cd87cee5cfca37927a8ed3b405d4d
I20260811 05:12:05.981870 28752 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ed85263812d444c5825b9916f164cd27: Neither blocks nor log segments found. Creating new log.
I20260811 05:12:05.982581 28752 log.cc:824] T 00000000000000000000000000000000 P ed85263812d444c5825b9916f164cd27: Log is configured to *not* fsync() on all Append() calls
I20260811 05:12:05.983582 28752 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ed85263812d444c5825b9916f164cd27: No bootstrap required, opened a new log
I20260811 05:12:05.986217 28752 raft_consensus.cc:348] T 00000000000000000000000000000000 P ed85263812d444c5825b9916f164cd27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed85263812d444c5825b9916f164cd27" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36701 } }
I20260811 05:12:05.986402 28752 raft_consensus.cc:374] T 00000000000000000000000000000000 P ed85263812d444c5825b9916f164cd27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:12:05.986470 28752 raft_consensus.cc:729] T 00000000000000000000000000000000 P ed85263812d444c5825b9916f164cd27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed85263812d444c5825b9916f164cd27, State: Initialized, Role: FOLLOWER
I20260811 05:12:05.986624 28752 consensus_queue.cc:260] T 00000000000000000000000000000000 P ed85263812d444c5825b9916f164cd27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed85263812d444c5825b9916f164cd27" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36701 } }
I20260811 05:12:05.986742 28752 raft_consensus.cc:388] T 00000000000000000000000000000000 P ed85263812d444c5825b9916f164cd27 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:12:05.986817 28752 raft_consensus.cc:482] T 00000000000000000000000000000000 P ed85263812d444c5825b9916f164cd27 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:12:05.986876 28752 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ed85263812d444c5825b9916f164cd27 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:12:05.987737 28752 raft_consensus.cc:504] T 00000000000000000000000000000000 P ed85263812d444c5825b9916f164cd27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed85263812d444c5825b9916f164cd27" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36701 } }
I20260811 05:12:05.987931 28752 leader_election.cc:302] T 00000000000000000000000000000000 P ed85263812d444c5825b9916f164cd27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ed85263812d444c5825b9916f164cd27; no voters:
I20260811 05:12:05.988190 28752 leader_election.cc:288] T 00000000000000000000000000000000 P ed85263812d444c5825b9916f164cd27 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 05:12:05.988219 28759 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ed85263812d444c5825b9916f164cd27 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:12:05.988430 28759 raft_consensus.cc:686] T 00000000000000000000000000000000 P ed85263812d444c5825b9916f164cd27 [term 1 LEADER]: Becoming Leader. State: Replica: ed85263812d444c5825b9916f164cd27, State: Running, Role: LEADER
I20260811 05:12:05.988549 28752 sys_catalog.cc:564] T 00000000000000000000000000000000 P ed85263812d444c5825b9916f164cd27 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:12:05.988567 28759 consensus_queue.cc:237] T 00000000000000000000000000000000 P ed85263812d444c5825b9916f164cd27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed85263812d444c5825b9916f164cd27" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36701 } }
I20260811 05:12:05.989089 28761 sys_catalog.cc:455] T 00000000000000000000000000000000 P ed85263812d444c5825b9916f164cd27 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ed85263812d444c5825b9916f164cd27. Latest consensus state: current_term: 1 leader_uuid: "ed85263812d444c5825b9916f164cd27" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed85263812d444c5825b9916f164cd27" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36701 } } }
I20260811 05:12:05.989190 28761 sys_catalog.cc:458] T 00000000000000000000000000000000 P ed85263812d444c5825b9916f164cd27 [sys.catalog]: This master's current role is: LEADER
I20260811 05:12:05.989441 28760 sys_catalog.cc:455] T 00000000000000000000000000000000 P ed85263812d444c5825b9916f164cd27 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ed85263812d444c5825b9916f164cd27" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed85263812d444c5825b9916f164cd27" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36701 } } }
I20260811 05:12:05.989828 28760 sys_catalog.cc:458] T 00000000000000000000000000000000 P ed85263812d444c5825b9916f164cd27 [sys.catalog]: This master's current role is: LEADER
W20260811 05:12:05.990602 28782 catalog_manager.cc:1558] T 00000000000000000000000000000000 P ed85263812d444c5825b9916f164cd27: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 05:12:05.990701 28782 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 05:12:05.990798 28773 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
Aug 11 05:12:05 dist-test-slave-x5fp krb5kdc[28601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425125, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 05:12:05.990990 28773 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:12:05.992774 28773 catalog_manager.cc:1347] Generated new cluster ID: 6f1a24f6ba83455aa508af40abb47633
I20260811 05:12:05.992835 28773 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:12:06.002238 28756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:05.982072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.203:39871 (local address 127.0.0.1:36701)
0811 05:12:05.982305 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:05.982316 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:05.982362 (+ 46us) server_negotiation.cc:407] Connection header received
0811 05:12:05.983090 (+ 728us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:05.983100 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:05.983174 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:05.983351 (+ 177us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:12:05.984271 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:05.985848 (+ 1577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:05.987062 (+ 1214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:05.987696 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:05.987867 (+ 171us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:12:05.991478 (+ 3611us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:12:05.991484 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:12:05.991484 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:12:05.991499 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:12:05.999945 (+ 8446us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:12:06.000661 (+ 716us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:12:06.000665 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:12:06.000665 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:12:06.000829 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:12:06.001072 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:12:06.001074 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:12:06.001074 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:12:06.001453 (+ 379us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:12:06.001642 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0811 05:12:06.001825 (+ 183us) server_negotiation.cc:299] Negotiation successful
0811 05:12:06.001943 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":173,"thread_start_us":116,"threads_started":1}
I20260811 05:12:06.003362 27391 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 05:12:06.011588 28773 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:12:06.012547 28773 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:12:06.019193 28773 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ed85263812d444c5825b9916f164cd27: Generated new TSK 0
I20260811 05:12:06.019433 28773 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 05:12:06.020437 28756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:06.005028 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.203:33471 (local address 127.0.0.1:36701)
0811 05:12:06.005068 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:06.005070 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:06.011568 (+ 6498us) server_negotiation.cc:407] Connection header received
0811 05:12:06.011685 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:06.011686 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:06.011699 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:06.011773 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:12:06.012598 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:06.013785 (+ 1187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:06.014937 (+ 1152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:06.015282 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:06.015358 (+ 76us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:12:06.017052 (+ 1694us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:12:06.017054 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:12:06.017054 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:12:06.017063 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:12:06.018924 (+ 1861us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:12:06.019494 (+ 570us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:12:06.019496 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:12:06.019496 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:12:06.019566 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:12:06.019850 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:12:06.019851 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:12:06.019851 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:12:06.019992 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:12:06.020121 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0811 05:12:06.020226 (+ 105us) server_negotiation.cc:299] Negotiation successful
0811 05:12:06.020298 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 05:12:06.022805 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 28630
W20260811 05:12:06.038483 28597 connection.cc:535] client connection to 127.0.0.1:36701 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:36701): Connection reset by peer (error 104)
2026-08-11T05:12:06Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1607 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786424853995437-27391-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 05:12:06 dist-test-slave-x5fp krb5kdc[28798](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 05:12:06 dist-test-slave-x5fp krb5kdc[28798](info): set up 2 sockets
Aug 11 05:12:06 dist-test-slave-x5fp krb5kdc[28798](info): commencing operation
krb5kdc: starting...
W20260811 05:12:07.345467 27391 mini_kdc.cc:121] Time spent starting KDC: real 1.293s user 0.001s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786424853995437-27391-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786424853995437-27391-0/krb5kdc/test-user.keytab.
Aug 11 05:12:07 dist-test-slave-x5fp krb5kdc[28798](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425127, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T05:12:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:12:07Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786424853995437-27391-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786424853995437-27391-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 05:12:07.488709 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786424853995437-27391-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786424853995437-27391-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786424853995437-27391-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33499
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786424853995437-27391-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39765
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33499
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:12:07.574843 28826 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:12:07.575109 28826 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:12:07.575153 28826 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:12:07.576380 28826 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:12:07.576462 28826 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:12:07.576485 28826 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:12:07.576505 28826 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:12:07.576536 28826 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:12:07.578141 28826 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39765
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786424853995437-27391-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786424853995437-27391-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33499
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786424853995437-27391-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33499
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28826
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786424853995437-27391-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:12:07.578452 28826 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:12:07.578708 28826 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:12:07.583891 28840 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:12:07.583920 28826 server_base.cc:1034] running on GCE node
W20260811 05:12:07.583950 28837 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:12:07.583891 28835 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:12:07.584455 28826 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:12:07.584836 28826 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:12:07.585990 28826 hybrid_clock.cc:648] HybridClock initialized: now 1786425127585979 us; error 33 us; skew 500 ppm
Aug 11 05:12:07 dist-test-slave-x5fp krb5kdc[28798](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425127, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:12:07.588889 28826 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 05:12:07.589385 28826 webserver.cc:460] Webserver started at http://127.0.0.1:35989/ using document root <none> and password file <none>
I20260811 05:12:07.589653 28826 fs_manager.cc:359] Metadata directory not provided
I20260811 05:12:07.589725 28826 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:12:07.589879 28826 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:12:07.590969 28826 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786424853995437-27391-0/minicluster-data/master-0/data/instance:
uuid: "8ffac585ceb049b2a0b947aa4e3c00dd"
format_stamp: "Formatted at 2026-08-11 05:12:07 on dist-test-slave-x5fp"
server_key: "9ef6e8b8ab399412ec96eca34f91e745"
server_key_iv: "225bd8013528ade5b8834c4847cc0636"
server_key_version: "encryptionkey@0"
I20260811 05:12:07.591341 28826 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786424853995437-27391-0/minicluster-data/master-0/wal/instance:
uuid: "8ffac585ceb049b2a0b947aa4e3c00dd"
format_stamp: "Formatted at 2026-08-11 05:12:07 on dist-test-slave-x5fp"
server_key: "9ef6e8b8ab399412ec96eca34f91e745"
server_key_iv: "225bd8013528ade5b8834c4847cc0636"
server_key_version: "encryptionkey@0"
I20260811 05:12:07.592846 28826 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 05:12:07.593712 28852 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:12:07.593935 28826 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:12:07.594048 28826 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786424853995437-27391-0/minicluster-data/master-0/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786424853995437-27391-0/minicluster-data/master-0/wal
uuid: "8ffac585ceb049b2a0b947aa4e3c00dd"
format_stamp: "Formatted at 2026-08-11 05:12:07 on dist-test-slave-x5fp"
server_key: "9ef6e8b8ab399412ec96eca34f91e745"
server_key_iv: "225bd8013528ade5b8834c4847cc0636"
server_key_version: "encryptionkey@0"
I20260811 05:12:07.594156 28826 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786424853995437-27391-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786424853995437-27391-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786424853995437-27391-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:12:07.624806 28826 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:12:07.627415 28826 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:12:07.627600 28826 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:12:07.631783 28826 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33499
I20260811 05:12:07.631821 28940 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33499 every 8 connection(s)
I20260811 05:12:07.632220 28826 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
I20260811 05:12:07.633230 28941 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:12:07.635578 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 28826
I20260811 05:12:07.635716 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786424853995437-27391-0/minicluster-data/master-0/wal/instance
I20260811 05:12:07.635759 28941 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8ffac585ceb049b2a0b947aa4e3c00dd: Bootstrap starting.
I20260811 05:12:07.635914 27391 external_mini_cluster.cc:1428] Setting key b4dcc2928113be38c6bcc68965bbcd6f
I20260811 05:12:07.636543 28941 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8ffac585ceb049b2a0b947aa4e3c00dd: Neither blocks nor log segments found. Creating new log.
I20260811 05:12:07.636912 28941 log.cc:824] T 00000000000000000000000000000000 P 8ffac585ceb049b2a0b947aa4e3c00dd: Log is configured to *not* fsync() on all Append() calls
I20260811 05:12:07.637739 28941 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8ffac585ceb049b2a0b947aa4e3c00dd: No bootstrap required, opened a new log
I20260811 05:12:07.640017 28941 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8ffac585ceb049b2a0b947aa4e3c00dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ffac585ceb049b2a0b947aa4e3c00dd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33499 } }
I20260811 05:12:07.640172 28941 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8ffac585ceb049b2a0b947aa4e3c00dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:12:07.640194 28941 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8ffac585ceb049b2a0b947aa4e3c00dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ffac585ceb049b2a0b947aa4e3c00dd, State: Initialized, Role: FOLLOWER
I20260811 05:12:07.640357 28941 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8ffac585ceb049b2a0b947aa4e3c00dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ffac585ceb049b2a0b947aa4e3c00dd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33499 } }
I20260811 05:12:07.640421 28941 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8ffac585ceb049b2a0b947aa4e3c00dd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:12:07.640476 28941 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8ffac585ceb049b2a0b947aa4e3c00dd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:12:07.640528 28941 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8ffac585ceb049b2a0b947aa4e3c00dd [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:12:07.641376 28941 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8ffac585ceb049b2a0b947aa4e3c00dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ffac585ceb049b2a0b947aa4e3c00dd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33499 } }
I20260811 05:12:07.641489 28941 leader_election.cc:302] T 00000000000000000000000000000000 P 8ffac585ceb049b2a0b947aa4e3c00dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8ffac585ceb049b2a0b947aa4e3c00dd; no voters:
I20260811 05:12:07.641678 28941 leader_election.cc:288] T 00000000000000000000000000000000 P 8ffac585ceb049b2a0b947aa4e3c00dd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 05:12:07.641726 28949 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8ffac585ceb049b2a0b947aa4e3c00dd [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:12:07.641897 28949 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8ffac585ceb049b2a0b947aa4e3c00dd [term 1 LEADER]: Becoming Leader. State: Replica: 8ffac585ceb049b2a0b947aa4e3c00dd, State: Running, Role: LEADER
I20260811 05:12:07.641969 28941 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8ffac585ceb049b2a0b947aa4e3c00dd [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:12:07.642009 28949 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8ffac585ceb049b2a0b947aa4e3c00dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ffac585ceb049b2a0b947aa4e3c00dd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33499 } }
I20260811 05:12:07.642379 28946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:07.636476 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.203:60159 (local address 127.0.0.1:33499)
0811 05:12:07.636776 (+ 300us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:07.636786 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:07.636826 (+ 40us) server_negotiation.cc:407] Connection header received
0811 05:12:07.637329 (+ 503us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:07.637337 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:07.637388 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:07.637535 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:12:07.637856 (+ 321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:07.638742 (+ 886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:07.639968 (+ 1226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:07.640537 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:07.640655 (+ 118us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:12:07.641366 (+ 711us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:12:07.641369 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:12:07.641369 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:12:07.641599 (+ 230us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:12:07.641639 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:12:07.641678 (+ 39us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:12:07.642062 (+ 384us) server_negotiation.cc:1035] Waiting for connection context
0811 05:12:07.642109 (+ 47us) server_negotiation.cc:299] Negotiation successful
0811 05:12:07.642162 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":207,"thread_start_us":91,"threads_started":1}
I20260811 05:12:07.642467 28950 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8ffac585ceb049b2a0b947aa4e3c00dd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8ffac585ceb049b2a0b947aa4e3c00dd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ffac585ceb049b2a0b947aa4e3c00dd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33499 } } }
I20260811 05:12:07.642558 28950 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8ffac585ceb049b2a0b947aa4e3c00dd [sys.catalog]: This master's current role is: LEADER
I20260811 05:12:07.642689 28955 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8ffac585ceb049b2a0b947aa4e3c00dd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8ffac585ceb049b2a0b947aa4e3c00dd. Latest consensus state: current_term: 1 leader_uuid: "8ffac585ceb049b2a0b947aa4e3c00dd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ffac585ceb049b2a0b947aa4e3c00dd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33499 } } }
I20260811 05:12:07.642766 28955 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8ffac585ceb049b2a0b947aa4e3c00dd [sys.catalog]: This master's current role is: LEADER
I20260811 05:12:07.643244 28961 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:12:07.643383 27391 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 05:12:07.643872 28961 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:12:07.645536 28961 catalog_manager.cc:1347] Generated new cluster ID: e7966afb0253455c826fd7e4337183f9
I20260811 05:12:07.645589 28961 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:12:07.655443 28946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:07.644951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.203:40017 (local address 127.0.0.1:33499)
0811 05:12:07.644983 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:07.644985 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:07.651702 (+ 6717us) server_negotiation.cc:407] Connection header received
0811 05:12:07.651777 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:07.651778 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:07.651792 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:07.651862 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:12:07.652042 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:07.652872 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:07.653958 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:07.654300 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:07.654360 (+ 60us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:12:07.655168 (+ 808us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:12:07.655170 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:12:07.655170 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:12:07.655176 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:12:07.655194 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:12:07.655198 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:12:07.655259 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 05:12:07.655340 (+ 81us) server_negotiation.cc:299] Negotiation successful
0811 05:12:07.655351 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260811 05:12:07.657706 28961 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:12:07.658416 28961 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:12:07.664018 28961 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8ffac585ceb049b2a0b947aa4e3c00dd: Generated new TSK 0
I20260811 05:12:07.664211 28961 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 05:12:07.667184 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 28826
W20260811 05:12:07.680044 28793 connection.cc:535] client connection to 127.0.0.1:33499 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:33499): Connection reset by peer (error 104)
2026-08-11T05:12:07Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1641 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786424853995437-27391-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 05:12:07 dist-test-slave-x5fp krb5kdc[28992](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 05:12:07 dist-test-slave-x5fp krb5kdc[28992](info): set up 2 sockets
Aug 11 05:12:07 dist-test-slave-x5fp krb5kdc[28992](info): commencing operation
krb5kdc: starting...
W20260811 05:12:08.964555 27391 mini_kdc.cc:121] Time spent starting KDC: real 1.270s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786424853995437-27391-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786424853995437-27391-0/krb5kdc/test-user.keytab.
Aug 11 05:12:09 dist-test-slave-x5fp krb5kdc[28992](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425129, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T05:12:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:12:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786424853995437-27391-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786424853995437-27391-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 05:12:09.100407 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786424853995437-27391-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786424853995437-27391-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786424853995437-27391-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36337
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786424853995437-27391-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36337
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:12:09.188081 29014 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:12:09.188309 29014 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:12:09.188335 29014 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:12:09.189478 29014 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:12:09.189514 29014 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:12:09.189529 29014 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:12:09.189541 29014 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:12:09.189554 29014 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:12:09.190985 29014 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786424853995437-27391-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786424853995437-27391-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36337
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786424853995437-27391-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36337
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29014
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786424853995437-27391-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:12:09.191185 29014 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:12:09.191377 29014 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:12:09.196478 29021 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:12:09.196487 29024 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:12:09.196940 29014 server_base.cc:1034] running on GCE node
W20260811 05:12:09.196506 29022 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:12:09.197285 29014 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:12:09.197590 29014 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:12:09.198763 29014 hybrid_clock.cc:648] HybridClock initialized: now 1786425129198739 us; error 42 us; skew 500 ppm
Aug 11 05:12:09 dist-test-slave-x5fp krb5kdc[28992](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425129, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:12:09.201421 29014 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 05:12:09.201926 29014 webserver.cc:460] Webserver started at http://127.0.0.1:38617/ using document root <none> and password file <none>
I20260811 05:12:09.202188 29014 fs_manager.cc:359] Metadata directory not provided
I20260811 05:12:09.202260 29014 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:12:09.202422 29014 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:12:09.203528 29014 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786424853995437-27391-0/minicluster-data/master-0/data/instance:
uuid: "6f7407b3da404390b6b3ba4ce37e2708"
format_stamp: "Formatted at 2026-08-11 05:12:09 on dist-test-slave-x5fp"
server_key: "f62d4312e381d7041ac0083745bdf3f7"
server_key_iv: "1d740569f6f6cfc1f64ae68cdf67ee4d"
server_key_version: "encryptionkey@0"
I20260811 05:12:09.203910 29014 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786424853995437-27391-0/minicluster-data/master-0/wal/instance:
uuid: "6f7407b3da404390b6b3ba4ce37e2708"
format_stamp: "Formatted at 2026-08-11 05:12:09 on dist-test-slave-x5fp"
server_key: "f62d4312e381d7041ac0083745bdf3f7"
server_key_iv: "1d740569f6f6cfc1f64ae68cdf67ee4d"
server_key_version: "encryptionkey@0"
I20260811 05:12:09.205428 29014 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 05:12:09.206269 29034 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:12:09.206540 29014 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:12:09.206676 29014 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786424853995437-27391-0/minicluster-data/master-0/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786424853995437-27391-0/minicluster-data/master-0/wal
uuid: "6f7407b3da404390b6b3ba4ce37e2708"
format_stamp: "Formatted at 2026-08-11 05:12:09 on dist-test-slave-x5fp"
server_key: "f62d4312e381d7041ac0083745bdf3f7"
server_key_iv: "1d740569f6f6cfc1f64ae68cdf67ee4d"
server_key_version: "encryptionkey@0"
I20260811 05:12:09.206764 29014 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786424853995437-27391-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786424853995437-27391-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786424853995437-27391-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:12:09.210342 29014 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:12:09.212839 29014 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:12:09.213003 29014 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:12:09.217383 29014 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36337
I20260811 05:12:09.217418 29117 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36337 every 8 connection(s)
I20260811 05:12:09.217768 29014 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
I20260811 05:12:09.218919 29118 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:12:09.221701 29118 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6f7407b3da404390b6b3ba4ce37e2708: Bootstrap starting.
I20260811 05:12:09.222388 29118 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6f7407b3da404390b6b3ba4ce37e2708: Neither blocks nor log segments found. Creating new log.
I20260811 05:12:09.222712 29118 log.cc:824] T 00000000000000000000000000000000 P 6f7407b3da404390b6b3ba4ce37e2708: Log is configured to *not* fsync() on all Append() calls
I20260811 05:12:09.223536 29118 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6f7407b3da404390b6b3ba4ce37e2708: No bootstrap required, opened a new log
I20260811 05:12:09.225478 29118 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6f7407b3da404390b6b3ba4ce37e2708 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f7407b3da404390b6b3ba4ce37e2708" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36337 } }
I20260811 05:12:09.225633 29118 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6f7407b3da404390b6b3ba4ce37e2708 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:12:09.225658 29118 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6f7407b3da404390b6b3ba4ce37e2708 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f7407b3da404390b6b3ba4ce37e2708, State: Initialized, Role: FOLLOWER
I20260811 05:12:09.225847 29118 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6f7407b3da404390b6b3ba4ce37e2708 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f7407b3da404390b6b3ba4ce37e2708" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36337 } }
I20260811 05:12:09.225917 29118 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6f7407b3da404390b6b3ba4ce37e2708 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:12:09.225965 29118 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6f7407b3da404390b6b3ba4ce37e2708 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:12:09.226027 29118 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6f7407b3da404390b6b3ba4ce37e2708 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:12:09.226634 29118 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6f7407b3da404390b6b3ba4ce37e2708 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f7407b3da404390b6b3ba4ce37e2708" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36337 } }
I20260811 05:12:09.226763 29118 leader_election.cc:302] T 00000000000000000000000000000000 P 6f7407b3da404390b6b3ba4ce37e2708 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6f7407b3da404390b6b3ba4ce37e2708; no voters:
I20260811 05:12:09.226971 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 29014
I20260811 05:12:09.226982 29118 leader_election.cc:288] T 00000000000000000000000000000000 P 6f7407b3da404390b6b3ba4ce37e2708 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 05:12:09.227018 29122 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6f7407b3da404390b6b3ba4ce37e2708 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:12:09.227098 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786424853995437-27391-0/minicluster-data/master-0/wal/instance
I20260811 05:12:09.227155 29122 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6f7407b3da404390b6b3ba4ce37e2708 [term 1 LEADER]: Becoming Leader. State: Replica: 6f7407b3da404390b6b3ba4ce37e2708, State: Running, Role: LEADER
I20260811 05:12:09.227293 27391 external_mini_cluster.cc:1428] Setting key dc076938c9abfd2e30ea221d6f97d9dd
I20260811 05:12:09.227314 29118 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6f7407b3da404390b6b3ba4ce37e2708 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:12:09.227252 29122 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6f7407b3da404390b6b3ba4ce37e2708 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f7407b3da404390b6b3ba4ce37e2708" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36337 } }
I20260811 05:12:09.228659 29125 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6f7407b3da404390b6b3ba4ce37e2708 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6f7407b3da404390b6b3ba4ce37e2708" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f7407b3da404390b6b3ba4ce37e2708" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36337 } } }
I20260811 05:12:09.228807 29125 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6f7407b3da404390b6b3ba4ce37e2708 [sys.catalog]: This master's current role is: LEADER
I20260811 05:12:09.229231 29126 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6f7407b3da404390b6b3ba4ce37e2708 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6f7407b3da404390b6b3ba4ce37e2708. Latest consensus state: current_term: 1 leader_uuid: "6f7407b3da404390b6b3ba4ce37e2708" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f7407b3da404390b6b3ba4ce37e2708" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36337 } } }
I20260811 05:12:09.229336 29126 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6f7407b3da404390b6b3ba4ce37e2708 [sys.catalog]: This master's current role is: LEADER
I20260811 05:12:09.229512 29140 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:12:09.230201 29140 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:12:09.230444 29130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:09.228182 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.203:55965 (local address 127.0.0.1:36337)
0811 05:12:09.228372 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:09.228384 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:09.228424 (+ 40us) server_negotiation.cc:407] Connection header received
0811 05:12:09.228561 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:09.228568 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:09.228601 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:09.229656 (+ 1055us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:12:09.229949 (+ 293us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:12:09.229951 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:12:09.229951 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:12:09.229954 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:12:09.229979 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:12:09.229988 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:12:09.230068 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 05:12:09.230142 (+ 74us) server_negotiation.cc:299] Negotiation successful
0811 05:12:09.230186 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":95,"threads_started":1}
I20260811 05:12:09.231565 27391 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 05:12:09.233183 29140 catalog_manager.cc:1347] Generated new cluster ID: 4d6500d3d4064cd5bd3d5f6e99984330
I20260811 05:12:09.233258 29140 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:12:09.237895 29130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:09.233116 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.203:60775 (local address 127.0.0.1:36337)
0811 05:12:09.233148 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:09.233149 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:09.236914 (+ 3765us) server_negotiation.cc:407] Connection header received
0811 05:12:09.236995 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:09.236996 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:09.237001 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:09.237042 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:12:09.237682 (+ 640us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:12:09.237683 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:12:09.237684 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:12:09.237688 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:12:09.237704 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:12:09.237709 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:12:09.237758 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 05:12:09.237816 (+ 58us) server_negotiation.cc:299] Negotiation successful
0811 05:12:09.237830 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260811 05:12:09.259277 29140 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:12:09.259505 29140 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:12:09.266283 29140 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6f7407b3da404390b6b3ba4ce37e2708: Generated new TSK 0
I20260811 05:12:09.266541 29140 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 05:12:09.271950 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 29014
2026-08-11T05:12:09Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1613 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786424853995437-27391-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 05:12:09 dist-test-slave-x5fp krb5kdc[29180](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 05:12:09 dist-test-slave-x5fp krb5kdc[29180](info): set up 2 sockets
Aug 11 05:12:09 dist-test-slave-x5fp krb5kdc[29180](info): commencing operation
krb5kdc: starting...
W20260811 05:12:10.681525 27391 mini_kdc.cc:121] Time spent starting KDC: real 1.374s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786424853995437-27391-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786424853995437-27391-0/krb5kdc/test-user.keytab.
Aug 11 05:12:10 dist-test-slave-x5fp krb5kdc[29180](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425130, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T05:12:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:12:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786424853995437-27391-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786424853995437-27391-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 05:12:10.820811 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786424853995437-27391-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786424853995437-27391-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786424853995437-27391-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46659
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786424853995437-27391-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38797
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46659
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:12:10.909564 29200 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:12:10.909828 29200 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:12:10.909868 29200 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:12:10.911068 29200 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:12:10.911144 29200 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:12:10.911170 29200 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:12:10.911204 29200 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:12:10.911230 29200 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:12:10.912878 29200 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38797
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786424853995437-27391-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786424853995437-27391-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46659
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786424853995437-27391-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46659
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29200
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786424853995437-27391-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:12:10.913164 29200 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:12:10.913434 29200 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:12:10.918696 29209 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:12:10.918785 29200 server_base.cc:1034] running on GCE node
W20260811 05:12:10.918696 29214 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:12:10.918718 29206 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:12:10.919476 29200 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:12:10.919790 29200 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:12:10.920939 29200 hybrid_clock.cc:648] HybridClock initialized: now 1786425130920922 us; error 35 us; skew 500 ppm
Aug 11 05:12:10 dist-test-slave-x5fp krb5kdc[29180](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425130, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:12:10.923643 29200 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 05:12:10.924360 29200 webserver.cc:460] Webserver started at http://127.0.0.1:45889/ using document root <none> and password file <none>
I20260811 05:12:10.924616 29200 fs_manager.cc:359] Metadata directory not provided
I20260811 05:12:10.924690 29200 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:12:10.924901 29200 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:12:10.926012 29200 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786424853995437-27391-0/minicluster-data/master-0/data/instance:
uuid: "125009a8caf2400a961344fa3dd0bf54"
format_stamp: "Formatted at 2026-08-11 05:12:10 on dist-test-slave-x5fp"
server_key: "db4a2ec5583ed3dda5e44fca02acdc6d"
server_key_iv: "127b1ea04a6e0daa71ca15355099c13e"
server_key_version: "encryptionkey@0"
I20260811 05:12:10.926403 29200 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786424853995437-27391-0/minicluster-data/master-0/wal/instance:
uuid: "125009a8caf2400a961344fa3dd0bf54"
format_stamp: "Formatted at 2026-08-11 05:12:10 on dist-test-slave-x5fp"
server_key: "db4a2ec5583ed3dda5e44fca02acdc6d"
server_key_iv: "127b1ea04a6e0daa71ca15355099c13e"
server_key_version: "encryptionkey@0"
I20260811 05:12:10.927778 29200 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 05:12:10.928562 29229 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:12:10.928791 29200 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:12:10.928925 29200 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786424853995437-27391-0/minicluster-data/master-0/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786424853995437-27391-0/minicluster-data/master-0/wal
uuid: "125009a8caf2400a961344fa3dd0bf54"
format_stamp: "Formatted at 2026-08-11 05:12:10 on dist-test-slave-x5fp"
server_key: "db4a2ec5583ed3dda5e44fca02acdc6d"
server_key_iv: "127b1ea04a6e0daa71ca15355099c13e"
server_key_version: "encryptionkey@0"
I20260811 05:12:10.929006 29200 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786424853995437-27391-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786424853995437-27391-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786424853995437-27391-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:12:10.936525 29200 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:12:10.938405 29200 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:12:10.938566 29200 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:12:10.942916 29200 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46659
I20260811 05:12:10.942951 29302 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46659 every 8 connection(s)
I20260811 05:12:10.943336 29200 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
I20260811 05:12:10.944232 29303 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:12:10.946552 29303 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 125009a8caf2400a961344fa3dd0bf54: Bootstrap starting.
I20260811 05:12:10.947100 29303 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 125009a8caf2400a961344fa3dd0bf54: Neither blocks nor log segments found. Creating new log.
I20260811 05:12:10.947438 29303 log.cc:824] T 00000000000000000000000000000000 P 125009a8caf2400a961344fa3dd0bf54: Log is configured to *not* fsync() on all Append() calls
I20260811 05:12:10.947463 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 29200
I20260811 05:12:10.947579 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786424853995437-27391-0/minicluster-data/master-0/wal/instance
I20260811 05:12:10.947790 27391 external_mini_cluster.cc:1428] Setting key f16004ef7214f9f78fce65e02886f647
I20260811 05:12:10.948354 29303 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 125009a8caf2400a961344fa3dd0bf54: No bootstrap required, opened a new log
I20260811 05:12:10.950533 29303 raft_consensus.cc:348] T 00000000000000000000000000000000 P 125009a8caf2400a961344fa3dd0bf54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "125009a8caf2400a961344fa3dd0bf54" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46659 } }
I20260811 05:12:10.950719 29303 raft_consensus.cc:374] T 00000000000000000000000000000000 P 125009a8caf2400a961344fa3dd0bf54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:12:10.950753 29303 raft_consensus.cc:729] T 00000000000000000000000000000000 P 125009a8caf2400a961344fa3dd0bf54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 125009a8caf2400a961344fa3dd0bf54, State: Initialized, Role: FOLLOWER
I20260811 05:12:10.950920 29303 consensus_queue.cc:260] T 00000000000000000000000000000000 P 125009a8caf2400a961344fa3dd0bf54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "125009a8caf2400a961344fa3dd0bf54" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46659 } }
I20260811 05:12:10.951012 29303 raft_consensus.cc:388] T 00000000000000000000000000000000 P 125009a8caf2400a961344fa3dd0bf54 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:12:10.951046 29303 raft_consensus.cc:482] T 00000000000000000000000000000000 P 125009a8caf2400a961344fa3dd0bf54 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:12:10.951086 29303 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 125009a8caf2400a961344fa3dd0bf54 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:12:10.951823 29303 raft_consensus.cc:504] T 00000000000000000000000000000000 P 125009a8caf2400a961344fa3dd0bf54 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "125009a8caf2400a961344fa3dd0bf54" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46659 } }
I20260811 05:12:10.951936 29303 leader_election.cc:302] T 00000000000000000000000000000000 P 125009a8caf2400a961344fa3dd0bf54 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 125009a8caf2400a961344fa3dd0bf54; no voters:
I20260811 05:12:10.952095 29303 leader_election.cc:288] T 00000000000000000000000000000000 P 125009a8caf2400a961344fa3dd0bf54 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 05:12:10.952220 29309 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 125009a8caf2400a961344fa3dd0bf54 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:12:10.952370 29303 sys_catalog.cc:564] T 00000000000000000000000000000000 P 125009a8caf2400a961344fa3dd0bf54 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:12:10.952454 29309 raft_consensus.cc:686] T 00000000000000000000000000000000 P 125009a8caf2400a961344fa3dd0bf54 [term 1 LEADER]: Becoming Leader. State: Replica: 125009a8caf2400a961344fa3dd0bf54, State: Running, Role: LEADER
I20260811 05:12:10.952603 29309 consensus_queue.cc:237] T 00000000000000000000000000000000 P 125009a8caf2400a961344fa3dd0bf54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "125009a8caf2400a961344fa3dd0bf54" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46659 } }
I20260811 05:12:10.953094 29311 sys_catalog.cc:455] T 00000000000000000000000000000000 P 125009a8caf2400a961344fa3dd0bf54 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "125009a8caf2400a961344fa3dd0bf54" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "125009a8caf2400a961344fa3dd0bf54" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46659 } } }
I20260811 05:12:10.953190 29311 sys_catalog.cc:458] T 00000000000000000000000000000000 P 125009a8caf2400a961344fa3dd0bf54 [sys.catalog]: This master's current role is: LEADER
I20260811 05:12:10.953393 29314 sys_catalog.cc:455] T 00000000000000000000000000000000 P 125009a8caf2400a961344fa3dd0bf54 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 125009a8caf2400a961344fa3dd0bf54. Latest consensus state: current_term: 1 leader_uuid: "125009a8caf2400a961344fa3dd0bf54" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "125009a8caf2400a961344fa3dd0bf54" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46659 } } }
I20260811 05:12:10.953471 29314 sys_catalog.cc:458] T 00000000000000000000000000000000 P 125009a8caf2400a961344fa3dd0bf54 [sys.catalog]: This master's current role is: LEADER
I20260811 05:12:10.953985 29330 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:12:10.954692 29330 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:12:10.956389 29330 catalog_manager.cc:1347] Generated new cluster ID: cbdbd6dfedda482a8149719a2899afad
I20260811 05:12:10.956442 29330 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:12:10.959956 29330 catalog_manager.cc:1370] Generated new certificate authority record
Aug 11 05:12:10 dist-test-slave-x5fp krb5kdc[29180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425130, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 05:12:10.960683 29330 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:12:10.965322 29330 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 125009a8caf2400a961344fa3dd0bf54: Generated new TSK 0
I20260811 05:12:10.965602 29330 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 05:12:10.965830 29307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:10.948346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.203:53539 (local address 127.0.0.1:46659)
0811 05:12:10.948546 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:10.948556 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:10.948614 (+ 58us) server_negotiation.cc:407] Connection header received
0811 05:12:10.949702 (+ 1088us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:10.949712 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:10.949780 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:10.949931 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:12:10.950556 (+ 625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:10.952329 (+ 1773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:10.953532 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:10.954207 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:10.954325 (+ 118us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:12:10.960922 (+ 6597us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:12:10.960926 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:12:10.960927 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:12:10.960941 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:12:10.963781 (+ 2840us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:12:10.964265 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:12:10.964269 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:12:10.964269 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:12:10.964398 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:12:10.964669 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:12:10.964670 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:12:10.964670 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:12:10.965002 (+ 332us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:12:10.965208 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0811 05:12:10.965334 (+ 126us) server_negotiation.cc:299] Negotiation successful
0811 05:12:10.965531 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":81,"threads_started":1}
I20260811 05:12:10.967124 27391 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 05:12:10.976284 29307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:10.968810 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.203:52577 (local address 127.0.0.1:46659)
0811 05:12:10.968851 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:10.968858 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:10.968977 (+ 119us) server_negotiation.cc:407] Connection header received
0811 05:12:10.969009 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:10.969010 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:10.969022 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:10.969097 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:12:10.969674 (+ 577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:10.970486 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:10.971242 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:10.971576 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:10.971657 (+ 81us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:12:10.973124 (+ 1467us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:12:10.973125 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:12:10.973126 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:12:10.973134 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:12:10.974824 (+ 1690us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:12:10.975246 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:12:10.975248 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:12:10.975248 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:12:10.975323 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:12:10.975606 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:12:10.975607 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:12:10.975608 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:12:10.975766 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:12:10.975888 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0811 05:12:10.976094 (+ 206us) server_negotiation.cc:299] Negotiation successful
0811 05:12:10.976174 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 05:12:10.978703 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 29200
W20260811 05:12:10.997175 29177 connection.cc:535] client connection to 127.0.0.1:46659 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:46659): Connection reset by peer (error 104)
2026-08-11T05:12:10Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1703 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786424853995437-27391-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 05:12:11 dist-test-slave-x5fp krb5kdc[29363](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 05:12:11 dist-test-slave-x5fp krb5kdc[29363](info): set up 2 sockets
Aug 11 05:12:11 dist-test-slave-x5fp krb5kdc[29363](info): commencing operation
krb5kdc: starting...
W20260811 05:12:12.341758 27391 mini_kdc.cc:121] Time spent starting KDC: real 1.330s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786424853995437-27391-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786424853995437-27391-0/krb5kdc/test-user.keytab.
Aug 11 05:12:12 dist-test-slave-x5fp krb5kdc[29363](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425132, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T05:12:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:12:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786424853995437-27391-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786424853995437-27391-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 05:12:12.477712 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786424853995437-27391-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786424853995437-27391-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786424853995437-27391-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39861
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786424853995437-27391-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36113
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39861
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:12:12.569371 29390 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:12:12.569646 29390 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:12:12.569689 29390 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:12:12.570881 29390 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:12:12.570952 29390 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:12:12.570976 29390 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:12:12.570998 29390 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:12:12.571026 29390 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:12:12.572652 29390 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36113
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786424853995437-27391-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786424853995437-27391-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39861
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786424853995437-27391-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39861
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29390
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786424853995437-27391-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:12:12.573067 29390 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:12:12.573367 29390 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:12:12.579043 29400 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:12:12.579074 29406 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:12:12.579059 29402 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:12:12.579402 29390 server_base.cc:1034] running on GCE node
I20260811 05:12:12.579668 29390 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:12:12.580003 29390 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:12:12.581162 29390 hybrid_clock.cc:648] HybridClock initialized: now 1786425132581137 us; error 39 us; skew 500 ppm
Aug 11 05:12:12 dist-test-slave-x5fp krb5kdc[29363](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425132, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:12:12.583778 29390 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 05:12:12.584266 29390 webserver.cc:460] Webserver started at http://127.0.0.1:33855/ using document root <none> and password file <none>
I20260811 05:12:12.584525 29390 fs_manager.cc:359] Metadata directory not provided
I20260811 05:12:12.584574 29390 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:12:12.584708 29390 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:12:12.585888 29390 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786424853995437-27391-0/minicluster-data/master-0/data/instance:
uuid: "89fdd376230f4f989c048240a61a642a"
format_stamp: "Formatted at 2026-08-11 05:12:12 on dist-test-slave-x5fp"
server_key: "45657eb191678b5e7100527e36113c43"
server_key_iv: "41ba0e0bf20a1bfdfeda2b076d3b2d3e"
server_key_version: "encryptionkey@0"
I20260811 05:12:12.586258 29390 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786424853995437-27391-0/minicluster-data/master-0/wal/instance:
uuid: "89fdd376230f4f989c048240a61a642a"
format_stamp: "Formatted at 2026-08-11 05:12:12 on dist-test-slave-x5fp"
server_key: "45657eb191678b5e7100527e36113c43"
server_key_iv: "41ba0e0bf20a1bfdfeda2b076d3b2d3e"
server_key_version: "encryptionkey@0"
I20260811 05:12:12.587677 29390 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 05:12:12.588542 29415 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:12:12.588779 29390 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 05:12:12.588896 29390 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786424853995437-27391-0/minicluster-data/master-0/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786424853995437-27391-0/minicluster-data/master-0/wal
uuid: "89fdd376230f4f989c048240a61a642a"
format_stamp: "Formatted at 2026-08-11 05:12:12 on dist-test-slave-x5fp"
server_key: "45657eb191678b5e7100527e36113c43"
server_key_iv: "41ba0e0bf20a1bfdfeda2b076d3b2d3e"
server_key_version: "encryptionkey@0"
I20260811 05:12:12.588980 29390 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786424853995437-27391-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786424853995437-27391-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786424853995437-27391-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:12:12.598533 29390 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:12:12.600946 29390 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:12:12.601079 29390 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:12:12.605357 29390 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39861
I20260811 05:12:12.605458 29485 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39861 every 8 connection(s)
I20260811 05:12:12.605816 29390 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
I20260811 05:12:12.606848 29488 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:12:12.609586 29488 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 89fdd376230f4f989c048240a61a642a: Bootstrap starting.
I20260811 05:12:12.610249 29488 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 89fdd376230f4f989c048240a61a642a: Neither blocks nor log segments found. Creating new log.
I20260811 05:12:12.610564 29488 log.cc:824] T 00000000000000000000000000000000 P 89fdd376230f4f989c048240a61a642a: Log is configured to *not* fsync() on all Append() calls
I20260811 05:12:12.611394 29488 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 89fdd376230f4f989c048240a61a642a: No bootstrap required, opened a new log
I20260811 05:12:12.613392 29488 raft_consensus.cc:348] T 00000000000000000000000000000000 P 89fdd376230f4f989c048240a61a642a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89fdd376230f4f989c048240a61a642a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39861 } }
I20260811 05:12:12.613574 29488 raft_consensus.cc:374] T 00000000000000000000000000000000 P 89fdd376230f4f989c048240a61a642a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:12:12.613626 29488 raft_consensus.cc:729] T 00000000000000000000000000000000 P 89fdd376230f4f989c048240a61a642a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89fdd376230f4f989c048240a61a642a, State: Initialized, Role: FOLLOWER
I20260811 05:12:12.613852 29488 consensus_queue.cc:260] T 00000000000000000000000000000000 P 89fdd376230f4f989c048240a61a642a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89fdd376230f4f989c048240a61a642a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39861 } }
I20260811 05:12:12.613955 29488 raft_consensus.cc:388] T 00000000000000000000000000000000 P 89fdd376230f4f989c048240a61a642a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:12:12.614001 29488 raft_consensus.cc:482] T 00000000000000000000000000000000 P 89fdd376230f4f989c048240a61a642a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:12:12.614063 29488 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 89fdd376230f4f989c048240a61a642a [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:12:12.614393 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 29390
I20260811 05:12:12.614526 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786424853995437-27391-0/minicluster-data/master-0/wal/instance
I20260811 05:12:12.614723 27391 external_mini_cluster.cc:1428] Setting key 6f4f549bbb4da1745b2a78541c3b1669
I20260811 05:12:12.614881 29488 raft_consensus.cc:504] T 00000000000000000000000000000000 P 89fdd376230f4f989c048240a61a642a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89fdd376230f4f989c048240a61a642a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39861 } }
I20260811 05:12:12.615008 29488 leader_election.cc:302] T 00000000000000000000000000000000 P 89fdd376230f4f989c048240a61a642a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 89fdd376230f4f989c048240a61a642a; no voters:
I20260811 05:12:12.615199 29488 leader_election.cc:288] T 00000000000000000000000000000000 P 89fdd376230f4f989c048240a61a642a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 05:12:12.615248 29491 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 89fdd376230f4f989c048240a61a642a [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:12:12.615482 29491 raft_consensus.cc:686] T 00000000000000000000000000000000 P 89fdd376230f4f989c048240a61a642a [term 1 LEADER]: Becoming Leader. State: Replica: 89fdd376230f4f989c048240a61a642a, State: Running, Role: LEADER
I20260811 05:12:12.615554 29488 sys_catalog.cc:564] T 00000000000000000000000000000000 P 89fdd376230f4f989c048240a61a642a [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:12:12.615772 29491 consensus_queue.cc:237] T 00000000000000000000000000000000 P 89fdd376230f4f989c048240a61a642a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89fdd376230f4f989c048240a61a642a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39861 } }
I20260811 05:12:12.616541 29494 sys_catalog.cc:455] T 00000000000000000000000000000000 P 89fdd376230f4f989c048240a61a642a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 89fdd376230f4f989c048240a61a642a. Latest consensus state: current_term: 1 leader_uuid: "89fdd376230f4f989c048240a61a642a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89fdd376230f4f989c048240a61a642a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39861 } } }
I20260811 05:12:12.616766 29494 sys_catalog.cc:458] T 00000000000000000000000000000000 P 89fdd376230f4f989c048240a61a642a [sys.catalog]: This master's current role is: LEADER
I20260811 05:12:12.617086 29511 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:12:12.617133 29496 sys_catalog.cc:455] T 00000000000000000000000000000000 P 89fdd376230f4f989c048240a61a642a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "89fdd376230f4f989c048240a61a642a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89fdd376230f4f989c048240a61a642a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39861 } } }
I20260811 05:12:12.617249 29496 sys_catalog.cc:458] T 00000000000000000000000000000000 P 89fdd376230f4f989c048240a61a642a [sys.catalog]: This master's current role is: LEADER
I20260811 05:12:12.617689 29511 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:12:12.619398 29511 catalog_manager.cc:1347] Generated new cluster ID: 66b92f3c59d148a3806f4bd2b7b4383e
I20260811 05:12:12.619453 29511 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:12:12.621512 29493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:12.615273 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.203:53289 (local address 127.0.0.1:39861)
0811 05:12:12.615617 (+ 344us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:12.615628 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:12.615663 (+ 35us) server_negotiation.cc:407] Connection header received
0811 05:12:12.615788 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:12.615796 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:12.615860 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:12.616003 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:12:12.616315 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:12.618012 (+ 1697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:12.619253 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:12.619845 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:12.619982 (+ 137us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:12:12.620840 (+ 858us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:12:12.620845 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:12:12.620845 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:12:12.621042 (+ 197us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:12:12.621076 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:12:12.621089 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:12:12.621205 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0811 05:12:12.621287 (+ 82us) server_negotiation.cc:299] Negotiation successful
0811 05:12:12.621321 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":285,"thread_start_us":90,"threads_started":1}
I20260811 05:12:12.622535 27391 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 05:12:12.623601 29511 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:12:12.624310 29511 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:12:12.631424 29511 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 89fdd376230f4f989c048240a61a642a: Generated new TSK 0
I20260811 05:12:12.631618 29511 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 05:12:12.632859 29493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:12.629144 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.203:58487 (local address 127.0.0.1:39861)
0811 05:12:12.629215 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:12.629217 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:12.629468 (+ 251us) server_negotiation.cc:407] Connection header received
0811 05:12:12.629545 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:12.629546 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:12.629558 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:12.629617 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:12:12.629791 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:12.630465 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:12.631353 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:12.631644 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:12.631711 (+ 67us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:12:12.632513 (+ 802us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:12:12.632515 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:12:12.632515 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:12:12.632520 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:12:12.632537 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:12:12.632541 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:12:12.632616 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 05:12:12.632680 (+ 64us) server_negotiation.cc:299] Negotiation successful
0811 05:12:12.632693 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260811 05:12:12.634802 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 29390
W20260811 05:12:12.651049 29361 connection.cc:535] client connection to 127.0.0.1:39861 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:39861): Connection reset by peer (error 104)
2026-08-11T05:12:12Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1653 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786424853995437-27391-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 05:12:12 dist-test-slave-x5fp krb5kdc[29546](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 05:12:12 dist-test-slave-x5fp krb5kdc[29546](info): set up 2 sockets
Aug 11 05:12:12 dist-test-slave-x5fp krb5kdc[29546](info): commencing operation
krb5kdc: starting...
W20260811 05:12:13.919549 27391 mini_kdc.cc:121] Time spent starting KDC: real 1.254s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786424853995437-27391-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786424853995437-27391-0/krb5kdc/test-user.keytab.
Aug 11 05:12:14 dist-test-slave-x5fp krb5kdc[29546](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425134, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T05:12:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:12:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786424853995437-27391-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786424853995437-27391-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 05:12:14.064477 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786424853995437-27391-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786424853995437-27391-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786424853995437-27391-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37623
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786424853995437-27391-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33943
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37623
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:12:14.153339 29562 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:12:14.153568 29562 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:12:14.153591 29562 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:12:14.154724 29562 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:12:14.154762 29562 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:12:14.154778 29562 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:12:14.154791 29562 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:12:14.154803 29562 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:12:14.156258 29562 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33943
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786424853995437-27391-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786424853995437-27391-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37623
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786424853995437-27391-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37623
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29562
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786424853995437-27391-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:12:14.156467 29562 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:12:14.156652 29562 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:12:14.162031 29568 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:12:14.162041 29569 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:12:14.162048 29571 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:12:14.162256 29562 server_base.cc:1034] running on GCE node
I20260811 05:12:14.162627 29562 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:12:14.162941 29562 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:12:14.164119 29562 hybrid_clock.cc:648] HybridClock initialized: now 1786425134164076 us; error 54 us; skew 500 ppm
Aug 11 05:12:14 dist-test-slave-x5fp krb5kdc[29546](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425134, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:12:14.167092 29562 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 05:12:14.167606 29562 webserver.cc:460] Webserver started at http://127.0.0.1:42253/ using document root <none> and password file <none>
I20260811 05:12:14.167879 29562 fs_manager.cc:359] Metadata directory not provided
I20260811 05:12:14.167954 29562 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:12:14.168113 29562 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:12:14.169305 29562 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786424853995437-27391-0/minicluster-data/master-0/data/instance:
uuid: "c706fe31fb9b4b7586b0ea8ba81e1d04"
format_stamp: "Formatted at 2026-08-11 05:12:14 on dist-test-slave-x5fp"
server_key: "1ab0e79d2c928311c7f559d07539acdf"
server_key_iv: "e07d7fcd4aea6a7930aa0942568a8478"
server_key_version: "encryptionkey@0"
I20260811 05:12:14.169682 29562 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786424853995437-27391-0/minicluster-data/master-0/wal/instance:
uuid: "c706fe31fb9b4b7586b0ea8ba81e1d04"
format_stamp: "Formatted at 2026-08-11 05:12:14 on dist-test-slave-x5fp"
server_key: "1ab0e79d2c928311c7f559d07539acdf"
server_key_iv: "e07d7fcd4aea6a7930aa0942568a8478"
server_key_version: "encryptionkey@0"
I20260811 05:12:14.171156 29562 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260811 05:12:14.172008 29586 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:12:14.172219 29562 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:12:14.172318 29562 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786424853995437-27391-0/minicluster-data/master-0/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786424853995437-27391-0/minicluster-data/master-0/wal
uuid: "c706fe31fb9b4b7586b0ea8ba81e1d04"
format_stamp: "Formatted at 2026-08-11 05:12:14 on dist-test-slave-x5fp"
server_key: "1ab0e79d2c928311c7f559d07539acdf"
server_key_iv: "e07d7fcd4aea6a7930aa0942568a8478"
server_key_version: "encryptionkey@0"
I20260811 05:12:14.172405 29562 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786424853995437-27391-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786424853995437-27391-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786424853995437-27391-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:12:14.175908 29562 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:12:14.178244 29562 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:12:14.178408 29562 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:12:14.182583 29562 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37623
I20260811 05:12:14.182617 29671 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37623 every 8 connection(s)
I20260811 05:12:14.182997 29562 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
I20260811 05:12:14.184046 29672 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:12:14.186508 29672 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c706fe31fb9b4b7586b0ea8ba81e1d04: Bootstrap starting.
I20260811 05:12:14.187114 29672 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c706fe31fb9b4b7586b0ea8ba81e1d04: Neither blocks nor log segments found. Creating new log.
I20260811 05:12:14.187361 29672 log.cc:824] T 00000000000000000000000000000000 P c706fe31fb9b4b7586b0ea8ba81e1d04: Log is configured to *not* fsync() on all Append() calls
I20260811 05:12:14.188268 29672 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c706fe31fb9b4b7586b0ea8ba81e1d04: No bootstrap required, opened a new log
I20260811 05:12:14.190146 29672 raft_consensus.cc:348] T 00000000000000000000000000000000 P c706fe31fb9b4b7586b0ea8ba81e1d04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c706fe31fb9b4b7586b0ea8ba81e1d04" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37623 } }
I20260811 05:12:14.190317 29672 raft_consensus.cc:374] T 00000000000000000000000000000000 P c706fe31fb9b4b7586b0ea8ba81e1d04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:12:14.190346 29672 raft_consensus.cc:729] T 00000000000000000000000000000000 P c706fe31fb9b4b7586b0ea8ba81e1d04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c706fe31fb9b4b7586b0ea8ba81e1d04, State: Initialized, Role: FOLLOWER
I20260811 05:12:14.190506 29672 consensus_queue.cc:260] T 00000000000000000000000000000000 P c706fe31fb9b4b7586b0ea8ba81e1d04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c706fe31fb9b4b7586b0ea8ba81e1d04" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37623 } }
I20260811 05:12:14.190603 29672 raft_consensus.cc:388] T 00000000000000000000000000000000 P c706fe31fb9b4b7586b0ea8ba81e1d04 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:12:14.190631 29672 raft_consensus.cc:482] T 00000000000000000000000000000000 P c706fe31fb9b4b7586b0ea8ba81e1d04 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:12:14.190678 29672 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c706fe31fb9b4b7586b0ea8ba81e1d04 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:12:14.191077 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 29562
I20260811 05:12:14.191224 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786424853995437-27391-0/minicluster-data/master-0/wal/instance
I20260811 05:12:14.191360 29672 raft_consensus.cc:504] T 00000000000000000000000000000000 P c706fe31fb9b4b7586b0ea8ba81e1d04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c706fe31fb9b4b7586b0ea8ba81e1d04" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37623 } }
I20260811 05:12:14.191409 27391 external_mini_cluster.cc:1428] Setting key 309acdb706b8a93beddf73fa5f1386f5
I20260811 05:12:14.191489 29672 leader_election.cc:302] T 00000000000000000000000000000000 P c706fe31fb9b4b7586b0ea8ba81e1d04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c706fe31fb9b4b7586b0ea8ba81e1d04; no voters:
I20260811 05:12:14.191723 29672 leader_election.cc:288] T 00000000000000000000000000000000 P c706fe31fb9b4b7586b0ea8ba81e1d04 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 05:12:14.191779 29678 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c706fe31fb9b4b7586b0ea8ba81e1d04 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:12:14.192008 29678 raft_consensus.cc:686] T 00000000000000000000000000000000 P c706fe31fb9b4b7586b0ea8ba81e1d04 [term 1 LEADER]: Becoming Leader. State: Replica: c706fe31fb9b4b7586b0ea8ba81e1d04, State: Running, Role: LEADER
I20260811 05:12:14.192044 29672 sys_catalog.cc:564] T 00000000000000000000000000000000 P c706fe31fb9b4b7586b0ea8ba81e1d04 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:12:14.192219 29678 consensus_queue.cc:237] T 00000000000000000000000000000000 P c706fe31fb9b4b7586b0ea8ba81e1d04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c706fe31fb9b4b7586b0ea8ba81e1d04" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37623 } }
I20260811 05:12:14.192703 29684 sys_catalog.cc:455] T 00000000000000000000000000000000 P c706fe31fb9b4b7586b0ea8ba81e1d04 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c706fe31fb9b4b7586b0ea8ba81e1d04. Latest consensus state: current_term: 1 leader_uuid: "c706fe31fb9b4b7586b0ea8ba81e1d04" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c706fe31fb9b4b7586b0ea8ba81e1d04" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37623 } } }
I20260811 05:12:14.192865 29684 sys_catalog.cc:458] T 00000000000000000000000000000000 P c706fe31fb9b4b7586b0ea8ba81e1d04 [sys.catalog]: This master's current role is: LEADER
I20260811 05:12:14.193161 29697 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:12:14.193554 29681 sys_catalog.cc:455] T 00000000000000000000000000000000 P c706fe31fb9b4b7586b0ea8ba81e1d04 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c706fe31fb9b4b7586b0ea8ba81e1d04" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c706fe31fb9b4b7586b0ea8ba81e1d04" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37623 } } }
I20260811 05:12:14.193718 29681 sys_catalog.cc:458] T 00000000000000000000000000000000 P c706fe31fb9b4b7586b0ea8ba81e1d04 [sys.catalog]: This master's current role is: LEADER
I20260811 05:12:14.194155 29689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:14.192025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.203:40801 (local address 127.0.0.1:37623)
0811 05:12:14.192323 (+ 298us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:14.192334 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:14.192372 (+ 38us) server_negotiation.cc:407] Connection header received
0811 05:12:14.192511 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:14.192519 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:14.192550 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:14.192761 (+ 211us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:12:14.193636 (+ 875us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:12:14.193640 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:12:14.193640 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:12:14.193645 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:12:14.193695 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:12:14.193711 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:12:14.193775 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 05:12:14.193894 (+ 119us) server_negotiation.cc:299] Negotiation successful
0811 05:12:14.193948 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":241,"thread_start_us":79,"threads_started":1}
I20260811 05:12:14.194371 29697 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:12:14.195353 27391 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 05:12:14.196868 29697 catalog_manager.cc:1347] Generated new cluster ID: c0b9a7bb20f24de99c9afc3de9a30a19
I20260811 05:12:14.196950 29697 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:12:14.198349 29689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:14.196994 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.203:56481 (local address 127.0.0.1:37623)
0811 05:12:14.197029 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:14.197031 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:14.197340 (+ 309us) server_negotiation.cc:407] Connection header received
0811 05:12:14.197401 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:14.197402 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:14.197407 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:14.197470 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:12:14.198085 (+ 615us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:12:14.198087 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:12:14.198087 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:12:14.198091 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:12:14.198109 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:12:14.198113 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:12:14.198176 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 05:12:14.198241 (+ 65us) server_negotiation.cc:299] Negotiation successful
0811 05:12:14.198254 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 05:12:14.204049 29697 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:12:14.204236 29697 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:12:14.208539 29697 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c706fe31fb9b4b7586b0ea8ba81e1d04: Generated new TSK 0
I20260811 05:12:14.208772 29697 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 05:12:14.212383 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 29562
2026-08-11T05:12:14Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1580 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786424853995437-27391-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 05:12:14 dist-test-slave-x5fp krb5kdc[29727](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 05:12:14 dist-test-slave-x5fp krb5kdc[29727](info): set up 2 sockets
Aug 11 05:12:14 dist-test-slave-x5fp krb5kdc[29727](info): commencing operation
krb5kdc: starting...
W20260811 05:12:15.521338 27391 mini_kdc.cc:121] Time spent starting KDC: real 1.275s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786424853995437-27391-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786424853995437-27391-0/krb5kdc/test-user.keytab.
Aug 11 05:12:15 dist-test-slave-x5fp krb5kdc[29727](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425135, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T05:12:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:12:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.191.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.191.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.191.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab.
Entry for principal kudu/127.26.191.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab.
I20260811 05:12:15.655941 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786424853995437-27391-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786424853995437-27391-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786424853995437-27391-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.254:43049
--webserver_interface=127.26.191.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab
--principal=kudu/127.26.191.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:39681
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.191.254:43049
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:12:15.745266 29747 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:12:15.745492 29747 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:12:15.745517 29747 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:12:15.746779 29747 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:12:15.746833 29747 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:12:15.746848 29747 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:12:15.746861 29747 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:12:15.746874 29747 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:12:15.748407 29747 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:39681
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786424853995437-27391-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786424853995437-27391-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.191.254:43049
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab
--principal=kudu/127.26.191.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.254:43049
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.191.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29747
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786424853995437-27391-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:12:15.748680 29747 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:12:15.748972 29747 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:12:15.754132 29754 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:12:15.754268 29747 server_base.cc:1034] running on GCE node
W20260811 05:12:15.754165 29756 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:12:15.754135 29759 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:12:15.754808 29747 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:12:15.755213 29747 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:12:15.756408 29747 hybrid_clock.cc:648] HybridClock initialized: now 1786425135756392 us; error 32 us; skew 500 ppm
Aug 11 05:12:15 dist-test-slave-x5fp krb5kdc[29727](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425135, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:12:15.759162 29747 init.cc:377] Logged in from keytab as kudu/127.26.191.254@KRBTEST.COM (short username kudu)
I20260811 05:12:15.759689 29747 webserver.cc:460] Webserver started at http://127.26.191.254:38801/ using document root <none> and password file <none>
I20260811 05:12:15.759946 29747 fs_manager.cc:359] Metadata directory not provided
I20260811 05:12:15.760017 29747 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:12:15.760174 29747 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:12:15.761404 29747 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786424853995437-27391-0/minicluster-data/master-0/data/instance:
uuid: "72802d813e1343ee9b70ceb2b60f89a4"
format_stamp: "Formatted at 2026-08-11 05:12:15 on dist-test-slave-x5fp"
server_key: "a65c31ad3293e9001da437807c6b3224"
server_key_iv: "f58d5511ba044b160441659611e2ce03"
server_key_version: "encryptionkey@0"
I20260811 05:12:15.761778 29747 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786424853995437-27391-0/minicluster-data/master-0/wal/instance:
uuid: "72802d813e1343ee9b70ceb2b60f89a4"
format_stamp: "Formatted at 2026-08-11 05:12:15 on dist-test-slave-x5fp"
server_key: "a65c31ad3293e9001da437807c6b3224"
server_key_iv: "f58d5511ba044b160441659611e2ce03"
server_key_version: "encryptionkey@0"
I20260811 05:12:15.763250 29747 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 05:12:15.764083 29770 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:12:15.764339 29747 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:12:15.764459 29747 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786424853995437-27391-0/minicluster-data/master-0/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786424853995437-27391-0/minicluster-data/master-0/wal
uuid: "72802d813e1343ee9b70ceb2b60f89a4"
format_stamp: "Formatted at 2026-08-11 05:12:15 on dist-test-slave-x5fp"
server_key: "a65c31ad3293e9001da437807c6b3224"
server_key_iv: "f58d5511ba044b160441659611e2ce03"
server_key_version: "encryptionkey@0"
I20260811 05:12:15.764539 29747 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786424853995437-27391-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786424853995437-27391-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786424853995437-27391-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:12:15.780990 29747 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:12:15.783039 29747 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:12:15.783313 29747 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:12:15.787879 29747 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.254:43049
I20260811 05:12:15.787923 29844 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.254:43049 every 8 connection(s)
I20260811 05:12:15.788321 29747 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
I20260811 05:12:15.789291 29845 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:12:15.791635 29845 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 72802d813e1343ee9b70ceb2b60f89a4: Bootstrap starting.
I20260811 05:12:15.792255 29845 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 72802d813e1343ee9b70ceb2b60f89a4: Neither blocks nor log segments found. Creating new log.
I20260811 05:12:15.792376 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 29747
I20260811 05:12:15.792546 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786424853995437-27391-0/minicluster-data/master-0/wal/instance
I20260811 05:12:15.792645 29845 log.cc:824] T 00000000000000000000000000000000 P 72802d813e1343ee9b70ceb2b60f89a4: Log is configured to *not* fsync() on all Append() calls
I20260811 05:12:15.792838 27391 external_mini_cluster.cc:1428] Setting key 8c761b8718b9c32a378e1daa5641180e
I20260811 05:12:15.793933 29845 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 72802d813e1343ee9b70ceb2b60f89a4: No bootstrap required, opened a new log
I20260811 05:12:15.796329 29845 raft_consensus.cc:348] T 00000000000000000000000000000000 P 72802d813e1343ee9b70ceb2b60f89a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72802d813e1343ee9b70ceb2b60f89a4" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 43049 } }
I20260811 05:12:15.796504 29845 raft_consensus.cc:374] T 00000000000000000000000000000000 P 72802d813e1343ee9b70ceb2b60f89a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:12:15.796535 29845 raft_consensus.cc:729] T 00000000000000000000000000000000 P 72802d813e1343ee9b70ceb2b60f89a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72802d813e1343ee9b70ceb2b60f89a4, State: Initialized, Role: FOLLOWER
I20260811 05:12:15.796650 29845 consensus_queue.cc:260] T 00000000000000000000000000000000 P 72802d813e1343ee9b70ceb2b60f89a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72802d813e1343ee9b70ceb2b60f89a4" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 43049 } }
I20260811 05:12:15.796764 29845 raft_consensus.cc:388] T 00000000000000000000000000000000 P 72802d813e1343ee9b70ceb2b60f89a4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:12:15.796816 29845 raft_consensus.cc:482] T 00000000000000000000000000000000 P 72802d813e1343ee9b70ceb2b60f89a4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:12:15.796873 29845 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 72802d813e1343ee9b70ceb2b60f89a4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:12:15.797437 29845 raft_consensus.cc:504] T 00000000000000000000000000000000 P 72802d813e1343ee9b70ceb2b60f89a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72802d813e1343ee9b70ceb2b60f89a4" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 43049 } }
I20260811 05:12:15.797566 29845 leader_election.cc:302] T 00000000000000000000000000000000 P 72802d813e1343ee9b70ceb2b60f89a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 72802d813e1343ee9b70ceb2b60f89a4; no voters:
I20260811 05:12:15.797777 29845 leader_election.cc:288] T 00000000000000000000000000000000 P 72802d813e1343ee9b70ceb2b60f89a4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 05:12:15.797798 29855 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 72802d813e1343ee9b70ceb2b60f89a4 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:12:15.797923 29855 raft_consensus.cc:686] T 00000000000000000000000000000000 P 72802d813e1343ee9b70ceb2b60f89a4 [term 1 LEADER]: Becoming Leader. State: Replica: 72802d813e1343ee9b70ceb2b60f89a4, State: Running, Role: LEADER
I20260811 05:12:15.798066 29855 consensus_queue.cc:237] T 00000000000000000000000000000000 P 72802d813e1343ee9b70ceb2b60f89a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72802d813e1343ee9b70ceb2b60f89a4" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 43049 } }
I20260811 05:12:15.798097 29845 sys_catalog.cc:564] T 00000000000000000000000000000000 P 72802d813e1343ee9b70ceb2b60f89a4 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:12:15.798475 29856 sys_catalog.cc:455] T 00000000000000000000000000000000 P 72802d813e1343ee9b70ceb2b60f89a4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "72802d813e1343ee9b70ceb2b60f89a4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72802d813e1343ee9b70ceb2b60f89a4" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 43049 } } }
I20260811 05:12:15.798627 29857 sys_catalog.cc:455] T 00000000000000000000000000000000 P 72802d813e1343ee9b70ceb2b60f89a4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 72802d813e1343ee9b70ceb2b60f89a4. Latest consensus state: current_term: 1 leader_uuid: "72802d813e1343ee9b70ceb2b60f89a4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72802d813e1343ee9b70ceb2b60f89a4" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 43049 } } }
I20260811 05:12:15.798703 29856 sys_catalog.cc:458] T 00000000000000000000000000000000 P 72802d813e1343ee9b70ceb2b60f89a4 [sys.catalog]: This master's current role is: LEADER
I20260811 05:12:15.799113 29857 sys_catalog.cc:458] T 00000000000000000000000000000000 P 72802d813e1343ee9b70ceb2b60f89a4 [sys.catalog]: This master's current role is: LEADER
I20260811 05:12:15.799449 29872 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:12:15.800082 29872 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 11 05:12:15 dist-test-slave-x5fp krb5kdc[29727](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425135, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
I20260811 05:12:15.801961 29872 catalog_manager.cc:1347] Generated new cluster ID: f746612ffdd2432a941a5e7ade5ba4dd
I20260811 05:12:15.802018 29872 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:12:15.805574 29853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:15.793440 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46007 (local address 127.26.191.254:43049)
0811 05:12:15.793611 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:15.793621 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:15.793656 (+ 35us) server_negotiation.cc:407] Connection header received
0811 05:12:15.794267 (+ 611us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:15.794276 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:15.794339 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:15.794505 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:12:15.795225 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:15.796659 (+ 1434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:15.797612 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:15.798306 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:15.798430 (+ 124us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:12:15.801825 (+ 3395us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:12:15.801830 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:12:15.801830 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:12:15.801844 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:12:15.803639 (+ 1795us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:12:15.804087 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:12:15.804091 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:12:15.804092 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:12:15.804204 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:12:15.804469 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:12:15.804471 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:12:15.804471 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:12:15.804799 (+ 328us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:12:15.804986 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0811 05:12:15.805263 (+ 277us) server_negotiation.cc:299] Negotiation successful
0811 05:12:15.805377 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":89,"threads_started":1}
I20260811 05:12:15.806797 27391 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 05:12:15.815807 29872 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:12:15.816036 29853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:15.808679 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53027 (local address 127.26.191.254:43049)
0811 05:12:15.808748 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:15.808750 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:15.808895 (+ 145us) server_negotiation.cc:407] Connection header received
0811 05:12:15.808969 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:15.808970 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:15.808982 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:15.809051 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:12:15.809642 (+ 591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:15.810213 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:15.811024 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:15.811293 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:15.811379 (+ 86us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:12:15.812846 (+ 1467us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:12:15.812847 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:12:15.812848 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:12:15.812856 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:12:15.814502 (+ 1646us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:12:15.814925 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:12:15.814926 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:12:15.814927 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:12:15.814997 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:12:15.815269 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:12:15.815271 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:12:15.815271 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:12:15.815423 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:12:15.815559 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0811 05:12:15.815851 (+ 292us) server_negotiation.cc:299] Negotiation successful
0811 05:12:15.815930 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 05:12:15.816672 29872 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:12:15.821116 29872 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 72802d813e1343ee9b70ceb2b60f89a4: Generated new TSK 0
I20260811 05:12:15.821336 29872 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 05:12:15.828210 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 29747
W20260811 05:12:15.850723 29725 connection.cc:535] client connection to 127.26.191.254:43049 recv error: Network error: failed to read from TLS socket (remote: 127.26.191.254:43049): Connection reset by peer (error 104)
2026-08-11T05:12:15Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1619 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786424853995437-27391-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 05:12:15 dist-test-slave-x5fp krb5kdc[29900](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 05:12:15 dist-test-slave-x5fp krb5kdc[29900](info): set up 2 sockets
Aug 11 05:12:15 dist-test-slave-x5fp krb5kdc[29900](info): commencing operation
krb5kdc: starting...
W20260811 05:12:17.186828 27391 mini_kdc.cc:121] Time spent starting KDC: real 1.321s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786424853995437-27391-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786424853995437-27391-0/krb5kdc/test-user.keytab.
Aug 11 05:12:17 dist-test-slave-x5fp krb5kdc[29900](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425137, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T05:12:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:12:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.191.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.191.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.191.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab.
Entry for principal kudu/127.26.191.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab.
I20260811 05:12:17.320144 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786424853995437-27391-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786424853995437-27391-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786424853995437-27391-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.254:40207
--webserver_interface=127.26.191.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab
--principal=kudu/127.26.191.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:35265
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.191.254:40207
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:12:17.404457 29915 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:12:17.404692 29915 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:12:17.404745 29915 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:12:17.405884 29915 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:12:17.405928 29915 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:12:17.405943 29915 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:12:17.405956 29915 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:12:17.405968 29915 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:12:17.407416 29915 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:35265
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786424853995437-27391-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786424853995437-27391-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.191.254:40207
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab
--principal=kudu/127.26.191.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.254:40207
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.191.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29915
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786424853995437-27391-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:12:17.407630 29915 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:12:17.407811 29915 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:12:17.412981 29922 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:12:17.413072 29923 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:12:17.413151 29915 server_base.cc:1034] running on GCE node
W20260811 05:12:17.412955 29928 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:12:17.413527 29915 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:12:17.413856 29915 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:12:17.415026 29915 hybrid_clock.cc:648] HybridClock initialized: now 1786425137414999 us; error 39 us; skew 500 ppm
Aug 11 05:12:17 dist-test-slave-x5fp krb5kdc[29900](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425137, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:12:17.421476 29915 init.cc:377] Logged in from keytab as kudu/127.26.191.254@KRBTEST.COM (short username kudu)
I20260811 05:12:17.421986 29915 webserver.cc:460] Webserver started at http://127.26.191.254:41985/ using document root <none> and password file <none>
I20260811 05:12:17.422236 29915 fs_manager.cc:359] Metadata directory not provided
I20260811 05:12:17.422293 29915 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:12:17.422466 29915 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:12:17.423585 29915 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786424853995437-27391-0/minicluster-data/master-0/data/instance:
uuid: "fba6d6cd249d4d06b2acc54b8e12b9f6"
format_stamp: "Formatted at 2026-08-11 05:12:17 on dist-test-slave-x5fp"
server_key: "c46b0bd41d2f79e53569692e9c8a8bec"
server_key_iv: "9835242e8af9c30fc098aadb10c3a8c1"
server_key_version: "encryptionkey@0"
I20260811 05:12:17.423982 29915 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786424853995437-27391-0/minicluster-data/master-0/wal/instance:
uuid: "fba6d6cd249d4d06b2acc54b8e12b9f6"
format_stamp: "Formatted at 2026-08-11 05:12:17 on dist-test-slave-x5fp"
server_key: "c46b0bd41d2f79e53569692e9c8a8bec"
server_key_iv: "9835242e8af9c30fc098aadb10c3a8c1"
server_key_version: "encryptionkey@0"
I20260811 05:12:17.425606 29915 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 05:12:17.426447 29944 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:12:17.426656 29915 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 05:12:17.426760 29915 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786424853995437-27391-0/minicluster-data/master-0/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786424853995437-27391-0/minicluster-data/master-0/wal
uuid: "fba6d6cd249d4d06b2acc54b8e12b9f6"
format_stamp: "Formatted at 2026-08-11 05:12:17 on dist-test-slave-x5fp"
server_key: "c46b0bd41d2f79e53569692e9c8a8bec"
server_key_iv: "9835242e8af9c30fc098aadb10c3a8c1"
server_key_version: "encryptionkey@0"
I20260811 05:12:17.426823 29915 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786424853995437-27391-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786424853995437-27391-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786424853995437-27391-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:12:17.448490 29915 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:12:17.450944 29915 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:12:17.451071 29915 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:12:17.455619 29915 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.254:40207
I20260811 05:12:17.455689 30010 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.254:40207 every 8 connection(s)
I20260811 05:12:17.456064 29915 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
I20260811 05:12:17.456377 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 29915
I20260811 05:12:17.456504 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786424853995437-27391-0/minicluster-data/master-0/wal/instance
I20260811 05:12:17.456772 27391 external_mini_cluster.cc:1428] Setting key ee4121fe370553cf1f434304b6a0a1c6
I20260811 05:12:17.457247 30011 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:12:17.460614 30011 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fba6d6cd249d4d06b2acc54b8e12b9f6: Bootstrap starting.
I20260811 05:12:17.461371 30011 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fba6d6cd249d4d06b2acc54b8e12b9f6: Neither blocks nor log segments found. Creating new log.
I20260811 05:12:17.461741 30011 log.cc:824] T 00000000000000000000000000000000 P fba6d6cd249d4d06b2acc54b8e12b9f6: Log is configured to *not* fsync() on all Append() calls
I20260811 05:12:17.462510 30016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:17.457378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39541 (local address 127.26.191.254:40207)
0811 05:12:17.457573 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:17.457583 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:17.457620 (+ 37us) server_negotiation.cc:407] Connection header received
0811 05:12:17.458071 (+ 451us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:17.458078 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:17.458133 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:17.458261 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:12:17.458489 (+ 228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:17.459370 (+ 881us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:17.460504 (+ 1134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:17.461014 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:17.461101 (+ 87us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:12:17.461878 (+ 777us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:12:17.461883 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:12:17.461884 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:12:17.462064 (+ 180us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:12:17.462094 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:12:17.462105 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:12:17.462206 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0811 05:12:17.462297 (+ 91us) server_negotiation.cc:299] Negotiation successful
0811 05:12:17.462328 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":100,"threads_started":1}
I20260811 05:12:17.462558 30011 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fba6d6cd249d4d06b2acc54b8e12b9f6: No bootstrap required, opened a new log
I20260811 05:12:17.463789 27391 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 05:12:17.465061 30011 raft_consensus.cc:348] T 00000000000000000000000000000000 P fba6d6cd249d4d06b2acc54b8e12b9f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fba6d6cd249d4d06b2acc54b8e12b9f6" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 40207 } }
I20260811 05:12:17.465253 30011 raft_consensus.cc:374] T 00000000000000000000000000000000 P fba6d6cd249d4d06b2acc54b8e12b9f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:12:17.465301 30011 raft_consensus.cc:729] T 00000000000000000000000000000000 P fba6d6cd249d4d06b2acc54b8e12b9f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fba6d6cd249d4d06b2acc54b8e12b9f6, State: Initialized, Role: FOLLOWER
I20260811 05:12:17.465471 30011 consensus_queue.cc:260] T 00000000000000000000000000000000 P fba6d6cd249d4d06b2acc54b8e12b9f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fba6d6cd249d4d06b2acc54b8e12b9f6" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 40207 } }
I20260811 05:12:17.465584 30011 raft_consensus.cc:388] T 00000000000000000000000000000000 P fba6d6cd249d4d06b2acc54b8e12b9f6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:12:17.465631 30011 raft_consensus.cc:482] T 00000000000000000000000000000000 P fba6d6cd249d4d06b2acc54b8e12b9f6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:12:17.465690 30011 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fba6d6cd249d4d06b2acc54b8e12b9f6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:12:17.466331 30011 raft_consensus.cc:504] T 00000000000000000000000000000000 P fba6d6cd249d4d06b2acc54b8e12b9f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fba6d6cd249d4d06b2acc54b8e12b9f6" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 40207 } }
I20260811 05:12:17.466467 30011 leader_election.cc:302] T 00000000000000000000000000000000 P fba6d6cd249d4d06b2acc54b8e12b9f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fba6d6cd249d4d06b2acc54b8e12b9f6; no voters:
I20260811 05:12:17.466636 30011 leader_election.cc:288] T 00000000000000000000000000000000 P fba6d6cd249d4d06b2acc54b8e12b9f6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 05:12:17.466668 30025 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fba6d6cd249d4d06b2acc54b8e12b9f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:12:17.466786 30025 raft_consensus.cc:686] T 00000000000000000000000000000000 P fba6d6cd249d4d06b2acc54b8e12b9f6 [term 1 LEADER]: Becoming Leader. State: Replica: fba6d6cd249d4d06b2acc54b8e12b9f6, State: Running, Role: LEADER
I20260811 05:12:17.466919 30011 sys_catalog.cc:564] T 00000000000000000000000000000000 P fba6d6cd249d4d06b2acc54b8e12b9f6 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:12:17.466935 30025 consensus_queue.cc:237] T 00000000000000000000000000000000 P fba6d6cd249d4d06b2acc54b8e12b9f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fba6d6cd249d4d06b2acc54b8e12b9f6" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 40207 } }
I20260811 05:12:17.467319 30025 sys_catalog.cc:455] T 00000000000000000000000000000000 P fba6d6cd249d4d06b2acc54b8e12b9f6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fba6d6cd249d4d06b2acc54b8e12b9f6. Latest consensus state: current_term: 1 leader_uuid: "fba6d6cd249d4d06b2acc54b8e12b9f6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fba6d6cd249d4d06b2acc54b8e12b9f6" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 40207 } } }
I20260811 05:12:17.467576 30025 sys_catalog.cc:458] T 00000000000000000000000000000000 P fba6d6cd249d4d06b2acc54b8e12b9f6 [sys.catalog]: This master's current role is: LEADER
I20260811 05:12:17.467490 30026 sys_catalog.cc:455] T 00000000000000000000000000000000 P fba6d6cd249d4d06b2acc54b8e12b9f6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fba6d6cd249d4d06b2acc54b8e12b9f6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fba6d6cd249d4d06b2acc54b8e12b9f6" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 40207 } } }
I20260811 05:12:17.468011 30026 sys_catalog.cc:458] T 00000000000000000000000000000000 P fba6d6cd249d4d06b2acc54b8e12b9f6 [sys.catalog]: This master's current role is: LEADER
I20260811 05:12:17.468190 30044 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:12:17.468794 30044 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:12:17.469039 30016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:17.465390 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48425 (local address 127.26.191.254:40207)
0811 05:12:17.465433 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:17.465434 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:17.465680 (+ 246us) server_negotiation.cc:407] Connection header received
0811 05:12:17.465760 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:17.465761 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:17.465773 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:17.465829 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:12:17.465986 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:17.466503 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:17.467510 (+ 1007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:17.467809 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:17.467852 (+ 43us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:12:17.468748 (+ 896us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:12:17.468749 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:12:17.468750 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:12:17.468754 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:12:17.468770 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:12:17.468775 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:12:17.468812 (+ 37us) server_negotiation.cc:1035] Waiting for connection context
0811 05:12:17.468954 (+ 142us) server_negotiation.cc:299] Negotiation successful
0811 05:12:17.468967 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 05:12:17.470402 30044 catalog_manager.cc:1347] Generated new cluster ID: b013c993fce04c53a7cb4415b4eb055d
I20260811 05:12:17.470467 30044 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:12:17.490618 30044 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:12:17.491230 30044 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:12:17.496189 30044 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fba6d6cd249d4d06b2acc54b8e12b9f6: Generated new TSK 0
I20260811 05:12:17.496454 30044 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 05:12:17.506948 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 29915
W20260811 05:12:17.521363 29897 connection.cc:535] client connection to 127.26.191.254:40207 recv error: Network error: failed to read from TLS socket (remote: 127.26.191.254:40207): Connection reset by peer (error 104)
2026-08-11T05:12:17Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1670 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786424853995437-27391-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 05:12:17 dist-test-slave-x5fp krb5kdc[30073](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 05:12:17 dist-test-slave-x5fp krb5kdc[30073](info): set up 2 sockets
Aug 11 05:12:17 dist-test-slave-x5fp krb5kdc[30073](info): commencing operation
krb5kdc: starting...
W20260811 05:12:18.876413 27391 mini_kdc.cc:121] Time spent starting KDC: real 1.341s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786424853995437-27391-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786424853995437-27391-0/krb5kdc/test-user.keytab.
Aug 11 05:12:18 dist-test-slave-x5fp krb5kdc[30073](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425138, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T05:12:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:12:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.191.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.191.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.191.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab.
Entry for principal kudu/127.26.191.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab.
I20260811 05:12:19.016273 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786424853995437-27391-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786424853995437-27391-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786424853995437-27391-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.254:32921
--webserver_interface=127.26.191.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab
--principal=kudu/127.26.191.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:39659
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.191.254:32921
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:12:19.100891 30092 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:12:19.101163 30092 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:12:19.101207 30092 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:12:19.103050 30092 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:12:19.103118 30092 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:12:19.103140 30092 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:12:19.103158 30092 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:12:19.103184 30092 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:12:19.105669 30092 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:39659
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786424853995437-27391-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786424853995437-27391-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.191.254:32921
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab
--principal=kudu/127.26.191.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.254:32921
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.191.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30092
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786424853995437-27391-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:12:19.105973 30092 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:12:19.106245 30092 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:12:19.111662 30098 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:12:19.111655 30099 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:12:19.111660 30103 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:12:19.112006 30092 server_base.cc:1034] running on GCE node
I20260811 05:12:19.112303 30092 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:12:19.112622 30092 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:12:19.113867 30092 hybrid_clock.cc:648] HybridClock initialized: now 1786425139113851 us; error 48 us; skew 500 ppm
Aug 11 05:12:19 dist-test-slave-x5fp krb5kdc[30073](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425139, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:12:19.116843 30092 init.cc:377] Logged in from keytab as kudu/127.26.191.254@KRBTEST.COM (short username kudu)
I20260811 05:12:19.117355 30092 webserver.cc:460] Webserver started at http://127.26.191.254:35607/ using document root <none> and password file <none>
I20260811 05:12:19.117615 30092 fs_manager.cc:359] Metadata directory not provided
I20260811 05:12:19.117707 30092 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:12:19.117877 30092 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:12:19.119108 30092 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786424853995437-27391-0/minicluster-data/master-0/data/instance:
uuid: "3d344868944b4946a927c6fb03011b72"
format_stamp: "Formatted at 2026-08-11 05:12:19 on dist-test-slave-x5fp"
server_key: "c2f44bc4790f860b7e9d08a0899329ee"
server_key_iv: "c13df53cd2083a05ee249bdddbc501e4"
server_key_version: "encryptionkey@0"
I20260811 05:12:19.119520 30092 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786424853995437-27391-0/minicluster-data/master-0/wal/instance:
uuid: "3d344868944b4946a927c6fb03011b72"
format_stamp: "Formatted at 2026-08-11 05:12:19 on dist-test-slave-x5fp"
server_key: "c2f44bc4790f860b7e9d08a0899329ee"
server_key_iv: "c13df53cd2083a05ee249bdddbc501e4"
server_key_version: "encryptionkey@0"
I20260811 05:12:19.121086 30092 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 05:12:19.121927 30113 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:12:19.122148 30092 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:12:19.122277 30092 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786424853995437-27391-0/minicluster-data/master-0/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786424853995437-27391-0/minicluster-data/master-0/wal
uuid: "3d344868944b4946a927c6fb03011b72"
format_stamp: "Formatted at 2026-08-11 05:12:19 on dist-test-slave-x5fp"
server_key: "c2f44bc4790f860b7e9d08a0899329ee"
server_key_iv: "c13df53cd2083a05ee249bdddbc501e4"
server_key_version: "encryptionkey@0"
I20260811 05:12:19.122364 30092 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786424853995437-27391-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786424853995437-27391-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786424853995437-27391-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:12:19.126259 30092 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:12:19.128391 30092 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:12:19.128574 30092 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:12:19.133155 30092 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.254:32921
I20260811 05:12:19.133186 30187 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.254:32921 every 8 connection(s)
I20260811 05:12:19.133571 30092 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
I20260811 05:12:19.134649 30189 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:12:19.137028 30189 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3d344868944b4946a927c6fb03011b72: Bootstrap starting.
I20260811 05:12:19.137583 30189 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3d344868944b4946a927c6fb03011b72: Neither blocks nor log segments found. Creating new log.
I20260811 05:12:19.137832 30189 log.cc:824] T 00000000000000000000000000000000 P 3d344868944b4946a927c6fb03011b72: Log is configured to *not* fsync() on all Append() calls
I20260811 05:12:19.138520 30189 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3d344868944b4946a927c6fb03011b72: No bootstrap required, opened a new log
I20260811 05:12:19.140075 30189 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3d344868944b4946a927c6fb03011b72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d344868944b4946a927c6fb03011b72" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 32921 } }
I20260811 05:12:19.140230 30189 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3d344868944b4946a927c6fb03011b72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:12:19.140255 30189 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3d344868944b4946a927c6fb03011b72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d344868944b4946a927c6fb03011b72, State: Initialized, Role: FOLLOWER
I20260811 05:12:19.140393 30189 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3d344868944b4946a927c6fb03011b72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d344868944b4946a927c6fb03011b72" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 32921 } }
I20260811 05:12:19.140486 30189 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3d344868944b4946a927c6fb03011b72 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:12:19.140508 30189 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3d344868944b4946a927c6fb03011b72 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:12:19.140538 30189 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3d344868944b4946a927c6fb03011b72 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:12:19.141456 30189 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3d344868944b4946a927c6fb03011b72 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d344868944b4946a927c6fb03011b72" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 32921 } }
I20260811 05:12:19.141552 30189 leader_election.cc:302] T 00000000000000000000000000000000 P 3d344868944b4946a927c6fb03011b72 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3d344868944b4946a927c6fb03011b72; no voters:
I20260811 05:12:19.141677 30189 leader_election.cc:288] T 00000000000000000000000000000000 P 3d344868944b4946a927c6fb03011b72 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 05:12:19.141764 30192 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3d344868944b4946a927c6fb03011b72 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:12:19.141958 30192 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3d344868944b4946a927c6fb03011b72 [term 1 LEADER]: Becoming Leader. State: Replica: 3d344868944b4946a927c6fb03011b72, State: Running, Role: LEADER
I20260811 05:12:19.141966 30189 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3d344868944b4946a927c6fb03011b72 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:12:19.142119 30192 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3d344868944b4946a927c6fb03011b72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d344868944b4946a927c6fb03011b72" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 32921 } }
I20260811 05:12:19.142457 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 30092
I20260811 05:12:19.142602 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786424853995437-27391-0/minicluster-data/master-0/wal/instance
I20260811 05:12:19.142788 30193 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d344868944b4946a927c6fb03011b72 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3d344868944b4946a927c6fb03011b72" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d344868944b4946a927c6fb03011b72" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 32921 } } }
I20260811 05:12:19.142839 27391 external_mini_cluster.cc:1428] Setting key e8de61ee5325ac2154b7228aa3b903c4
I20260811 05:12:19.143376 30194 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d344868944b4946a927c6fb03011b72 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3d344868944b4946a927c6fb03011b72. Latest consensus state: current_term: 1 leader_uuid: "3d344868944b4946a927c6fb03011b72" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d344868944b4946a927c6fb03011b72" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 32921 } } }
I20260811 05:12:19.143520 30194 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d344868944b4946a927c6fb03011b72 [sys.catalog]: This master's current role is: LEADER
I20260811 05:12:19.143682 30193 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d344868944b4946a927c6fb03011b72 [sys.catalog]: This master's current role is: LEADER
W20260811 05:12:19.144080 30220 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3d344868944b4946a927c6fb03011b72: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 05:12:19.144153 30220 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 05:12:19.144330 30227 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:12:19.144532 30227 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:12:19.145956 30222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:19.143542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45491 (local address 127.26.191.254:32921)
0811 05:12:19.144101 (+ 559us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:19.144111 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:19.144144 (+ 33us) server_negotiation.cc:407] Connection header received
0811 05:12:19.144269 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:19.144276 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:19.144308 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:19.144799 (+ 491us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:12:19.145332 (+ 533us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:12:19.145336 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:12:19.145336 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:12:19.145341 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:12:19.145383 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:12:19.145398 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:12:19.145472 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 05:12:19.145602 (+ 130us) server_negotiation.cc:299] Negotiation successful
0811 05:12:19.145767 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":500,"thread_start_us":83,"threads_started":1}
I20260811 05:12:19.146426 30227 catalog_manager.cc:1347] Generated new cluster ID: 01833fee4a0b4ba48fbe8af44cbb237b
I20260811 05:12:19.146492 30227 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:12:19.147049 27391 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 05:12:19.149847 30222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:19.148582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57861 (local address 127.26.191.254:32921)
0811 05:12:19.148624 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:19.148626 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:19.148869 (+ 243us) server_negotiation.cc:407] Connection header received
0811 05:12:19.148899 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:19.148899 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:19.148905 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:19.148981 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:12:19.149591 (+ 610us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:12:19.149592 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:12:19.149592 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:12:19.149597 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:12:19.149613 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:12:19.149618 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:12:19.149689 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 05:12:19.149753 (+ 64us) server_negotiation.cc:299] Negotiation successful
0811 05:12:19.149767 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 05:12:19.163125 30227 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:12:19.163348 30227 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:12:19.169685 30227 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3d344868944b4946a927c6fb03011b72: Generated new TSK 0
I20260811 05:12:19.169906 30227 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 05:12:19.172843 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 30092
2026-08-11T05:12:19Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1671 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786424853995437-27391-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 05:12:19 dist-test-slave-x5fp krb5kdc[30240](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 05:12:19 dist-test-slave-x5fp krb5kdc[30240](info): set up 2 sockets
Aug 11 05:12:19 dist-test-slave-x5fp krb5kdc[30240](info): commencing operation
krb5kdc: starting...
W20260811 05:12:20.526144 27391 mini_kdc.cc:121] Time spent starting KDC: real 1.319s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786424853995437-27391-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786424853995437-27391-0/krb5kdc/test-user.keytab.
Aug 11 05:12:20 dist-test-slave-x5fp krb5kdc[30240](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425140, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T05:12:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:12:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.191.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.191.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.191.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab.
Entry for principal kudu/127.26.191.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab.
I20260811 05:12:20.668810 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786424853995437-27391-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786424853995437-27391-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786424853995437-27391-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.254:36143
--webserver_interface=127.26.191.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab
--principal=kudu/127.26.191.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:43269
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.191.254:36143
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:12:20.771387 30266 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:12:20.771642 30266 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:12:20.771682 30266 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:12:20.772953 30266 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:12:20.773020 30266 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:12:20.773042 30266 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:12:20.773073 30266 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:12:20.773099 30266 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:12:20.774600 30266 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:43269
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786424853995437-27391-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786424853995437-27391-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.191.254:36143
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab
--principal=kudu/127.26.191.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.254:36143
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.191.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30266
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786424853995437-27391-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:12:20.774904 30266 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:12:20.775144 30266 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:12:20.780232 30279 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:12:20.780208 30284 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:12:20.780401 30266 server_base.cc:1034] running on GCE node
W20260811 05:12:20.780206 30280 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:12:20.780711 30266 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:12:20.781085 30266 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:12:20.782259 30266 hybrid_clock.cc:648] HybridClock initialized: now 1786425140782255 us; error 39 us; skew 500 ppm
Aug 11 05:12:20 dist-test-slave-x5fp krb5kdc[30240](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425140, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:12:20.784971 30266 init.cc:377] Logged in from keytab as kudu/127.26.191.254@KRBTEST.COM (short username kudu)
I20260811 05:12:20.785465 30266 webserver.cc:460] Webserver started at http://127.26.191.254:46649/ using document root <none> and password file <none>
I20260811 05:12:20.785702 30266 fs_manager.cc:359] Metadata directory not provided
I20260811 05:12:20.785774 30266 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:12:20.785946 30266 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:12:20.787052 30266 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786424853995437-27391-0/minicluster-data/master-0/data/instance:
uuid: "c5146f28a93440c48384f4c7d16a3548"
format_stamp: "Formatted at 2026-08-11 05:12:20 on dist-test-slave-x5fp"
server_key: "627f18612c352fc954729791fb592913"
server_key_iv: "f0271f05477933bdaf46e18831f9b8b8"
server_key_version: "encryptionkey@0"
I20260811 05:12:20.787437 30266 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786424853995437-27391-0/minicluster-data/master-0/wal/instance:
uuid: "c5146f28a93440c48384f4c7d16a3548"
format_stamp: "Formatted at 2026-08-11 05:12:20 on dist-test-slave-x5fp"
server_key: "627f18612c352fc954729791fb592913"
server_key_iv: "f0271f05477933bdaf46e18831f9b8b8"
server_key_version: "encryptionkey@0"
I20260811 05:12:20.788854 30266 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260811 05:12:20.789642 30295 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:12:20.789826 30266 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 05:12:20.789963 30266 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786424853995437-27391-0/minicluster-data/master-0/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786424853995437-27391-0/minicluster-data/master-0/wal
uuid: "c5146f28a93440c48384f4c7d16a3548"
format_stamp: "Formatted at 2026-08-11 05:12:20 on dist-test-slave-x5fp"
server_key: "627f18612c352fc954729791fb592913"
server_key_iv: "f0271f05477933bdaf46e18831f9b8b8"
server_key_version: "encryptionkey@0"
I20260811 05:12:20.790046 30266 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786424853995437-27391-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786424853995437-27391-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786424853995437-27391-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:12:20.820587 30266 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:12:20.823179 30266 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:12:20.823307 30266 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:12:20.827970 30266 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.254:36143
I20260811 05:12:20.828133 30370 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.254:36143 every 8 connection(s)
I20260811 05:12:20.828413 30266 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
I20260811 05:12:20.829614 30372 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:12:20.832051 30372 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c5146f28a93440c48384f4c7d16a3548: Bootstrap starting.
I20260811 05:12:20.832698 30372 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c5146f28a93440c48384f4c7d16a3548: Neither blocks nor log segments found. Creating new log.
I20260811 05:12:20.833047 30372 log.cc:824] T 00000000000000000000000000000000 P c5146f28a93440c48384f4c7d16a3548: Log is configured to *not* fsync() on all Append() calls
I20260811 05:12:20.833768 30372 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c5146f28a93440c48384f4c7d16a3548: No bootstrap required, opened a new log
I20260811 05:12:20.835433 30372 raft_consensus.cc:348] T 00000000000000000000000000000000 P c5146f28a93440c48384f4c7d16a3548 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5146f28a93440c48384f4c7d16a3548" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 36143 } }
I20260811 05:12:20.835577 30372 raft_consensus.cc:374] T 00000000000000000000000000000000 P c5146f28a93440c48384f4c7d16a3548 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:12:20.835599 30372 raft_consensus.cc:729] T 00000000000000000000000000000000 P c5146f28a93440c48384f4c7d16a3548 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5146f28a93440c48384f4c7d16a3548, State: Initialized, Role: FOLLOWER
I20260811 05:12:20.835807 30372 consensus_queue.cc:260] T 00000000000000000000000000000000 P c5146f28a93440c48384f4c7d16a3548 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5146f28a93440c48384f4c7d16a3548" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 36143 } }
I20260811 05:12:20.835896 30372 raft_consensus.cc:388] T 00000000000000000000000000000000 P c5146f28a93440c48384f4c7d16a3548 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:12:20.835944 30372 raft_consensus.cc:482] T 00000000000000000000000000000000 P c5146f28a93440c48384f4c7d16a3548 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:12:20.835997 30372 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c5146f28a93440c48384f4c7d16a3548 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:12:20.836977 30372 raft_consensus.cc:504] T 00000000000000000000000000000000 P c5146f28a93440c48384f4c7d16a3548 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5146f28a93440c48384f4c7d16a3548" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 36143 } }
I20260811 05:12:20.837136 30372 leader_election.cc:302] T 00000000000000000000000000000000 P c5146f28a93440c48384f4c7d16a3548 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c5146f28a93440c48384f4c7d16a3548; no voters:
I20260811 05:12:20.837258 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 30266
I20260811 05:12:20.837321 30372 leader_election.cc:288] T 00000000000000000000000000000000 P c5146f28a93440c48384f4c7d16a3548 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 05:12:20.837396 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786424853995437-27391-0/minicluster-data/master-0/wal/instance
I20260811 05:12:20.837388 30375 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c5146f28a93440c48384f4c7d16a3548 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:12:20.837546 30375 raft_consensus.cc:686] T 00000000000000000000000000000000 P c5146f28a93440c48384f4c7d16a3548 [term 1 LEADER]: Becoming Leader. State: Replica: c5146f28a93440c48384f4c7d16a3548, State: Running, Role: LEADER
I20260811 05:12:20.837602 27391 external_mini_cluster.cc:1428] Setting key 4855324b061f05e37e58bdbbd1730339
I20260811 05:12:20.837628 30372 sys_catalog.cc:564] T 00000000000000000000000000000000 P c5146f28a93440c48384f4c7d16a3548 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:12:20.837714 30375 consensus_queue.cc:237] T 00000000000000000000000000000000 P c5146f28a93440c48384f4c7d16a3548 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5146f28a93440c48384f4c7d16a3548" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 36143 } }
I20260811 05:12:20.838693 30379 sys_catalog.cc:455] T 00000000000000000000000000000000 P c5146f28a93440c48384f4c7d16a3548 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c5146f28a93440c48384f4c7d16a3548. Latest consensus state: current_term: 1 leader_uuid: "c5146f28a93440c48384f4c7d16a3548" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5146f28a93440c48384f4c7d16a3548" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 36143 } } }
I20260811 05:12:20.838791 30379 sys_catalog.cc:458] T 00000000000000000000000000000000 P c5146f28a93440c48384f4c7d16a3548 [sys.catalog]: This master's current role is: LEADER
I20260811 05:12:20.838768 30376 sys_catalog.cc:455] T 00000000000000000000000000000000 P c5146f28a93440c48384f4c7d16a3548 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c5146f28a93440c48384f4c7d16a3548" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5146f28a93440c48384f4c7d16a3548" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 36143 } } }
I20260811 05:12:20.838860 30376 sys_catalog.cc:458] T 00000000000000000000000000000000 P c5146f28a93440c48384f4c7d16a3548 [sys.catalog]: This master's current role is: LEADER
I20260811 05:12:20.839041 30401 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:12:20.839848 30401 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:12:20.841408 30401 catalog_manager.cc:1347] Generated new cluster ID: b7b348d3bfa44af58686b891e453b1f6
I20260811 05:12:20.841470 30401 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:12:20.846110 30401 catalog_manager.cc:1370] Generated new certificate authority record
Aug 11 05:12:20 dist-test-slave-x5fp krb5kdc[30240](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425140, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
I20260811 05:12:20.846688 30401 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:12:20.852134 30391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:20.838317 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34803 (local address 127.26.191.254:36143)
0811 05:12:20.839004 (+ 687us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:20.839014 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:20.839106 (+ 92us) server_negotiation.cc:407] Connection header received
0811 05:12:20.839395 (+ 289us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:20.839403 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:20.839465 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:20.839637 (+ 172us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:12:20.840497 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:20.841961 (+ 1464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:20.843102 (+ 1141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:20.843796 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:20.843882 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:12:20.847091 (+ 3209us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:12:20.847096 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:12:20.847096 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:12:20.847110 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:12:20.849827 (+ 2717us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:12:20.850312 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:12:20.850315 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:12:20.850316 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:12:20.850445 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:12:20.850670 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:12:20.850671 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:12:20.850672 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:12:20.850986 (+ 314us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:12:20.851149 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0811 05:12:20.851720 (+ 571us) server_negotiation.cc:299] Negotiation successful
0811 05:12:20.851900 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105,"thread_start_us":82,"threads_started":1}
I20260811 05:12:20.853133 27391 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 05:12:20.856362 30401 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c5146f28a93440c48384f4c7d16a3548: Generated new TSK 0
I20260811 05:12:20.856566 30401 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 05:12:20.861927 30391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:20.854755 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50743 (local address 127.26.191.254:36143)
0811 05:12:20.854794 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:20.854796 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:20.854896 (+ 100us) server_negotiation.cc:407] Connection header received
0811 05:12:20.854944 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:20.854945 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:20.854955 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:20.855018 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:12:20.855657 (+ 639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:20.856481 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:20.857295 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:20.857616 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:20.857693 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:12:20.858962 (+ 1269us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:12:20.858963 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:12:20.858963 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:12:20.858971 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:12:20.860772 (+ 1801us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:12:20.861153 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:12:20.861154 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:12:20.861154 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:12:20.861223 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:12:20.861410 (+ 187us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:12:20.861411 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:12:20.861411 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:12:20.861549 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:12:20.861648 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0811 05:12:20.861737 (+ 89us) server_negotiation.cc:299] Negotiation successful
0811 05:12:20.861821 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 05:12:20.864499 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 30266
2026-08-11T05:12:20Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1689 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786424853995437-27391-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 05:12:20 dist-test-slave-x5fp krb5kdc[30422](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 05:12:20 dist-test-slave-x5fp krb5kdc[30422](info): set up 2 sockets
Aug 11 05:12:20 dist-test-slave-x5fp krb5kdc[30422](info): commencing operation
krb5kdc: starting...
W20260811 05:12:22.147917 27391 mini_kdc.cc:121] Time spent starting KDC: real 1.252s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786424853995437-27391-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786424853995437-27391-0/krb5kdc/test-user.keytab.
Aug 11 05:12:22 dist-test-slave-x5fp krb5kdc[30422](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425142, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T05:12:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:12:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.191.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.191.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.191.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab.
Entry for principal kudu/127.26.191.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab.
I20260811 05:12:22.282292 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786424853995437-27391-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786424853995437-27391-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786424853995437-27391-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.254:38417
--webserver_interface=127.26.191.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab
--principal=kudu/127.26.191.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:39879
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.191.254:38417
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:12:22.376322 30443 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:12:22.376569 30443 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:12:22.376597 30443 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:12:22.378050 30443 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:12:22.378104 30443 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:12:22.378121 30443 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:12:22.378136 30443 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:12:22.378150 30443 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:12:22.379886 30443 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:39879
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786424853995437-27391-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786424853995437-27391-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.191.254:38417
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab
--principal=kudu/127.26.191.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.254:38417
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.191.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30443
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786424853995437-27391-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:12:22.380165 30443 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:12:22.380435 30443 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:12:22.385609 30455 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:12:22.385622 30450 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:12:22.385666 30451 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:12:22.386004 30443 server_base.cc:1034] running on GCE node
I20260811 05:12:22.386281 30443 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:12:22.386547 30443 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:12:22.387753 30443 hybrid_clock.cc:648] HybridClock initialized: now 1786425142387747 us; error 45 us; skew 500 ppm
Aug 11 05:12:22 dist-test-slave-x5fp krb5kdc[30422](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425142, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:12:22.390528 30443 init.cc:377] Logged in from keytab as kudu/127.26.191.254@KRBTEST.COM (short username kudu)
I20260811 05:12:22.391021 30443 webserver.cc:460] Webserver started at http://127.26.191.254:41023/ using document root <none> and password file <none>
I20260811 05:12:22.391263 30443 fs_manager.cc:359] Metadata directory not provided
I20260811 05:12:22.391337 30443 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:12:22.391515 30443 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:12:22.392663 30443 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786424853995437-27391-0/minicluster-data/master-0/data/instance:
uuid: "667cb5082c0746fbae14043a79685f68"
format_stamp: "Formatted at 2026-08-11 05:12:22 on dist-test-slave-x5fp"
server_key: "3787f5ca983f962b4c68ecee705500f2"
server_key_iv: "135732bfd7789639f1ae67fbd263588d"
server_key_version: "encryptionkey@0"
I20260811 05:12:22.393119 30443 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786424853995437-27391-0/minicluster-data/master-0/wal/instance:
uuid: "667cb5082c0746fbae14043a79685f68"
format_stamp: "Formatted at 2026-08-11 05:12:22 on dist-test-slave-x5fp"
server_key: "3787f5ca983f962b4c68ecee705500f2"
server_key_iv: "135732bfd7789639f1ae67fbd263588d"
server_key_version: "encryptionkey@0"
I20260811 05:12:22.394589 30443 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 05:12:22.395512 30465 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:12:22.395730 30443 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:12:22.395848 30443 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786424853995437-27391-0/minicluster-data/master-0/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786424853995437-27391-0/minicluster-data/master-0/wal
uuid: "667cb5082c0746fbae14043a79685f68"
format_stamp: "Formatted at 2026-08-11 05:12:22 on dist-test-slave-x5fp"
server_key: "3787f5ca983f962b4c68ecee705500f2"
server_key_iv: "135732bfd7789639f1ae67fbd263588d"
server_key_version: "encryptionkey@0"
I20260811 05:12:22.395936 30443 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786424853995437-27391-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786424853995437-27391-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786424853995437-27391-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:12:22.426982 30443 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:12:22.429315 30443 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:12:22.429493 30443 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:12:22.434278 30443 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.254:38417
I20260811 05:12:22.434314 30547 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.254:38417 every 8 connection(s)
I20260811 05:12:22.434695 30443 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
I20260811 05:12:22.435632 30548 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:12:22.438221 30548 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 667cb5082c0746fbae14043a79685f68: Bootstrap starting.
I20260811 05:12:22.438844 30548 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 667cb5082c0746fbae14043a79685f68: Neither blocks nor log segments found. Creating new log.
I20260811 05:12:22.439101 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 30443
I20260811 05:12:22.439182 30548 log.cc:824] T 00000000000000000000000000000000 P 667cb5082c0746fbae14043a79685f68: Log is configured to *not* fsync() on all Append() calls
I20260811 05:12:22.439251 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786424853995437-27391-0/minicluster-data/master-0/wal/instance
I20260811 05:12:22.439420 27391 external_mini_cluster.cc:1428] Setting key 1daddfe0b215bc016642c6c45a7f2ad8
I20260811 05:12:22.440119 30548 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 667cb5082c0746fbae14043a79685f68: No bootstrap required, opened a new log
I20260811 05:12:22.442633 30548 raft_consensus.cc:348] T 00000000000000000000000000000000 P 667cb5082c0746fbae14043a79685f68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "667cb5082c0746fbae14043a79685f68" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 38417 } }
I20260811 05:12:22.442776 30548 raft_consensus.cc:374] T 00000000000000000000000000000000 P 667cb5082c0746fbae14043a79685f68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:12:22.442801 30548 raft_consensus.cc:729] T 00000000000000000000000000000000 P 667cb5082c0746fbae14043a79685f68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 667cb5082c0746fbae14043a79685f68, State: Initialized, Role: FOLLOWER
I20260811 05:12:22.442947 30548 consensus_queue.cc:260] T 00000000000000000000000000000000 P 667cb5082c0746fbae14043a79685f68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "667cb5082c0746fbae14043a79685f68" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 38417 } }
I20260811 05:12:22.443058 30548 raft_consensus.cc:388] T 00000000000000000000000000000000 P 667cb5082c0746fbae14043a79685f68 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:12:22.443091 30548 raft_consensus.cc:482] T 00000000000000000000000000000000 P 667cb5082c0746fbae14043a79685f68 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:12:22.443130 30548 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 667cb5082c0746fbae14043a79685f68 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:12:22.443873 30548 raft_consensus.cc:504] T 00000000000000000000000000000000 P 667cb5082c0746fbae14043a79685f68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "667cb5082c0746fbae14043a79685f68" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 38417 } }
I20260811 05:12:22.443976 30548 leader_election.cc:302] T 00000000000000000000000000000000 P 667cb5082c0746fbae14043a79685f68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 667cb5082c0746fbae14043a79685f68; no voters:
I20260811 05:12:22.444165 30548 leader_election.cc:288] T 00000000000000000000000000000000 P 667cb5082c0746fbae14043a79685f68 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 05:12:22.444239 30555 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 667cb5082c0746fbae14043a79685f68 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:12:22.444444 30555 raft_consensus.cc:686] T 00000000000000000000000000000000 P 667cb5082c0746fbae14043a79685f68 [term 1 LEADER]: Becoming Leader. State: Replica: 667cb5082c0746fbae14043a79685f68, State: Running, Role: LEADER
I20260811 05:12:22.444463 30548 sys_catalog.cc:564] T 00000000000000000000000000000000 P 667cb5082c0746fbae14043a79685f68 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:12:22.444602 30555 consensus_queue.cc:237] T 00000000000000000000000000000000 P 667cb5082c0746fbae14043a79685f68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "667cb5082c0746fbae14043a79685f68" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 38417 } }
I20260811 05:12:22.445290 30560 sys_catalog.cc:455] T 00000000000000000000000000000000 P 667cb5082c0746fbae14043a79685f68 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 667cb5082c0746fbae14043a79685f68. Latest consensus state: current_term: 1 leader_uuid: "667cb5082c0746fbae14043a79685f68" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "667cb5082c0746fbae14043a79685f68" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 38417 } } }
I20260811 05:12:22.445392 30554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:22.440025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40705 (local address 127.26.191.254:38417)
0811 05:12:22.440246 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:22.440256 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:22.440291 (+ 35us) server_negotiation.cc:407] Connection header received
0811 05:12:22.440794 (+ 503us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:22.440804 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:22.440863 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:22.441004 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:12:22.441223 (+ 219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:22.442117 (+ 894us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:22.443006 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:22.443633 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:22.443763 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:12:22.444563 (+ 800us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:12:22.444567 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:12:22.444568 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:12:22.444845 (+ 277us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:12:22.444884 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:12:22.444900 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:12:22.444965 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 05:12:22.445091 (+ 126us) server_negotiation.cc:299] Negotiation successful
0811 05:12:22.445162 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":112,"threads_started":1}
I20260811 05:12:22.445394 30560 sys_catalog.cc:458] T 00000000000000000000000000000000 P 667cb5082c0746fbae14043a79685f68 [sys.catalog]: This master's current role is: LEADER
I20260811 05:12:22.445528 30557 sys_catalog.cc:455] T 00000000000000000000000000000000 P 667cb5082c0746fbae14043a79685f68 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "667cb5082c0746fbae14043a79685f68" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "667cb5082c0746fbae14043a79685f68" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 38417 } } }
I20260811 05:12:22.445611 30557 sys_catalog.cc:458] T 00000000000000000000000000000000 P 667cb5082c0746fbae14043a79685f68 [sys.catalog]: This master's current role is: LEADER
I20260811 05:12:22.446170 30571 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:12:22.446708 30571 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:12:22.446708 27391 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 05:12:22.449198 30571 catalog_manager.cc:1347] Generated new cluster ID: 86c9f4eefe464451af4062c60a021d44
I20260811 05:12:22.449258 30571 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:12:22.455796 30554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:22.449448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59171 (local address 127.26.191.254:38417)
0811 05:12:22.449486 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:22.449488 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:22.452955 (+ 3467us) server_negotiation.cc:407] Connection header received
0811 05:12:22.453040 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:22.453042 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:22.453053 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:22.453107 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:12:22.453261 (+ 154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:22.453748 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:22.454500 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:22.454712 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:22.454788 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:12:22.455524 (+ 736us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:12:22.455525 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:12:22.455526 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:12:22.455531 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:12:22.455547 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:12:22.455552 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:12:22.455606 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 05:12:22.455665 (+ 59us) server_negotiation.cc:299] Negotiation successful
0811 05:12:22.455689 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 05:12:22.469475 30571 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:12:22.470232 30571 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:12:22.473930 30571 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 667cb5082c0746fbae14043a79685f68: Generated new TSK 0
I20260811 05:12:22.474136 30571 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 05:12:22.480844 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 30443
2026-08-11T05:12:22Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1614 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786424853995437-27391-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 05:12:22 dist-test-slave-x5fp krb5kdc[30597](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 05:12:22 dist-test-slave-x5fp krb5kdc[30597](info): set up 2 sockets
Aug 11 05:12:22 dist-test-slave-x5fp krb5kdc[30597](info): commencing operation
krb5kdc: starting...
W20260811 05:12:23.754338 27391 mini_kdc.cc:121] Time spent starting KDC: real 1.243s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786424853995437-27391-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786424853995437-27391-0/krb5kdc/test-user.keytab.
Aug 11 05:12:23 dist-test-slave-x5fp krb5kdc[30597](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425143, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T05:12:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:12:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.191.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.191.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.191.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab.
Entry for principal kudu/127.26.191.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab.
I20260811 05:12:23.890034 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786424853995437-27391-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786424853995437-27391-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786424853995437-27391-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.254:41179
--webserver_interface=127.26.191.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab
--principal=kudu/127.26.191.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:39885
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.191.254:41179
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:12:23.981417 30620 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:12:23.981668 30620 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:12:23.981709 30620 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:12:23.982941 30620 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:12:23.983018 30620 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:12:23.983042 30620 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:12:23.983064 30620 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:12:23.983093 30620 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:12:23.984591 30620 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:39885
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786424853995437-27391-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786424853995437-27391-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.191.254:41179
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab
--principal=kudu/127.26.191.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.254:41179
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.191.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30620
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786424853995437-27391-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:12:23.984905 30620 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:12:23.985152 30620 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:12:23.990207 30627 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:12:23.990180 30631 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:12:23.990258 30628 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:12:23.990386 30620 server_base.cc:1034] running on GCE node
I20260811 05:12:23.990722 30620 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:12:23.991048 30620 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:12:23.992234 30620 hybrid_clock.cc:648] HybridClock initialized: now 1786425143992229 us; error 58 us; skew 500 ppm
Aug 11 05:12:23 dist-test-slave-x5fp krb5kdc[30597](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425143, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:12:23.995010 30620 init.cc:377] Logged in from keytab as kudu/127.26.191.254@KRBTEST.COM (short username kudu)
I20260811 05:12:23.995507 30620 webserver.cc:460] Webserver started at http://127.26.191.254:36051/ using document root <none> and password file <none>
I20260811 05:12:23.995750 30620 fs_manager.cc:359] Metadata directory not provided
I20260811 05:12:23.995826 30620 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:12:23.995990 30620 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:12:23.997215 30620 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786424853995437-27391-0/minicluster-data/master-0/data/instance:
uuid: "d90145c2bbb9403f815681a9bcef7475"
format_stamp: "Formatted at 2026-08-11 05:12:23 on dist-test-slave-x5fp"
server_key: "cf7bc76a9e563c2d26be207bf30bde9a"
server_key_iv: "6a0473e05866f5dcab59cf6b58f5a94c"
server_key_version: "encryptionkey@0"
I20260811 05:12:23.997617 30620 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786424853995437-27391-0/minicluster-data/master-0/wal/instance:
uuid: "d90145c2bbb9403f815681a9bcef7475"
format_stamp: "Formatted at 2026-08-11 05:12:23 on dist-test-slave-x5fp"
server_key: "cf7bc76a9e563c2d26be207bf30bde9a"
server_key_iv: "6a0473e05866f5dcab59cf6b58f5a94c"
server_key_version: "encryptionkey@0"
I20260811 05:12:23.999154 30620 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 05:12:24.000085 30641 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:12:24.000451 30620 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:12:24.000598 30620 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786424853995437-27391-0/minicluster-data/master-0/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786424853995437-27391-0/minicluster-data/master-0/wal
uuid: "d90145c2bbb9403f815681a9bcef7475"
format_stamp: "Formatted at 2026-08-11 05:12:23 on dist-test-slave-x5fp"
server_key: "cf7bc76a9e563c2d26be207bf30bde9a"
server_key_iv: "6a0473e05866f5dcab59cf6b58f5a94c"
server_key_version: "encryptionkey@0"
I20260811 05:12:24.000691 30620 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786424853995437-27391-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786424853995437-27391-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786424853995437-27391-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:12:24.004231 30620 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:12:24.006496 30620 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:12:24.006656 30620 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:12:24.010991 30620 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.254:41179
I20260811 05:12:24.011024 30719 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.254:41179 every 8 connection(s)
I20260811 05:12:24.011394 30620 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
I20260811 05:12:24.012460 30720 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:12:24.014999 30720 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d90145c2bbb9403f815681a9bcef7475: Bootstrap starting.
I20260811 05:12:24.015625 30720 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d90145c2bbb9403f815681a9bcef7475: Neither blocks nor log segments found. Creating new log.
I20260811 05:12:24.015951 30720 log.cc:824] T 00000000000000000000000000000000 P d90145c2bbb9403f815681a9bcef7475: Log is configured to *not* fsync() on all Append() calls
I20260811 05:12:24.016510 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 30620
I20260811 05:12:24.016639 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786424853995437-27391-0/minicluster-data/master-0/wal/instance
I20260811 05:12:24.016856 27391 external_mini_cluster.cc:1428] Setting key e551ed40b47c16070c940a51d921f4b0
I20260811 05:12:24.016935 30720 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d90145c2bbb9403f815681a9bcef7475: No bootstrap required, opened a new log
I20260811 05:12:24.019411 30720 raft_consensus.cc:348] T 00000000000000000000000000000000 P d90145c2bbb9403f815681a9bcef7475 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d90145c2bbb9403f815681a9bcef7475" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 41179 } }
I20260811 05:12:24.019608 30720 raft_consensus.cc:374] T 00000000000000000000000000000000 P d90145c2bbb9403f815681a9bcef7475 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:12:24.019650 30720 raft_consensus.cc:729] T 00000000000000000000000000000000 P d90145c2bbb9403f815681a9bcef7475 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d90145c2bbb9403f815681a9bcef7475, State: Initialized, Role: FOLLOWER
I20260811 05:12:24.019783 30720 consensus_queue.cc:260] T 00000000000000000000000000000000 P d90145c2bbb9403f815681a9bcef7475 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d90145c2bbb9403f815681a9bcef7475" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 41179 } }
I20260811 05:12:24.019899 30720 raft_consensus.cc:388] T 00000000000000000000000000000000 P d90145c2bbb9403f815681a9bcef7475 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:12:24.019932 30720 raft_consensus.cc:482] T 00000000000000000000000000000000 P d90145c2bbb9403f815681a9bcef7475 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:12:24.019973 30720 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d90145c2bbb9403f815681a9bcef7475 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:12:24.020021 30724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:24.017452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45733 (local address 127.26.191.254:41179)
0811 05:12:24.017694 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:24.017706 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:24.017754 (+ 48us) server_negotiation.cc:407] Connection header received
0811 05:12:24.018438 (+ 684us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:24.018450 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:24.018487 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:24.018646 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:12:24.019371 (+ 725us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:12:24.019375 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:12:24.019375 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:12:24.019380 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:12:24.019434 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:12:24.019450 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:12:24.019529 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 05:12:24.019586 (+ 57us) server_negotiation.cc:299] Negotiation successful
0811 05:12:24.019628 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":175,"thread_start_us":104,"threads_started":1}
I20260811 05:12:24.020829 30720 raft_consensus.cc:504] T 00000000000000000000000000000000 P d90145c2bbb9403f815681a9bcef7475 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d90145c2bbb9403f815681a9bcef7475" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 41179 } }
I20260811 05:12:24.020952 30720 leader_election.cc:302] T 00000000000000000000000000000000 P d90145c2bbb9403f815681a9bcef7475 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d90145c2bbb9403f815681a9bcef7475; no voters:
I20260811 05:12:24.021140 30720 leader_election.cc:288] T 00000000000000000000000000000000 P d90145c2bbb9403f815681a9bcef7475 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 05:12:24.021167 27391 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 05:12:24.021188 30726 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d90145c2bbb9403f815681a9bcef7475 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:12:24.021379 30726 raft_consensus.cc:686] T 00000000000000000000000000000000 P d90145c2bbb9403f815681a9bcef7475 [term 1 LEADER]: Becoming Leader. State: Replica: d90145c2bbb9403f815681a9bcef7475, State: Running, Role: LEADER
I20260811 05:12:24.021406 30720 sys_catalog.cc:564] T 00000000000000000000000000000000 P d90145c2bbb9403f815681a9bcef7475 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:12:24.021492 30726 consensus_queue.cc:237] T 00000000000000000000000000000000 P d90145c2bbb9403f815681a9bcef7475 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d90145c2bbb9403f815681a9bcef7475" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 41179 } }
I20260811 05:12:24.021806 30726 sys_catalog.cc:455] T 00000000000000000000000000000000 P d90145c2bbb9403f815681a9bcef7475 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d90145c2bbb9403f815681a9bcef7475. Latest consensus state: current_term: 1 leader_uuid: "d90145c2bbb9403f815681a9bcef7475" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d90145c2bbb9403f815681a9bcef7475" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 41179 } } }
I20260811 05:12:24.021898 30726 sys_catalog.cc:458] T 00000000000000000000000000000000 P d90145c2bbb9403f815681a9bcef7475 [sys.catalog]: This master's current role is: LEADER
I20260811 05:12:24.021818 30728 sys_catalog.cc:455] T 00000000000000000000000000000000 P d90145c2bbb9403f815681a9bcef7475 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d90145c2bbb9403f815681a9bcef7475" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d90145c2bbb9403f815681a9bcef7475" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 41179 } } }
I20260811 05:12:24.022043 30728 sys_catalog.cc:458] T 00000000000000000000000000000000 P d90145c2bbb9403f815681a9bcef7475 [sys.catalog]: This master's current role is: LEADER
I20260811 05:12:24.022120 30737 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:12:24.022651 30737 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:12:24.024564 30737 catalog_manager.cc:1347] Generated new cluster ID: ea899345c12c45f184b6037581fbae27
I20260811 05:12:24.024622 30737 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:12:24.025514 30724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:24.023972 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56225 (local address 127.26.191.254:41179)
0811 05:12:24.024011 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:24.024013 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:24.024378 (+ 365us) server_negotiation.cc:407] Connection header received
0811 05:12:24.024463 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:24.024464 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:24.024470 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:24.024523 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:12:24.025284 (+ 761us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:12:24.025285 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:12:24.025285 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:12:24.025290 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:12:24.025306 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:12:24.025310 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:12:24.025361 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 05:12:24.025414 (+ 53us) server_negotiation.cc:299] Negotiation successful
0811 05:12:24.025429 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 05:12:24.037300 30737 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:12:24.037520 30737 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:12:24.043015 30737 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d90145c2bbb9403f815681a9bcef7475: Generated new TSK 0
I20260811 05:12:24.043236 30737 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 05:12:24.049799 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 30620
2026-08-11T05:12:24Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1581 ms)
[----------] 18 tests from AuthTokenIssuingTest (29331 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424853995437-27391-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 05:12:24 dist-test-slave-x5fp krb5kdc[30776](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 05:12:24 dist-test-slave-x5fp krb5kdc[30776](info): set up 2 sockets
Aug 11 05:12:24 dist-test-slave-x5fp krb5kdc[30776](info): commencing operation
krb5kdc: starting...
W20260811 05:12:25.343603 27391 mini_kdc.cc:121] Time spent starting KDC: real 1.251s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424853995437-27391-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424853995437-27391-0/krb5kdc/test-user.keytab.
Aug 11 05:12:25 dist-test-slave-x5fp krb5kdc[30776](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425145, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T05:12:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:12:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.191.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.191.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.191.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab.
Entry for principal kudu/127.26.191.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab.
I20260811 05:12:25.477818 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424853995437-27391-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424853995437-27391-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424853995437-27391-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.254:40375
--webserver_interface=127.26.191.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab
--principal=kudu/127.26.191.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:34845
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.191.254:40375,127.26.191.253:35905,127.26.191.252:34991
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:12:25.565058 30795 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 05:12:25.565346 30795 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:12:25.565380 30795 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:12:25.565430 30795 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:12:25.566617 30795 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:12:25.566699 30795 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:12:25.566730 30795 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:12:25.566766 30795 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:12:25.566792 30795 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:12:25.568657 30795 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:34845
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424853995437-27391-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424853995437-27391-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.191.254:40375,127.26.191.253:35905,127.26.191.252:34991
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab
--principal=kudu/127.26.191.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.254:40375
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.191.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30795
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424853995437-27391-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:12:25.568965 30795 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:12:25.569168 30795 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:12:25.574263 30809 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:12:25.574252 30810 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:12:25.574249 30813 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:12:25.574577 30795 server_base.cc:1034] running on GCE node
I20260811 05:12:25.574865 30795 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:12:25.575172 30795 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:12:25.576364 30795 hybrid_clock.cc:648] HybridClock initialized: now 1786425145576345 us; error 57 us; skew 500 ppm
Aug 11 05:12:25 dist-test-slave-x5fp krb5kdc[30776](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425145, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:12:25.579087 30795 init.cc:377] Logged in from keytab as kudu/127.26.191.254@KRBTEST.COM (short username kudu)
I20260811 05:12:25.579574 30795 webserver.cc:460] Webserver started at http://127.26.191.254:43027/ using document root <none> and password file <none>
I20260811 05:12:25.579816 30795 fs_manager.cc:359] Metadata directory not provided
I20260811 05:12:25.579865 30795 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:12:25.579994 30795 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:12:25.581180 30795 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424853995437-27391-0/minicluster-data/master-0/data/instance:
uuid: "7b75e9aaa50e4579978f0082f475dbab"
format_stamp: "Formatted at 2026-08-11 05:12:25 on dist-test-slave-x5fp"
server_key: "4e5cb315a3e6395bf04fec22c21f156d"
server_key_iv: "8dc140c39f19d8f64865d50127c7a44e"
server_key_version: "encryptionkey@0"
I20260811 05:12:25.581557 30795 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424853995437-27391-0/minicluster-data/master-0/wal/instance:
uuid: "7b75e9aaa50e4579978f0082f475dbab"
format_stamp: "Formatted at 2026-08-11 05:12:25 on dist-test-slave-x5fp"
server_key: "4e5cb315a3e6395bf04fec22c21f156d"
server_key_iv: "8dc140c39f19d8f64865d50127c7a44e"
server_key_version: "encryptionkey@0"
I20260811 05:12:25.582958 30795 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260811 05:12:25.583799 30825 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:12:25.584074 30795 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:12:25.584189 30795 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424853995437-27391-0/minicluster-data/master-0/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424853995437-27391-0/minicluster-data/master-0/wal
uuid: "7b75e9aaa50e4579978f0082f475dbab"
format_stamp: "Formatted at 2026-08-11 05:12:25 on dist-test-slave-x5fp"
server_key: "4e5cb315a3e6395bf04fec22c21f156d"
server_key_iv: "8dc140c39f19d8f64865d50127c7a44e"
server_key_version: "encryptionkey@0"
I20260811 05:12:25.584275 30795 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424853995437-27391-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424853995437-27391-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424853995437-27391-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:12:25.607323 30795 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:12:25.609867 30795 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:12:25.610040 30795 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:12:25.614567 30795 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.254:40375
I20260811 05:12:25.614609 30915 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.254:40375 every 8 connection(s)
I20260811 05:12:25.615058 30795 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
I20260811 05:12:25.616001 30916 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:12:25.617724 30916 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.191.254" port: 40375 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 05:12:25 dist-test-slave-x5fp krb5kdc[30776](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425145, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.254@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
I20260811 05:12:25.624325 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 30795
I20260811 05:12:25.624475 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424853995437-27391-0/minicluster-data/master-0/wal/instance
I20260811 05:12:25.624715 27391 external_mini_cluster.cc:1428] Setting key 6476993f89cc1371da65c608e8353f47
I20260811 05:12:25.628608 30921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:25.618445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52104 (local address 127.26.191.254:40375)
0811 05:12:25.618615 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:25.618626 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:25.618760 (+ 134us) server_negotiation.cc:407] Connection header received
0811 05:12:25.619370 (+ 610us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:25.619372 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:25.619393 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:25.619492 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:12:25.620072 (+ 580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:25.621000 (+ 928us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:25.621895 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:25.622212 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:25.622350 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:12:25.624629 (+ 2279us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:12:25.624639 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:12:25.624640 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:12:25.624648 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:12:25.626669 (+ 2021us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:12:25.627207 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:12:25.627210 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:12:25.627210 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:12:25.627295 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:12:25.627579 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:12:25.627580 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:12:25.627580 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:12:25.627791 (+ 211us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:12:25.627858 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 05:12:25.628151 (+ 293us) server_negotiation.cc:299] Negotiation successful
0811 05:12:25.628333 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":78,"threads_started":1}
I20260811 05:12:25.628611 30920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:25.618375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:40375 (local address 127.0.0.1:52104)
0811 05:12:25.618605 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0811 05:12:25.618652 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 05:12:25.619194 (+ 542us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:12:25.619514 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:12:25.619516 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:12:25.619790 (+ 274us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:12:25.619956 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:12:25.619961 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:12:25.621112 (+ 1151us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:12:25.621113 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:12:25.621773 (+ 660us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:12:25.621774 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:12:25.622313 (+ 539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:12:25.622315 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:12:25.622381 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:12:25.622933 (+ 552us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:12:25.622941 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:12:25.624508 (+ 1567us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:12:25.626769 (+ 2261us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:12:25.626779 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:12:25.626781 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:12:25.627111 (+ 330us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:12:25.627377 (+ 266us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:12:25.627378 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:12:25.627379 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:12:25.627508 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:12:25.627864 (+ 356us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:12:25.627871 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:12:25.627958 (+ 87us) client_negotiation.cc:769] Sending connection context
0811 05:12:25.628086 (+ 128us) client_negotiation.cc:240] Negotiation successful
0811 05:12:25.628415 (+ 329us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":187,"mutex_wait_us":148,"thread_start_us":95,"threads_started":1}
I20260811 05:12:25.629859 30916 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.191.253" port: 35905 } has no permanent_uuid. Determining permanent_uuid...
I20260811 05:12:25.630249 30920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:25.630122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.253:35905 (local address 127.0.0.1:42668)
0811 05:12:25.630176 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0811 05:12:25.630226 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.253:35905: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260811 05:12:25.630395 30830 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.191.253:35905: connect: Connection refused (error 111)
I20260811 05:12:25.630888 30920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:25.630769 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.253:35905 (local address 127.0.0.1:42678)
0811 05:12:25.630826 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0811 05:12:25.630860 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.253:35905: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260811 05:12:25.631069 30916 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.191.253:35905: Network error: Client connection negotiation failed: client connection to 127.26.191.253:35905: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.26.191.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.191.253@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.191.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.253.keytab.
Entry for principal kudu/127.26.191.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.253.keytab.
I20260811 05:12:25.655963 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424853995437-27391-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424853995437-27391-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424853995437-27391-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424853995437-27391-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.253:35905
--webserver_interface=127.26.191.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.253.keytab
--principal=kudu/127.26.191.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:34845
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.191.254:40375,127.26.191.253:35905,127.26.191.252:34991
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 05:12:25.680341 30916 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.191.253" port: 35905 } attempt: 1
I20260811 05:12:25.680927 30920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:25.680713 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.253:35905 (local address 127.0.0.1:42684)
0811 05:12:25.680830 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0811 05:12:25.680885 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.253:35905: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85}
I20260811 05:12:25.681324 30920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:25.681221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.253:35905 (local address 127.0.0.1:42686)
0811 05:12:25.681270 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0811 05:12:25.681301 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.253:35905: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260811 05:12:25.681494 30916 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.191.253:35905: Network error: Client connection negotiation failed: client connection to 127.26.191.253:35905: connect: Connection refused (error 111)
W20260811 05:12:25.741716 30928 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 05:12:25.741937 30928 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:12:25.741954 30928 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:12:25.741976 30928 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:12:25.743180 30928 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:12:25.743225 30928 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:12:25.743239 30928 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:12:25.743252 30928 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:12:25.743264 30928 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:12:25.744807 30928 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:34845
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424853995437-27391-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424853995437-27391-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.26.191.254:40375,127.26.191.253:35905,127.26.191.252:34991
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.253.keytab
--principal=kudu/127.26.191.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.253:35905
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424853995437-27391-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.26.191.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30928
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424853995437-27391-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:12:25.745070 30928 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:12:25.745317 30928 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 05:12:25.749696 30916 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.191.253" port: 35905 } attempt: 2
I20260811 05:12:25.750191 30920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:25.750042 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.253:35905 (local address 127.0.0.1:42692)
0811 05:12:25.750113 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0811 05:12:25.750145 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.253:35905: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
W20260811 05:12:25.750283 30935 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:12:25.750265 30939 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:12:25.750502 30943 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:12:25.750670 30920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:25.750531 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.253:35905 (local address 127.0.0.1:42696)
0811 05:12:25.750579 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0811 05:12:25.750633 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.253:35905: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260811 05:12:25.750766 30916 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.191.253:35905: Network error: Client connection negotiation failed: client connection to 127.26.191.253:35905: connect: Connection refused (error 111)
I20260811 05:12:25.750855 30928 server_base.cc:1034] running on GCE node
I20260811 05:12:25.751116 30928 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:12:25.751370 30928 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:12:25.752547 30928 hybrid_clock.cc:648] HybridClock initialized: now 1786425145752532 us; error 31 us; skew 500 ppm
Aug 11 05:12:25 dist-test-slave-x5fp krb5kdc[30776](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425145, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:12:25.755302 30928 init.cc:377] Logged in from keytab as kudu/127.26.191.253@KRBTEST.COM (short username kudu)
I20260811 05:12:25.755748 30928 webserver.cc:460] Webserver started at http://127.26.191.253:33419/ using document root <none> and password file <none>
I20260811 05:12:25.756002 30928 fs_manager.cc:359] Metadata directory not provided
I20260811 05:12:25.756073 30928 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:12:25.756240 30928 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:12:25.757414 30928 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424853995437-27391-0/minicluster-data/master-1/data/instance:
uuid: "3d3099e7f3d541cf8e8b7e79976de1de"
format_stamp: "Formatted at 2026-08-11 05:12:25 on dist-test-slave-x5fp"
server_key: "c9afde8788e2dcbf547637a942199ebb"
server_key_iv: "d3e5e35c31c22e76c52792db857fc4c6"
server_key_version: "encryptionkey@0"
I20260811 05:12:25.757797 30928 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424853995437-27391-0/minicluster-data/master-1/wal/instance:
uuid: "3d3099e7f3d541cf8e8b7e79976de1de"
format_stamp: "Formatted at 2026-08-11 05:12:25 on dist-test-slave-x5fp"
server_key: "c9afde8788e2dcbf547637a942199ebb"
server_key_iv: "d3e5e35c31c22e76c52792db857fc4c6"
server_key_version: "encryptionkey@0"
I20260811 05:12:25.759179 30928 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 05:12:25.760018 30956 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:12:25.760257 30928 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 05:12:25.760370 30928 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424853995437-27391-0/minicluster-data/master-1/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424853995437-27391-0/minicluster-data/master-1/wal
uuid: "3d3099e7f3d541cf8e8b7e79976de1de"
format_stamp: "Formatted at 2026-08-11 05:12:25 on dist-test-slave-x5fp"
server_key: "c9afde8788e2dcbf547637a942199ebb"
server_key_iv: "d3e5e35c31c22e76c52792db857fc4c6"
server_key_version: "encryptionkey@0"
I20260811 05:12:25.760448 30928 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424853995437-27391-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424853995437-27391-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424853995437-27391-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:12:25.773197 30928 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:12:25.775287 30928 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:12:25.775460 30928 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:12:25.779700 30928 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.253:35905
I20260811 05:12:25.779763 31050 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.253:35905 every 8 connection(s)
I20260811 05:12:25.780145 30928 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424853995437-27391-0/minicluster-data/master-1/data/info.pb
I20260811 05:12:25.781160 31051 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:12:25.781930 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 30928
I20260811 05:12:25.782070 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424853995437-27391-0/minicluster-data/master-1/wal/instance
I20260811 05:12:25.782251 27391 external_mini_cluster.cc:1428] Setting key e385f4ada2c8f6957e5c1d836833b491
I20260811 05:12:25.782894 31051 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.191.254" port: 40375 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 05:12:25 dist-test-slave-x5fp krb5kdc[30776](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425145, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.253@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.26.191.252@KRBTEST.COM; defaulting to no policy
I20260811 05:12:25.793210 30921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:25.783639 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52110 (local address 127.26.191.254:40375)
0811 05:12:25.783714 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:25.783716 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:25.783903 (+ 187us) server_negotiation.cc:407] Connection header received
0811 05:12:25.784626 (+ 723us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:25.784628 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:25.784641 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:25.784701 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:12:25.785617 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:25.786390 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:25.787491 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:25.787880 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:25.787957 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:12:25.790210 (+ 2253us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:12:25.790212 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:12:25.790212 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:12:25.790220 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:12:25.791847 (+ 1627us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:12:25.792300 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:12:25.792301 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:12:25.792302 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:12:25.792370 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:12:25.792598 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:12:25.792598 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:12:25.792599 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:12:25.792698 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:12:25.792823 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0811 05:12:25.793076 (+ 253us) server_negotiation.cc:299] Negotiation successful
0811 05:12:25.793145 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 05:12:25.793481 31056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:25.783568 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:40375 (local address 127.0.0.1:52110)
0811 05:12:25.783766 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0811 05:12:25.783808 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 05:12:25.784514 (+ 706us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:12:25.784796 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:12:25.784801 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:12:25.785181 (+ 380us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:12:25.785488 (+ 307us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:12:25.785501 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:12:25.786506 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:12:25.786507 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:12:25.787407 (+ 900us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:12:25.787410 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:12:25.787962 (+ 552us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:12:25.787963 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:12:25.788073 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:12:25.788668 (+ 595us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:12:25.788676 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:12:25.790113 (+ 1437us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:12:25.791940 (+ 1827us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:12:25.791946 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:12:25.791948 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:12:25.792219 (+ 271us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:12:25.792449 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:12:25.792450 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:12:25.792450 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:12:25.792555 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:12:25.792818 (+ 263us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:12:25.792824 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:12:25.792941 (+ 117us) client_negotiation.cc:769] Sending connection context
0811 05:12:25.793061 (+ 120us) client_negotiation.cc:240] Negotiation successful
0811 05:12:25.793208 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":83,"threads_started":1}
I20260811 05:12:25.794246 31051 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.191.253" port: 35905 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.191.252@KRBTEST.COM" created.
Aug 11 05:12:25 dist-test-slave-x5fp krb5kdc[30776](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425145, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.253@KRBTEST.COM for kudu/127.26.191.253@KRBTEST.COM
I20260811 05:12:25.802968 31056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:25.794540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.253:35905 (local address 127.0.0.1:42704)
0811 05:12:25.794595 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0811 05:12:25.794608 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 05:12:25.794652 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:12:25.795049 (+ 397us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:12:25.795050 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:12:25.795176 (+ 126us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:12:25.795242 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:12:25.795243 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:12:25.796483 (+ 1240us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:12:25.796484 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:12:25.797092 (+ 608us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:12:25.797094 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:12:25.797680 (+ 586us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:12:25.797681 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:12:25.797756 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:12:25.798184 (+ 428us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:12:25.798189 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:12:25.799714 (+ 1525us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:12:25.801654 (+ 1940us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:12:25.801656 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:12:25.801656 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:12:25.801928 (+ 272us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:12:25.802160 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:12:25.802161 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:12:25.802161 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:12:25.802241 (+ 80us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:12:25.802528 (+ 287us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:12:25.802529 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:12:25.802580 (+ 51us) client_negotiation.cc:769] Sending connection context
0811 05:12:25.802662 (+ 82us) client_negotiation.cc:240] Negotiation successful
0811 05:12:25.802776 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260811 05:12:25.802973 31059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:25.794691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42704 (local address 127.26.191.253:35905)
0811 05:12:25.794893 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:25.794898 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:25.794923 (+ 25us) server_negotiation.cc:407] Connection header received
0811 05:12:25.794946 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:25.794948 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:25.794962 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:25.795037 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:12:25.795335 (+ 298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:25.796389 (+ 1054us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:25.797201 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:25.797574 (+ 373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:25.797681 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:12:25.799808 (+ 2127us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:12:25.799817 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:12:25.799817 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:12:25.799823 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:12:25.801557 (+ 1734us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:12:25.802023 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:12:25.802026 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:12:25.802026 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:12:25.802084 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:12:25.802312 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:12:25.802313 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:12:25.802313 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:12:25.802456 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:12:25.802520 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 05:12:25.802727 (+ 207us) server_negotiation.cc:299] Negotiation successful
0811 05:12:25.802819 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":24,"server-negotiator.queue_time_us":169,"thread_start_us":119,"threads_started":1}
I20260811 05:12:25.803777 31051 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.191.252" port: 34991 } has no permanent_uuid. Determining permanent_uuid...
I20260811 05:12:25.804147 31056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:25.804011 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.252:34991 (local address 127.0.0.1:59652)
0811 05:12:25.804066 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0811 05:12:25.804122 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.252:34991: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260811 05:12:25.804298 30957 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.191.252:34991: connect: Connection refused (error 111)
I20260811 05:12:25.804659 31056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:25.804598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.252:34991 (local address 127.0.0.1:59656)
0811 05:12:25.804620 (+ 22us) negotiation.cc:107] Waiting for socket to connect
0811 05:12:25.804642 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.252:34991: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":12}
W20260811 05:12:25.804798 31051 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.191.252:34991: Network error: Client connection negotiation failed: client connection to 127.26.191.252:34991: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.191.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.252.keytab.
Entry for principal kudu/127.26.191.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.252.keytab.
I20260811 05:12:25.811973 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424853995437-27391-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424853995437-27391-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424853995437-27391-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424853995437-27391-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.252:34991
--webserver_interface=127.26.191.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.252.keytab
--principal=kudu/127.26.191.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:34845
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.191.254:40375,127.26.191.253:35905,127.26.191.252:34991
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 05:12:25.841945 30916 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.191.253" port: 35905 } attempt: 3
Aug 11 05:12:25 dist-test-slave-x5fp krb5kdc[30776](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425145, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.254@KRBTEST.COM for kudu/127.26.191.253@KRBTEST.COM
I20260811 05:12:25.849429 30920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:25.842349 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.253:35905 (local address 127.0.0.1:42710)
0811 05:12:25.842422 (+ 73us) negotiation.cc:107] Waiting for socket to connect
0811 05:12:25.842442 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 05:12:25.842511 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:12:25.842664 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:12:25.842665 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:12:25.842864 (+ 199us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:12:25.842937 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:12:25.842939 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:12:25.843634 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:12:25.843635 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:12:25.844196 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:12:25.844198 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:12:25.844617 (+ 419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:12:25.844618 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:12:25.844699 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:12:25.845267 (+ 568us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:12:25.845272 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:12:25.846671 (+ 1399us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:12:25.848331 (+ 1660us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:12:25.848332 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:12:25.848333 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:12:25.848509 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:12:25.848754 (+ 245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:12:25.848755 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:12:25.848756 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:12:25.848821 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:12:25.849087 (+ 266us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:12:25.849088 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:12:25.849133 (+ 45us) client_negotiation.cc:769] Sending connection context
0811 05:12:25.849220 (+ 87us) client_negotiation.cc:240] Negotiation successful
0811 05:12:25.849325 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46}
I20260811 05:12:25.849429 31059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:25.842441 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42710 (local address 127.26.191.253:35905)
0811 05:12:25.842518 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:25.842520 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:25.842533 (+ 13us) server_negotiation.cc:407] Connection header received
0811 05:12:25.842584 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:25.842585 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:25.842595 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:25.842656 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:12:25.843026 (+ 370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:25.843540 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:25.844290 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:25.844530 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:25.844609 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:12:25.846772 (+ 2163us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:12:25.846774 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:12:25.846774 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:12:25.846785 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:12:25.848205 (+ 1420us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:12:25.848597 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:12:25.848599 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:12:25.848599 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:12:25.848661 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:12:25.848887 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:12:25.848888 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:12:25.848889 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:12:25.849007 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:12:25.849082 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 05:12:25.849253 (+ 171us) server_negotiation.cc:299] Negotiation successful
0811 05:12:25.849328 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 05:12:25.849848 30916 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.191.252" port: 34991 } has no permanent_uuid. Determining permanent_uuid...
I20260811 05:12:25.850255 30920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:25.850145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.252:34991 (local address 127.0.0.1:59664)
0811 05:12:25.850202 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0811 05:12:25.850235 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.252:34991: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260811 05:12:25.850785 30920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:25.850665 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.252:34991 (local address 127.0.0.1:59666)
0811 05:12:25.850714 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0811 05:12:25.850768 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.252:34991: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260811 05:12:25.850914 30916 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.191.252:34991: Network error: Client connection negotiation failed: client connection to 127.26.191.252:34991: connect: Connection refused (error 111)
I20260811 05:12:25.854035 31051 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.191.252" port: 34991 } attempt: 1
I20260811 05:12:25.854492 31056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:25.854361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.252:34991 (local address 127.0.0.1:59676)
0811 05:12:25.854422 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0811 05:12:25.854461 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.252:34991: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260811 05:12:25.854859 31056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:25.854763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.252:34991 (local address 127.0.0.1:59686)
0811 05:12:25.854810 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0811 05:12:25.854837 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.252:34991: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260811 05:12:25.854976 31051 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.191.252:34991: Network error: Client connection negotiation failed: client connection to 127.26.191.252:34991: connect: Connection refused (error 111)
I20260811 05:12:25.882088 30916 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.191.252" port: 34991 } attempt: 1
I20260811 05:12:25.882654 30920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:25.882507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.252:34991 (local address 127.0.0.1:59690)
0811 05:12:25.882577 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0811 05:12:25.882620 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.252:34991: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260811 05:12:25.883172 30920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:25.883040 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.252:34991 (local address 127.0.0.1:59698)
0811 05:12:25.883111 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0811 05:12:25.883140 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.252:34991: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260811 05:12:25.883283 30916 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.191.252:34991: Network error: Client connection negotiation failed: client connection to 127.26.191.252:34991: connect: Connection refused (error 111)
W20260811 05:12:25.901362 31064 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 05:12:25.901616 31064 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:12:25.901635 31064 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:12:25.901657 31064 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:12:25.902967 31064 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:12:25.903017 31064 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:12:25.903033 31064 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:12:25.903045 31064 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:12:25.903059 31064 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:12:25.904654 31064 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:34845
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424853995437-27391-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424853995437-27391-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.26.191.254:40375,127.26.191.253:35905,127.26.191.252:34991
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.252.keytab
--principal=kudu/127.26.191.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.252:34991
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424853995437-27391-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.26.191.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31064
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424853995437-27391-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:12:25.904948 31064 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:12:25.905153 31064 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:12:25.910400 31072 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:12:25.910431 31069 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:12:25.910499 31070 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:12:25.910771 31064 server_base.cc:1034] running on GCE node
I20260811 05:12:25.911082 31064 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:12:25.911440 31064 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:12:25.912623 31064 hybrid_clock.cc:648] HybridClock initialized: now 1786425145912619 us; error 39 us; skew 500 ppm
Aug 11 05:12:25 dist-test-slave-x5fp krb5kdc[30776](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425145, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:12:25.915274 31064 init.cc:377] Logged in from keytab as kudu/127.26.191.252@KRBTEST.COM (short username kudu)
I20260811 05:12:25.915822 31064 webserver.cc:460] Webserver started at http://127.26.191.252:34017/ using document root <none> and password file <none>
I20260811 05:12:25.916069 31064 fs_manager.cc:359] Metadata directory not provided
I20260811 05:12:25.916141 31064 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:12:25.916306 31064 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:12:25.917510 31064 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424853995437-27391-0/minicluster-data/master-2/data/instance:
uuid: "57f67e6f23f645f39184a47c9045f4a4"
format_stamp: "Formatted at 2026-08-11 05:12:25 on dist-test-slave-x5fp"
server_key: "cde79352d1cab3151a66d45f9a91122f"
server_key_iv: "e2e656c6955df182cc3ed384c431adbc"
server_key_version: "encryptionkey@0"
I20260811 05:12:25.917920 31064 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424853995437-27391-0/minicluster-data/master-2/wal/instance:
uuid: "57f67e6f23f645f39184a47c9045f4a4"
format_stamp: "Formatted at 2026-08-11 05:12:25 on dist-test-slave-x5fp"
server_key: "cde79352d1cab3151a66d45f9a91122f"
server_key_iv: "e2e656c6955df182cc3ed384c431adbc"
server_key_version: "encryptionkey@0"
I20260811 05:12:25.919314 31064 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 05:12:25.920115 31080 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:12:25.920339 31064 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:12:25.920463 31064 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424853995437-27391-0/minicluster-data/master-2/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424853995437-27391-0/minicluster-data/master-2/wal
uuid: "57f67e6f23f645f39184a47c9045f4a4"
format_stamp: "Formatted at 2026-08-11 05:12:25 on dist-test-slave-x5fp"
server_key: "cde79352d1cab3151a66d45f9a91122f"
server_key_iv: "e2e656c6955df182cc3ed384c431adbc"
server_key_version: "encryptionkey@0"
I20260811 05:12:25.920543 31064 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424853995437-27391-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424853995437-27391-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424853995437-27391-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:12:25.923156 31051 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.191.252" port: 34991 } attempt: 2
I20260811 05:12:25.923619 31056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:25.923486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.252:34991 (local address 127.0.0.1:59706)
0811 05:12:25.923548 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0811 05:12:25.923589 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.252:34991: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260811 05:12:25.924008 31056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:25.923910 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.252:34991 (local address 127.0.0.1:59720)
0811 05:12:25.923957 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0811 05:12:25.923982 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.252:34991: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260811 05:12:25.924093 31051 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.191.252:34991: Network error: Client connection negotiation failed: client connection to 127.26.191.252:34991: connect: Connection refused (error 111)
I20260811 05:12:25.957953 31064 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:12:25.958447 30916 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.191.252" port: 34991 } attempt: 2
I20260811 05:12:25.958942 30920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:25.958773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.252:34991 (local address 127.0.0.1:59724)
0811 05:12:25.958853 (+ 80us) negotiation.cc:107] Waiting for socket to connect
0811 05:12:25.958899 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.252:34991: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260811 05:12:25.959337 30920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:25.959220 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.252:34991 (local address 127.0.0.1:59736)
0811 05:12:25.959280 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0811 05:12:25.959313 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.252:34991: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260811 05:12:25.959486 30916 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.191.252:34991: Network error: Client connection negotiation failed: client connection to 127.26.191.252:34991: connect: Connection refused (error 111)
I20260811 05:12:25.961277 31064 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:12:25.961467 31064 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:12:25.966300 31064 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.252:34991
I20260811 05:12:25.966334 31150 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.252:34991 every 8 connection(s)
I20260811 05:12:25.966745 31064 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424853995437-27391-0/minicluster-data/master-2/data/info.pb
I20260811 05:12:25.967758 31151 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:12:25.968410 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 31064
I20260811 05:12:25.968511 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424853995437-27391-0/minicluster-data/master-2/wal/instance
I20260811 05:12:25.968763 27391 external_mini_cluster.cc:1428] Setting key e7cdb978fbe0993f304cfe75b0bb3805
I20260811 05:12:25.969988 31151 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.191.254" port: 40375 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 05:12:25 dist-test-slave-x5fp krb5kdc[30776](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425145, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.252@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
Aug 11 05:12:25 dist-test-slave-x5fp krb5kdc[30776](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425145, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.191.252@KRBTEST.COM
I20260811 05:12:25.980479 30921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:25.970853 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52112 (local address 127.26.191.254:40375)
0811 05:12:25.970904 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:25.970906 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:25.971101 (+ 195us) server_negotiation.cc:407] Connection header received
0811 05:12:25.971160 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:25.971160 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:25.971169 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:25.971242 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:12:25.971736 (+ 494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:25.972458 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:25.973782 (+ 1324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:25.974069 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:25.974150 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:12:25.977029 (+ 2879us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:12:25.977030 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:12:25.977031 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:12:25.977040 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:12:25.978844 (+ 1804us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:12:25.979321 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:12:25.979322 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:12:25.979323 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:12:25.979377 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:12:25.979671 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:12:25.979672 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:12:25.979673 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:12:25.979865 (+ 192us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:12:25.979933 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 05:12:25.980300 (+ 367us) server_negotiation.cc:299] Negotiation successful
0811 05:12:25.980373 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 05:12:25.980934 31159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:25.970813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:40375 (local address 127.0.0.1:52112)
0811 05:12:25.970964 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0811 05:12:25.971013 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0811 05:12:25.971095 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:12:25.971276 (+ 181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:12:25.971278 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:12:25.971541 (+ 263us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:12:25.971640 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:12:25.971644 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:12:25.972541 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:12:25.972542 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:12:25.973692 (+ 1150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:12:25.973695 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:12:25.974157 (+ 462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:12:25.974158 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:12:25.974285 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:12:25.975105 (+ 820us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:12:25.975116 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:12:25.976930 (+ 1814us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:12:25.978931 (+ 2001us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:12:25.978938 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:12:25.978941 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:12:25.979237 (+ 296us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:12:25.979443 (+ 206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:12:25.979444 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:12:25.979444 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:12:25.979594 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:12:25.979946 (+ 352us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:12:25.979951 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:12:25.980140 (+ 189us) client_negotiation.cc:769] Sending connection context
0811 05:12:25.980265 (+ 125us) client_negotiation.cc:240] Negotiation successful
0811 05:12:25.980440 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":79,"threads_started":1}
I20260811 05:12:25.980934 31157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:25.969364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59744 (local address 127.26.191.252:34991)
0811 05:12:25.969593 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:25.969603 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:25.969644 (+ 41us) server_negotiation.cc:407] Connection header received
0811 05:12:25.970202 (+ 558us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:25.970211 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:25.970277 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:25.970478 (+ 201us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:12:25.971280 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:25.972557 (+ 1277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:25.973677 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:25.974175 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:25.974283 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:12:25.977627 (+ 3344us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:12:25.977638 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:12:25.977639 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:12:25.977652 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:12:25.979510 (+ 1858us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:12:25.979944 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:12:25.979948 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:12:25.979948 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:12:25.980010 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:12:25.980216 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:12:25.980217 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:12:25.980217 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:12:25.980379 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:12:25.980648 (+ 269us) server_negotiation.cc:1035] Waiting for connection context
0811 05:12:25.980696 (+ 48us) server_negotiation.cc:299] Negotiation successful
0811 05:12:25.980804 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":173,"thread_start_us":114,"threads_started":1}
I20260811 05:12:25.981556 31151 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.191.253" port: 35905 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 05:12:25 dist-test-slave-x5fp krb5kdc[30776](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425145, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.252@KRBTEST.COM for kudu/127.26.191.253@KRBTEST.COM
Aug 11 05:12:25 dist-test-slave-x5fp krb5kdc[30776](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425145, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
I20260811 05:12:25.989032 31059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:25.981944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42722 (local address 127.26.191.253:35905)
0811 05:12:25.981998 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:25.982000 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:25.982046 (+ 46us) server_negotiation.cc:407] Connection header received
0811 05:12:25.982120 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:25.982121 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:25.982132 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:25.982201 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:12:25.982488 (+ 287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:25.982956 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:25.983615 (+ 659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:25.983822 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:25.983902 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:12:25.985881 (+ 1979us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:12:25.985883 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:12:25.985883 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:12:25.985892 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:12:25.987840 (+ 1948us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:12:25.988207 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:12:25.988208 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:12:25.988209 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:12:25.988271 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:12:25.988472 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:12:25.988473 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:12:25.988473 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:12:25.988593 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:12:25.988668 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 05:12:25.988854 (+ 186us) server_negotiation.cc:299] Negotiation successful
0811 05:12:25.988930 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 05:12:25.989032 31159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:25.981876 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.253:35905 (local address 127.0.0.1:42722)
0811 05:12:25.981990 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0811 05:12:25.981998 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 05:12:25.982057 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:12:25.982205 (+ 148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:12:25.982206 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:12:25.982349 (+ 143us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:12:25.982400 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:12:25.982401 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:12:25.983035 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:12:25.983036 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:12:25.983532 (+ 496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:12:25.983533 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:12:25.983904 (+ 371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:12:25.983905 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:12:25.983978 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:12:25.984373 (+ 395us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:12:25.984377 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:12:25.985789 (+ 1412us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:12:25.987937 (+ 2148us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:12:25.987938 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:12:25.987938 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:12:25.988116 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:12:25.988340 (+ 224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:12:25.988341 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:12:25.988341 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:12:25.988407 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:12:25.988673 (+ 266us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:12:25.988674 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:12:25.988762 (+ 88us) client_negotiation.cc:769] Sending connection context
0811 05:12:25.988827 (+ 65us) client_negotiation.cc:240] Negotiation successful
0811 05:12:25.988930 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":100}
I20260811 05:12:25.989497 31151 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.191.252" port: 34991 } has no permanent_uuid. Determining permanent_uuid...
I20260811 05:12:25.989864 30921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:25.981886 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52128 (local address 127.26.191.254:40375)
0811 05:12:25.981921 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:25.981924 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:25.981932 (+ 8us) server_negotiation.cc:407] Connection header received
0811 05:12:25.982028 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:25.982029 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:25.982038 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:25.982113 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:12:25.982592 (+ 479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:25.983056 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:25.983742 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:25.983953 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:25.984028 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:12:25.986607 (+ 2579us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:12:25.986608 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:12:25.986608 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:12:25.986615 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:12:25.988235 (+ 1620us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:12:25.988606 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:12:25.988607 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:12:25.988607 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:12:25.988667 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:12:25.988927 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:12:25.988928 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:12:25.988929 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:12:25.989049 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:12:25.989277 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0811 05:12:25.989654 (+ 377us) server_negotiation.cc:299] Negotiation successful
0811 05:12:25.989736 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
Aug 11 05:12:25 dist-test-slave-x5fp krb5kdc[30776](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425145, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.252@KRBTEST.COM for kudu/127.26.191.252@KRBTEST.COM
Aug 11 05:12:25 dist-test-slave-x5fp krb5kdc[30776](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425145, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.191.253@KRBTEST.COM
I20260811 05:12:25.996838 31159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:25.989791 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.252:34991 (local address 127.0.0.1:59750)
0811 05:12:25.989840 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0811 05:12:25.989850 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 05:12:25.989882 (+ 32us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:12:25.990070 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:12:25.990070 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:12:25.990223 (+ 153us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:12:25.990249 (+ 26us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:12:25.990250 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:12:25.991121 (+ 871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:12:25.991122 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:12:25.991718 (+ 596us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:12:25.991720 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:12:25.992143 (+ 423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:12:25.992145 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:12:25.992208 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:12:25.992623 (+ 415us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:12:25.992627 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:12:25.993998 (+ 1371us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:12:25.995672 (+ 1674us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:12:25.995673 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:12:25.995673 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:12:25.995899 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:12:25.996134 (+ 235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:12:25.996134 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:12:25.996134 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:12:25.996189 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:12:25.996456 (+ 267us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:12:25.996457 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:12:25.996494 (+ 37us) client_negotiation.cc:769] Sending connection context
0811 05:12:25.996563 (+ 69us) client_negotiation.cc:240] Negotiation successful
0811 05:12:25.996664 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260811 05:12:25.996838 31157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:25.989822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59750 (local address 127.26.191.252:34991)
0811 05:12:25.989962 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:25.989963 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:25.989970 (+ 7us) server_negotiation.cc:407] Connection header received
0811 05:12:25.989988 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:25.989989 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:25.989999 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:25.990040 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:12:25.990331 (+ 291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:25.991042 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:25.991799 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:25.992068 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:25.992140 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:12:25.994098 (+ 1958us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:12:25.994100 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:12:25.994100 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:12:25.994108 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:12:25.995588 (+ 1480us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:12:25.995983 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:12:25.995984 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:12:25.995985 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:12:25.996053 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:12:25.996279 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:12:25.996279 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:12:25.996280 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:12:25.996389 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:12:25.996464 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 05:12:25.996587 (+ 123us) server_negotiation.cc:299] Negotiation successful
0811 05:12:25.996743 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":67,"server-negotiator.queue_time_us":123}
I20260811 05:12:25.998875 31151 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 57f67e6f23f645f39184a47c9045f4a4: Bootstrap starting.
I20260811 05:12:25.998921 31059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:25.990857 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42728 (local address 127.26.191.253:35905)
0811 05:12:25.990892 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:25.990893 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:25.990921 (+ 28us) server_negotiation.cc:407] Connection header received
0811 05:12:25.990988 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:25.990989 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:25.990995 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:25.991033 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:12:25.991511 (+ 478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:25.992076 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:25.992981 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:25.993255 (+ 274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:25.993337 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:12:25.995982 (+ 2645us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:12:25.995984 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:12:25.995984 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:12:25.995992 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:12:25.997696 (+ 1704us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:12:25.998079 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:12:25.998080 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:12:25.998080 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:12:25.998147 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:12:25.998415 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:12:25.998417 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:12:25.998417 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:12:25.998540 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:12:25.998701 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0811 05:12:25.998796 (+ 95us) server_negotiation.cc:299] Negotiation successful
0811 05:12:25.998857 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260811 05:12:26.000052 31151 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 57f67e6f23f645f39184a47c9045f4a4: Neither blocks nor log segments found. Creating new log.
I20260811 05:12:26.000389 31151 log.cc:824] T 00000000000000000000000000000000 P 57f67e6f23f645f39184a47c9045f4a4: Log is configured to *not* fsync() on all Append() calls
I20260811 05:12:26.000629 27391 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 05:12:26.001381 31151 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 57f67e6f23f645f39184a47c9045f4a4: No bootstrap required, opened a new log
I20260811 05:12:26.001713 30879 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "7b75e9aaa50e4579978f0082f475dbab"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52128
I20260811 05:12:26.003590 31151 raft_consensus.cc:348] T 00000000000000000000000000000000 P 57f67e6f23f645f39184a47c9045f4a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b75e9aaa50e4579978f0082f475dbab" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 40375 } } peers { permanent_uuid: "3d3099e7f3d541cf8e8b7e79976de1de" member_type: VOTER last_known_addr { host: "127.26.191.253" port: 35905 } } peers { permanent_uuid: "57f67e6f23f645f39184a47c9045f4a4" member_type: VOTER last_known_addr { host: "127.26.191.252" port: 34991 } }
I20260811 05:12:26.003756 31151 raft_consensus.cc:729] T 00000000000000000000000000000000 P 57f67e6f23f645f39184a47c9045f4a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57f67e6f23f645f39184a47c9045f4a4, State: Initialized, Role: FOLLOWER
I20260811 05:12:26.003839 31151 consensus_queue.cc:260] T 00000000000000000000000000000000 P 57f67e6f23f645f39184a47c9045f4a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b75e9aaa50e4579978f0082f475dbab" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 40375 } } peers { permanent_uuid: "3d3099e7f3d541cf8e8b7e79976de1de" member_type: VOTER last_known_addr { host: "127.26.191.253" port: 35905 } } peers { permanent_uuid: "57f67e6f23f645f39184a47c9045f4a4" member_type: VOTER last_known_addr { host: "127.26.191.252" port: 34991 } }
I20260811 05:12:26.004153 31161 sys_catalog.cc:455] T 00000000000000000000000000000000 P 57f67e6f23f645f39184a47c9045f4a4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b75e9aaa50e4579978f0082f475dbab" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 40375 } } peers { permanent_uuid: "3d3099e7f3d541cf8e8b7e79976de1de" member_type: VOTER last_known_addr { host: "127.26.191.253" port: 35905 } } peers { permanent_uuid: "57f67e6f23f645f39184a47c9045f4a4" member_type: VOTER last_known_addr { host: "127.26.191.252" port: 34991 } } }
I20260811 05:12:26.004225 31151 sys_catalog.cc:564] T 00000000000000000000000000000000 P 57f67e6f23f645f39184a47c9045f4a4 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:12:26.004294 31161 sys_catalog.cc:458] T 00000000000000000000000000000000 P 57f67e6f23f645f39184a47c9045f4a4 [sys.catalog]: This master's current role is: FOLLOWER
W20260811 05:12:26.006371 31179 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 57f67e6f23f645f39184a47c9045f4a4: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 05:12:26.006435 31179 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 05:12:26.006678 31064 master_runner.cc:186] Error getting master registration for 127.26.191.254:40375: OK, instance_id { permanent_uuid: "7b75e9aaa50e4579978f0082f475dbab" instance_seqno: 1786425145613113 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 05:12:26.009721 31064 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 05:12:26.015234 31051 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.191.252" port: 34991 } attempt: 3
Aug 11 05:12:26 dist-test-slave-x5fp krb5kdc[30776](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425145, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.253@KRBTEST.COM for kudu/127.26.191.252@KRBTEST.COM
I20260811 05:12:26.024502 31157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:26.015642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59764 (local address 127.26.191.252:34991)
0811 05:12:26.015687 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:26.015689 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:26.015702 (+ 13us) server_negotiation.cc:407] Connection header received
0811 05:12:26.015770 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:26.015771 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:26.015782 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:26.015859 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:12:26.016229 (+ 370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:26.017060 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:26.018777 (+ 1717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:26.019091 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:26.019170 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:12:26.021278 (+ 2108us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:12:26.021281 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:12:26.021281 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:12:26.021290 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:12:26.023140 (+ 1850us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:12:26.023571 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:12:26.023572 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:12:26.023572 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:12:26.023638 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:12:26.023849 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:12:26.023850 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:12:26.023851 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:12:26.024057 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:12:26.024137 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 05:12:26.024309 (+ 172us) server_negotiation.cc:299] Negotiation successful
0811 05:12:26.024406 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 05:12:26.024516 31056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:26.015563 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.252:34991 (local address 127.0.0.1:59764)
0811 05:12:26.015648 (+ 85us) negotiation.cc:107] Waiting for socket to connect
0811 05:12:26.015660 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 05:12:26.015702 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:12:26.015877 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:12:26.015878 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:12:26.016085 (+ 207us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:12:26.016144 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:12:26.016146 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:12:26.017145 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:12:26.017146 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:12:26.018677 (+ 1531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:12:26.018680 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:12:26.019176 (+ 496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:12:26.019177 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:12:26.019237 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:12:26.019750 (+ 513us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:12:26.019756 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:12:26.021166 (+ 1410us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:12:26.023247 (+ 2081us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:12:26.023249 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:12:26.023249 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:12:26.023488 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:12:26.023700 (+ 212us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:12:26.023701 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:12:26.023701 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:12:26.023779 (+ 78us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:12:26.024141 (+ 362us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:12:26.024143 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:12:26.024193 (+ 50us) client_negotiation.cc:769] Sending connection context
0811 05:12:26.024281 (+ 88us) client_negotiation.cc:240] Negotiation successful
0811 05:12:26.024398 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41}
I20260811 05:12:26.025876 31051 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3d3099e7f3d541cf8e8b7e79976de1de: Bootstrap starting.
I20260811 05:12:26.026633 31051 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3d3099e7f3d541cf8e8b7e79976de1de: Neither blocks nor log segments found. Creating new log.
I20260811 05:12:26.026923 31051 log.cc:824] T 00000000000000000000000000000000 P 3d3099e7f3d541cf8e8b7e79976de1de: Log is configured to *not* fsync() on all Append() calls
I20260811 05:12:26.027710 31051 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3d3099e7f3d541cf8e8b7e79976de1de: No bootstrap required, opened a new log
I20260811 05:12:26.029249 31051 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3d3099e7f3d541cf8e8b7e79976de1de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b75e9aaa50e4579978f0082f475dbab" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 40375 } } peers { permanent_uuid: "3d3099e7f3d541cf8e8b7e79976de1de" member_type: VOTER last_known_addr { host: "127.26.191.253" port: 35905 } } peers { permanent_uuid: "57f67e6f23f645f39184a47c9045f4a4" member_type: VOTER last_known_addr { host: "127.26.191.252" port: 34991 } }
I20260811 05:12:26.029369 31051 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3d3099e7f3d541cf8e8b7e79976de1de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d3099e7f3d541cf8e8b7e79976de1de, State: Initialized, Role: FOLLOWER
I20260811 05:12:26.029424 31051 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3d3099e7f3d541cf8e8b7e79976de1de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b75e9aaa50e4579978f0082f475dbab" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 40375 } } peers { permanent_uuid: "3d3099e7f3d541cf8e8b7e79976de1de" member_type: VOTER last_known_addr { host: "127.26.191.253" port: 35905 } } peers { permanent_uuid: "57f67e6f23f645f39184a47c9045f4a4" member_type: VOTER last_known_addr { host: "127.26.191.252" port: 34991 } }
I20260811 05:12:26.029680 31184 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d3099e7f3d541cf8e8b7e79976de1de [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b75e9aaa50e4579978f0082f475dbab" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 40375 } } peers { permanent_uuid: "3d3099e7f3d541cf8e8b7e79976de1de" member_type: VOTER last_known_addr { host: "127.26.191.253" port: 35905 } } peers { permanent_uuid: "57f67e6f23f645f39184a47c9045f4a4" member_type: VOTER last_known_addr { host: "127.26.191.252" port: 34991 } } }
I20260811 05:12:26.029752 31051 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3d3099e7f3d541cf8e8b7e79976de1de [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:12:26.029778 31184 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d3099e7f3d541cf8e8b7e79976de1de [sys.catalog]: This master's current role is: FOLLOWER
W20260811 05:12:26.031675 31200 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3d3099e7f3d541cf8e8b7e79976de1de: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 05:12:26.031740 31200 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 05:12:26.032027 30928 master_runner.cc:186] Error getting master registration for 127.26.191.254:40375: OK, instance_id { permanent_uuid: "7b75e9aaa50e4579978f0082f475dbab" instance_seqno: 1786425145613113 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 05:12:26.035018 30928 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 05:12:26.058657 30916 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.191.252" port: 34991 } attempt: 3
Aug 11 05:12:26 dist-test-slave-x5fp krb5kdc[30776](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425145, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.254@KRBTEST.COM for kudu/127.26.191.252@KRBTEST.COM
I20260811 05:12:26.067059 30920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:26.059141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.252:34991 (local address 127.0.0.1:59780)
0811 05:12:26.059214 (+ 73us) negotiation.cc:107] Waiting for socket to connect
0811 05:12:26.059227 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 05:12:26.059289 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:12:26.059439 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:12:26.059440 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:12:26.059623 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:12:26.059671 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:12:26.059673 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:12:26.060605 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:12:26.060607 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:12:26.061163 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:12:26.061165 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:12:26.061691 (+ 526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:12:26.061692 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:12:26.061752 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:12:26.062289 (+ 537us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:12:26.062295 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:12:26.063951 (+ 1656us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:12:26.065927 (+ 1976us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:12:26.065928 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:12:26.065929 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:12:26.066119 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:12:26.066348 (+ 229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:12:26.066349 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:12:26.066349 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:12:26.066414 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:12:26.066695 (+ 281us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:12:26.066696 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:12:26.066744 (+ 48us) client_negotiation.cc:769] Sending connection context
0811 05:12:26.066841 (+ 97us) client_negotiation.cc:240] Negotiation successful
0811 05:12:26.066954 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46}
I20260811 05:12:26.067059 31157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:26.059230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59780 (local address 127.26.191.252:34991)
0811 05:12:26.059276 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:26.059278 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:26.059289 (+ 11us) server_negotiation.cc:407] Connection header received
0811 05:12:26.059362 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:26.059363 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:26.059375 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:26.059431 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:12:26.059764 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:26.060518 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:26.061257 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:26.061561 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:26.061624 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:12:26.064028 (+ 2404us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:12:26.064030 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:12:26.064031 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:12:26.064039 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:12:26.065851 (+ 1812us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:12:26.066200 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:12:26.066201 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:12:26.066202 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:12:26.066276 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:12:26.066483 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:12:26.066485 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:12:26.066485 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:12:26.066633 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:12:26.066697 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 05:12:26.066869 (+ 172us) server_negotiation.cc:299] Negotiation successful
0811 05:12:26.066954 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 05:12:26.069310 30916 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7b75e9aaa50e4579978f0082f475dbab: Bootstrap starting.
I20260811 05:12:26.070101 30916 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7b75e9aaa50e4579978f0082f475dbab: Neither blocks nor log segments found. Creating new log.
I20260811 05:12:26.070412 30916 log.cc:824] T 00000000000000000000000000000000 P 7b75e9aaa50e4579978f0082f475dbab: Log is configured to *not* fsync() on all Append() calls
I20260811 05:12:26.071283 30916 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7b75e9aaa50e4579978f0082f475dbab: No bootstrap required, opened a new log
I20260811 05:12:26.072798 30916 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7b75e9aaa50e4579978f0082f475dbab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b75e9aaa50e4579978f0082f475dbab" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 40375 } } peers { permanent_uuid: "3d3099e7f3d541cf8e8b7e79976de1de" member_type: VOTER last_known_addr { host: "127.26.191.253" port: 35905 } } peers { permanent_uuid: "57f67e6f23f645f39184a47c9045f4a4" member_type: VOTER last_known_addr { host: "127.26.191.252" port: 34991 } }
I20260811 05:12:26.072959 30916 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7b75e9aaa50e4579978f0082f475dbab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b75e9aaa50e4579978f0082f475dbab, State: Initialized, Role: FOLLOWER
I20260811 05:12:26.073050 30916 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7b75e9aaa50e4579978f0082f475dbab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b75e9aaa50e4579978f0082f475dbab" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 40375 } } peers { permanent_uuid: "3d3099e7f3d541cf8e8b7e79976de1de" member_type: VOTER last_known_addr { host: "127.26.191.253" port: 35905 } } peers { permanent_uuid: "57f67e6f23f645f39184a47c9045f4a4" member_type: VOTER last_known_addr { host: "127.26.191.252" port: 34991 } }
I20260811 05:12:26.073400 30879 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7b75e9aaa50e4579978f0082f475dbab [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 05:12:26.073365 31203 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7b75e9aaa50e4579978f0082f475dbab [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b75e9aaa50e4579978f0082f475dbab" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 40375 } } peers { permanent_uuid: "3d3099e7f3d541cf8e8b7e79976de1de" member_type: VOTER last_known_addr { host: "127.26.191.253" port: 35905 } } peers { permanent_uuid: "57f67e6f23f645f39184a47c9045f4a4" member_type: VOTER last_known_addr { host: "127.26.191.252" port: 34991 } } }
I20260811 05:12:26.073509 30879 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7b75e9aaa50e4579978f0082f475dbab [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:12:26.073629 31203 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7b75e9aaa50e4579978f0082f475dbab [sys.catalog]: This master's current role is: FOLLOWER
I20260811 05:12:26.074249 30879 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7b75e9aaa50e4579978f0082f475dbab [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b75e9aaa50e4579978f0082f475dbab" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 40375 } } peers { permanent_uuid: "3d3099e7f3d541cf8e8b7e79976de1de" member_type: VOTER last_known_addr { host: "127.26.191.253" port: 35905 } } peers { permanent_uuid: "57f67e6f23f645f39184a47c9045f4a4" member_type: VOTER last_known_addr { host: "127.26.191.252" port: 34991 } }
I20260811 05:12:26.074548 30879 leader_election.cc:288] T 00000000000000000000000000000000 P 7b75e9aaa50e4579978f0082f475dbab [CANDIDATE]: Term 1 election: Requested vote from peers 3d3099e7f3d541cf8e8b7e79976de1de (127.26.191.253:35905), 57f67e6f23f645f39184a47c9045f4a4 (127.26.191.252:34991)
I20260811 05:12:26.074970 31006 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7b75e9aaa50e4579978f0082f475dbab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "3d3099e7f3d541cf8e8b7e79976de1de"
I20260811 05:12:26.075114 31006 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3d3099e7f3d541cf8e8b7e79976de1de [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:12:26.076045 31006 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3d3099e7f3d541cf8e8b7e79976de1de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b75e9aaa50e4579978f0082f475dbab in term 1.
I20260811 05:12:26.076339 30830 leader_election.cc:302] T 00000000000000000000000000000000 P 7b75e9aaa50e4579978f0082f475dbab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d3099e7f3d541cf8e8b7e79976de1de, 7b75e9aaa50e4579978f0082f475dbab; no voters:
I20260811 05:12:26.076439 31118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7b75e9aaa50e4579978f0082f475dbab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "57f67e6f23f645f39184a47c9045f4a4"
I20260811 05:12:26.076574 31118 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 57f67e6f23f645f39184a47c9045f4a4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:12:26.076613 31203 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7b75e9aaa50e4579978f0082f475dbab [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:12:26.076887 31203 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7b75e9aaa50e4579978f0082f475dbab [term 1 LEADER]: Becoming Leader. State: Replica: 7b75e9aaa50e4579978f0082f475dbab, State: Running, Role: LEADER
I20260811 05:12:26.077032 31203 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7b75e9aaa50e4579978f0082f475dbab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b75e9aaa50e4579978f0082f475dbab" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 40375 } } peers { permanent_uuid: "3d3099e7f3d541cf8e8b7e79976de1de" member_type: VOTER last_known_addr { host: "127.26.191.253" port: 35905 } } peers { permanent_uuid: "57f67e6f23f645f39184a47c9045f4a4" member_type: VOTER last_known_addr { host: "127.26.191.252" port: 34991 } }
I20260811 05:12:26.077600 31118 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 57f67e6f23f645f39184a47c9045f4a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b75e9aaa50e4579978f0082f475dbab in term 1.
I20260811 05:12:26.077602 31203 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7b75e9aaa50e4579978f0082f475dbab [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7b75e9aaa50e4579978f0082f475dbab. Latest consensus state: current_term: 1 leader_uuid: "7b75e9aaa50e4579978f0082f475dbab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b75e9aaa50e4579978f0082f475dbab" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 40375 } } peers { permanent_uuid: "3d3099e7f3d541cf8e8b7e79976de1de" member_type: VOTER last_known_addr { host: "127.26.191.253" port: 35905 } } peers { permanent_uuid: "57f67e6f23f645f39184a47c9045f4a4" member_type: VOTER last_known_addr { host: "127.26.191.252" port: 34991 } } }
I20260811 05:12:26.077780 31203 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7b75e9aaa50e4579978f0082f475dbab [sys.catalog]: This master's current role is: LEADER
I20260811 05:12:26.073391 30916 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7b75e9aaa50e4579978f0082f475dbab [sys.catalog]: configured and running, proceeding with master startup.
W20260811 05:12:26.079757 31232 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 7b75e9aaa50e4579978f0082f475dbab: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 05:12:26.079872 31232 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 05:12:26.080319 31213 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:12:26.080608 31213 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:12:26.082332 31006 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3d3099e7f3d541cf8e8b7e79976de1de [term 1 FOLLOWER]: Refusing update from remote peer 7b75e9aaa50e4579978f0082f475dbab: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:12:26.082682 31203 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 7b75e9aaa50e4579978f0082f475dbab [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3099e7f3d541cf8e8b7e79976de1de" member_type: VOTER last_known_addr { host: "127.26.191.253" port: 35905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:12:26.083110 31118 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 57f67e6f23f645f39184a47c9045f4a4 [term 1 FOLLOWER]: Refusing update from remote peer 7b75e9aaa50e4579978f0082f475dbab: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:12:26.084048 31184 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d3099e7f3d541cf8e8b7e79976de1de [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7b75e9aaa50e4579978f0082f475dbab. Latest consensus state: current_term: 1 leader_uuid: "7b75e9aaa50e4579978f0082f475dbab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b75e9aaa50e4579978f0082f475dbab" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 40375 } } peers { permanent_uuid: "3d3099e7f3d541cf8e8b7e79976de1de" member_type: VOTER last_known_addr { host: "127.26.191.253" port: 35905 } } peers { permanent_uuid: "57f67e6f23f645f39184a47c9045f4a4" member_type: VOTER last_known_addr { host: "127.26.191.252" port: 34991 } } }
I20260811 05:12:26.084165 31184 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d3099e7f3d541cf8e8b7e79976de1de [sys.catalog]: This master's current role is: FOLLOWER
I20260811 05:12:26.084340 31203 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 7b75e9aaa50e4579978f0082f475dbab [LEADER]: Connected to new peer: Peer: permanent_uuid: "57f67e6f23f645f39184a47c9045f4a4" member_type: VOTER last_known_addr { host: "127.26.191.252" port: 34991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:12:26.085604 31161 sys_catalog.cc:455] T 00000000000000000000000000000000 P 57f67e6f23f645f39184a47c9045f4a4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7b75e9aaa50e4579978f0082f475dbab. Latest consensus state: current_term: 1 leader_uuid: "7b75e9aaa50e4579978f0082f475dbab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b75e9aaa50e4579978f0082f475dbab" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 40375 } } peers { permanent_uuid: "3d3099e7f3d541cf8e8b7e79976de1de" member_type: VOTER last_known_addr { host: "127.26.191.253" port: 35905 } } peers { permanent_uuid: "57f67e6f23f645f39184a47c9045f4a4" member_type: VOTER last_known_addr { host: "127.26.191.252" port: 34991 } } }
I20260811 05:12:26.085721 31161 sys_catalog.cc:458] T 00000000000000000000000000000000 P 57f67e6f23f645f39184a47c9045f4a4 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 05:12:26.089864 31211 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7b75e9aaa50e4579978f0082f475dbab [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7b75e9aaa50e4579978f0082f475dbab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b75e9aaa50e4579978f0082f475dbab" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 40375 } } peers { permanent_uuid: "3d3099e7f3d541cf8e8b7e79976de1de" member_type: VOTER last_known_addr { host: "127.26.191.253" port: 35905 } } peers { permanent_uuid: "57f67e6f23f645f39184a47c9045f4a4" member_type: VOTER last_known_addr { host: "127.26.191.252" port: 34991 } } }
I20260811 05:12:26.089964 31211 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7b75e9aaa50e4579978f0082f475dbab [sys.catalog]: This master's current role is: LEADER
I20260811 05:12:26.090099 31184 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d3099e7f3d541cf8e8b7e79976de1de [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7b75e9aaa50e4579978f0082f475dbab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b75e9aaa50e4579978f0082f475dbab" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 40375 } } peers { permanent_uuid: "3d3099e7f3d541cf8e8b7e79976de1de" member_type: VOTER last_known_addr { host: "127.26.191.253" port: 35905 } } peers { permanent_uuid: "57f67e6f23f645f39184a47c9045f4a4" member_type: VOTER last_known_addr { host: "127.26.191.252" port: 34991 } } }
I20260811 05:12:26.090179 31184 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d3099e7f3d541cf8e8b7e79976de1de [sys.catalog]: This master's current role is: FOLLOWER
I20260811 05:12:26.090232 31239 mvcc.cc:205] Tried to move back new op lower bound from 7317197398350544896 to 7317197398332747776. Current Snapshot: MvccSnapshot[applied={T|T < 7317197398350544896}]
I20260811 05:12:26.090296 31238 mvcc.cc:205] Tried to move back new op lower bound from 7317197398350544896 to 7317197398332747776. Current Snapshot: MvccSnapshot[applied={T|T < 7317197398350544896}]
I20260811 05:12:26.093251 31059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:26.080097 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42730 (local address 127.26.191.253:35905)
0811 05:12:26.080144 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:26.080146 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:26.081584 (+ 1438us) server_negotiation.cc:407] Connection header received
0811 05:12:26.081687 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:26.081687 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:26.081698 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:26.081727 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:12:26.085871 (+ 4144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:26.086578 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:26.087693 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:26.087998 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:26.088045 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:12:26.089763 (+ 1718us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:12:26.089765 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:12:26.089765 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:12:26.089785 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:12:26.091817 (+ 2032us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:12:26.092238 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:12:26.092239 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:12:26.092239 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:12:26.092300 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:12:26.092511 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:12:26.092511 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:12:26.092512 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:12:26.092657 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:12:26.092795 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0811 05:12:26.093013 (+ 218us) server_negotiation.cc:299] Negotiation successful
0811 05:12:26.093121 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 05:12:26.097687 30921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:26.079956 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52140 (local address 127.26.191.254:40375)
0811 05:12:26.079996 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:26.079998 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:26.086762 (+ 6764us) server_negotiation.cc:407] Connection header received
0811 05:12:26.086856 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:26.086857 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:26.086868 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:26.086897 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:12:26.088125 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:26.088848 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:26.092189 (+ 3341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:26.092530 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:26.092572 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:12:26.094518 (+ 1946us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:12:26.094520 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:12:26.094520 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:12:26.094529 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:12:26.096326 (+ 1797us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:12:26.096794 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:12:26.096795 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:12:26.096796 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:12:26.096858 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:12:26.097067 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:12:26.097068 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:12:26.097068 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:12:26.097204 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:12:26.097291 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0811 05:12:26.097492 (+ 201us) server_negotiation.cc:299] Negotiation successful
0811 05:12:26.097582 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 05:12:26.098338 31213 catalog_manager.cc:1347] Generated new cluster ID: e79dfe21a8284e4caa71e24375b73528
I20260811 05:12:26.098425 31213 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:12:26.104530 31203 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7b75e9aaa50e4579978f0082f475dbab [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7b75e9aaa50e4579978f0082f475dbab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b75e9aaa50e4579978f0082f475dbab" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 40375 } } peers { permanent_uuid: "3d3099e7f3d541cf8e8b7e79976de1de" member_type: VOTER last_known_addr { host: "127.26.191.253" port: 35905 } } peers { permanent_uuid: "57f67e6f23f645f39184a47c9045f4a4" member_type: VOTER last_known_addr { host: "127.26.191.252" port: 34991 } } }
I20260811 05:12:26.104667 31203 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7b75e9aaa50e4579978f0082f475dbab [sys.catalog]: This master's current role is: LEADER
I20260811 05:12:26.105285 31161 sys_catalog.cc:455] T 00000000000000000000000000000000 P 57f67e6f23f645f39184a47c9045f4a4 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7b75e9aaa50e4579978f0082f475dbab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b75e9aaa50e4579978f0082f475dbab" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 40375 } } peers { permanent_uuid: "3d3099e7f3d541cf8e8b7e79976de1de" member_type: VOTER last_known_addr { host: "127.26.191.253" port: 35905 } } peers { permanent_uuid: "57f67e6f23f645f39184a47c9045f4a4" member_type: VOTER last_known_addr { host: "127.26.191.252" port: 34991 } } }
I20260811 05:12:26.105396 31161 sys_catalog.cc:458] T 00000000000000000000000000000000 P 57f67e6f23f645f39184a47c9045f4a4 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 05:12:26.106695 31157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:26.079679 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59786 (local address 127.26.191.252:34991)
0811 05:12:26.079724 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:26.079727 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:26.087325 (+ 7598us) server_negotiation.cc:407] Connection header received
0811 05:12:26.088376 (+ 1051us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:26.088377 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:26.088388 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:26.088425 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:12:26.089221 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:26.089899 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:26.100855 (+ 10956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:26.101171 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:26.101229 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:12:26.103315 (+ 2086us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:12:26.103317 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:12:26.103318 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:12:26.103328 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:12:26.105276 (+ 1948us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:12:26.105792 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:12:26.105793 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:12:26.105793 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:12:26.105854 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:12:26.106047 (+ 193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:12:26.106048 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:12:26.106048 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:12:26.106180 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:12:26.106259 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 05:12:26.106487 (+ 228us) server_negotiation.cc:299] Negotiation successful
0811 05:12:26.106574 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 05:12:26.106626 31242 mvcc.cc:205] Tried to move back new op lower bound from 7317197398350544896 to 7317197398332747776. Current Snapshot: MvccSnapshot[applied={T|T < 7317197398350544896}]
I20260811 05:12:26.111241 31213 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:12:26.112008 31213 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:12:26.122218 31213 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7b75e9aaa50e4579978f0082f475dbab: Generated new TSK 0
I20260811 05:12:26.122471 31213 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 05:12:26.151057 30921 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:12:26.149342 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52156 (local address 127.26.191.254:40375)
0811 05:12:26.149385 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:26.149387 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:26.150135 (+ 748us) server_negotiation.cc:407] Connection header received
0811 05:12:26.150342 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:26.150343 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:26.150356 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:26.150387 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:12:26.150977 (+ 590us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52156: BlockingRecv error: recv got EOF from 127.0.0.1:52156 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260811 05:12:26.152061 31059 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:12:26.149552 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42734 (local address 127.26.191.253:35905)
0811 05:12:26.149592 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:26.149593 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:26.150226 (+ 633us) server_negotiation.cc:407] Connection header received
0811 05:12:26.151402 (+ 1176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:26.151403 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:26.151546 (+ 143us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:26.151587 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:12:26.151998 (+ 411us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42734: BlockingRecv error: recv got EOF from 127.0.0.1:42734 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260811 05:12:26.153074 31157 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:12:26.149105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59792 (local address 127.26.191.252:34991)
0811 05:12:26.149155 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:26.149157 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:26.152449 (+ 3292us) server_negotiation.cc:407] Connection header received
0811 05:12:26.152626 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:26.152628 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:26.152639 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:26.152669 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:12:26.153015 (+ 346us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59792: BlockingRecv error: recv got EOF from 127.0.0.1:59792 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
W20260811 05:12:26.155680 31059 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:12:26.154903 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42738 (local address 127.26.191.253:35905)
0811 05:12:26.154944 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:26.154946 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:26.155160 (+ 214us) server_negotiation.cc:407] Connection header received
0811 05:12:26.155264 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:26.155265 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:26.155285 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:26.155315 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:12:26.155631 (+ 316us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42738: BlockingRecv error: recv got EOF from 127.0.0.1:42738 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260811 05:12:26.162086 31059 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:12:26.161184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42744 (local address 127.26.191.253:35905)
0811 05:12:26.161226 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:26.161228 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:26.161506 (+ 278us) server_negotiation.cc:407] Connection header received
0811 05:12:26.161609 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:26.161611 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:26.161622 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:26.161652 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:12:26.162027 (+ 375us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42744: BlockingRecv error: recv got EOF from 127.0.0.1:42744 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260811 05:12:26.168409 31059 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:12:26.165655 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42756 (local address 127.26.191.253:35905)
0811 05:12:26.165700 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:26.165702 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:26.167739 (+ 2037us) server_negotiation.cc:407] Connection header received
0811 05:12:26.167861 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:26.167862 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:26.167876 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:26.167911 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:12:26.168344 (+ 433us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42756: BlockingRecv error: recv got EOF from 127.0.0.1:42756 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260811 05:12:26.175038 31059 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:12:26.174027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42758 (local address 127.26.191.253:35905)
0811 05:12:26.174070 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:26.174073 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:26.174371 (+ 298us) server_negotiation.cc:407] Connection header received
0811 05:12:26.174485 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:26.174486 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:26.174499 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:26.174533 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:12:26.174963 (+ 430us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42758: BlockingRecv error: recv got EOF from 127.0.0.1:42758 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260811 05:12:26.185757 31059 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:12:26.184612 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42768 (local address 127.26.191.253:35905)
0811 05:12:26.184662 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:26.184664 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:26.185084 (+ 420us) server_negotiation.cc:407] Connection header received
0811 05:12:26.185206 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:26.185207 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:26.185220 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:26.185254 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:12:26.185674 (+ 420us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42768: BlockingRecv error: recv got EOF from 127.0.0.1:42768 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260811 05:12:26.204823 31059 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:12:26.203499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42772 (local address 127.26.191.253:35905)
0811 05:12:26.203550 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:26.203552 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:26.203927 (+ 375us) server_negotiation.cc:407] Connection header received
0811 05:12:26.204059 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:26.204061 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:26.204076 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:26.204112 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:12:26.204669 (+ 557us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42772: BlockingRecv error: recv got EOF from 127.0.0.1:42772 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
W20260811 05:12:26.239463 31059 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:12:26.238612 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42784 (local address 127.26.191.253:35905)
0811 05:12:26.238667 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:26.238670 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:26.238825 (+ 155us) server_negotiation.cc:407] Connection header received
0811 05:12:26.238874 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:26.238875 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:26.238889 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:26.238981 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:12:26.239391 (+ 410us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42784: BlockingRecv error: recv got EOF from 127.0.0.1:42784 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
W20260811 05:12:26.305819 31059 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:12:26.304891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42792 (local address 127.26.191.253:35905)
0811 05:12:26.304993 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:26.304996 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:26.305213 (+ 217us) server_negotiation.cc:407] Connection header received
0811 05:12:26.305283 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:26.305284 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:26.305296 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:26.305355 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:12:26.305696 (+ 341us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42792: BlockingRecv error: recv got EOF from 127.0.0.1:42792 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
W20260811 05:12:26.435977 31059 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:12:26.435048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42804 (local address 127.26.191.253:35905)
0811 05:12:26.435149 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:26.435152 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:26.435248 (+ 96us) server_negotiation.cc:407] Connection header received
0811 05:12:26.435375 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:26.435376 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:26.435392 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:26.435466 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:12:26.435900 (+ 434us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42804: BlockingRecv error: recv got EOF from 127.0.0.1:42804 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
W20260811 05:12:26.694192 31059 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:12:26.693445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42810 (local address 127.26.191.253:35905)
0811 05:12:26.693526 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:26.693529 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:26.693540 (+ 11us) server_negotiation.cc:407] Connection header received
0811 05:12:26.693616 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:26.693617 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:26.693628 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:26.693706 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:12:26.694117 (+ 411us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42810: BlockingRecv error: recv got EOF from 127.0.0.1:42810 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 05:12:27.006914 31179 catalog_manager.cc:1259] Loaded cluster ID: e79dfe21a8284e4caa71e24375b73528
I20260811 05:12:27.006999 31179 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 57f67e6f23f645f39184a47c9045f4a4: loading cluster ID for follower catalog manager: success
I20260811 05:12:27.007954 31179 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 57f67e6f23f645f39184a47c9045f4a4: acquiring CA information for follower catalog manager: success
I20260811 05:12:27.008335 31179 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 57f67e6f23f645f39184a47c9045f4a4: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 05:12:27.032264 31200 catalog_manager.cc:1259] Loaded cluster ID: e79dfe21a8284e4caa71e24375b73528
I20260811 05:12:27.032356 31200 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 3d3099e7f3d541cf8e8b7e79976de1de: loading cluster ID for follower catalog manager: success
I20260811 05:12:27.033361 31200 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 3d3099e7f3d541cf8e8b7e79976de1de: acquiring CA information for follower catalog manager: success
I20260811 05:12:27.033711 31200 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 3d3099e7f3d541cf8e8b7e79976de1de: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 05:12:27.210423 31365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:27.207494 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42814 (local address 127.26.191.253:35905)
0811 05:12:27.207649 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:27.207651 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:27.207663 (+ 12us) server_negotiation.cc:407] Connection header received
0811 05:12:27.207712 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:27.207713 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:27.207808 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:27.207893 (+ 85us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:12:27.208110 (+ 217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:27.208685 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:27.209556 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:27.209802 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:27.209862 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:12:27.210071 (+ 209us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:12:27.210195 (+ 124us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:12:27.210275 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 05:12:27.210328 (+ 53us) server_negotiation.cc:299] Negotiation successful
0811 05:12:27.210349 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":75,"threads_started":1}
I20260811 05:12:27.215134 31372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:27.212625 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59808 (local address 127.26.191.252:34991)
0811 05:12:27.212800 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:27.212802 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:27.212810 (+ 8us) server_negotiation.cc:407] Connection header received
0811 05:12:27.212848 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:27.212849 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:27.212888 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:27.212962 (+ 74us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:12:27.213082 (+ 120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:27.213635 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:27.214347 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:27.214559 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:27.214617 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:12:27.214751 (+ 134us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:12:27.214867 (+ 116us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:12:27.214932 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 05:12:27.214970 (+ 38us) server_negotiation.cc:299] Negotiation successful
0811 05:12:27.214989 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":76,"threads_started":1}
I20260811 05:12:27.220244 31372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:27.217194 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59814 (local address 127.26.191.252:34991)
0811 05:12:27.217301 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:27.217303 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:27.217310 (+ 7us) server_negotiation.cc:407] Connection header received
0811 05:12:27.217330 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:27.217330 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:27.217338 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:27.217415 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:12:27.217560 (+ 145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:27.218385 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:27.219438 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:27.219638 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:27.219726 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:12:27.219954 (+ 228us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:12:27.219989 (+ 35us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:12:27.220057 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 05:12:27.220125 (+ 68us) server_negotiation.cc:299] Negotiation successful
0811 05:12:27.220152 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260811 05:12:27.220397 31365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:27.217156 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42824 (local address 127.26.191.253:35905)
0811 05:12:27.217200 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:27.217202 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:27.217391 (+ 189us) server_negotiation.cc:407] Connection header received
0811 05:12:27.217512 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:27.217513 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:27.217526 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:27.217577 (+ 51us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:12:27.217754 (+ 177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:27.218223 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:27.219354 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:27.219683 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:27.219756 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:12:27.220003 (+ 247us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:12:27.220038 (+ 35us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:12:27.220088 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 05:12:27.220296 (+ 208us) server_negotiation.cc:299] Negotiation successful
0811 05:12:27.220324 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 05:12:27.220418 31381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:27.216960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52164 (local address 127.26.191.254:40375)
0811 05:12:27.217085 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:27.217087 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:27.217097 (+ 10us) server_negotiation.cc:407] Connection header received
0811 05:12:27.217176 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:27.217177 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:27.217271 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:27.217522 (+ 251us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:12:27.217570 (+ 48us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:27.218406 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:27.219290 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:27.219627 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:27.219703 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:12:27.219908 (+ 205us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:12:27.220026 (+ 118us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:12:27.220271 (+ 245us) server_negotiation.cc:1035] Waiting for connection context
0811 05:12:27.220296 (+ 25us) server_negotiation.cc:299] Negotiation successful
0811 05:12:27.220321 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":103,"thread_start_us":66,"threads_started":1}
I20260811 05:12:27.222131 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 30795
I20260811 05:12:27.237766 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 30928
I20260811 05:12:27.253109 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 31064
2026-08-11T05:12:27Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (3188 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424853995437-27391-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 05:12:27 dist-test-slave-x5fp krb5kdc[31388](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 05:12:27 dist-test-slave-x5fp krb5kdc[31388](info): set up 2 sockets
Aug 11 05:12:27 dist-test-slave-x5fp krb5kdc[31388](info): commencing operation
krb5kdc: starting...
W20260811 05:12:28.541013 27391 mini_kdc.cc:121] Time spent starting KDC: real 1.260s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424853995437-27391-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424853995437-27391-0/krb5kdc/test-user.keytab.
Aug 11 05:12:28 dist-test-slave-x5fp krb5kdc[31388](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425148, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T05:12:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:12:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.191.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.191.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.191.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab.
Entry for principal kudu/127.26.191.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab.
I20260811 05:12:28.675966 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424853995437-27391-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424853995437-27391-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424853995437-27391-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.254:33603
--webserver_interface=127.26.191.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab
--principal=kudu/127.26.191.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:45999
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.191.254:33603,127.26.191.253:44323,127.26.191.252:34555
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:12:28.761021 31414 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 05:12:28.761293 31414 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:12:28.761325 31414 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:12:28.761368 31414 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:12:28.762609 31414 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:12:28.762677 31414 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:12:28.762702 31414 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:12:28.762723 31414 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:12:28.762754 31414 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:12:28.764267 31414 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:45999
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424853995437-27391-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424853995437-27391-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.191.254:33603,127.26.191.253:44323,127.26.191.252:34555
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.254.keytab
--principal=kudu/127.26.191.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.254:33603
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.191.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31414
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424853995437-27391-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:12:28.764573 31414 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:12:28.764829 31414 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:12:28.770267 31423 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:12:28.770267 31427 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:12:28.770358 31425 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:12:28.770450 31414 server_base.cc:1034] running on GCE node
I20260811 05:12:28.770807 31414 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:12:28.771107 31414 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:12:28.772295 31414 hybrid_clock.cc:648] HybridClock initialized: now 1786425148772262 us; error 55 us; skew 500 ppm
Aug 11 05:12:28 dist-test-slave-x5fp krb5kdc[31388](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425148, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:12:28.780332 31414 init.cc:377] Logged in from keytab as kudu/127.26.191.254@KRBTEST.COM (short username kudu)
I20260811 05:12:28.780939 31414 webserver.cc:460] Webserver started at http://127.26.191.254:37769/ using document root <none> and password file <none>
I20260811 05:12:28.781188 31414 fs_manager.cc:359] Metadata directory not provided
I20260811 05:12:28.781260 31414 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:12:28.781424 31414 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:12:28.782557 31414 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424853995437-27391-0/minicluster-data/master-0/data/instance:
uuid: "d0d236310eab46faaf1b14c68d5d4b6a"
format_stamp: "Formatted at 2026-08-11 05:12:28 on dist-test-slave-x5fp"
server_key: "3222e9e3f911bef4876e3a0f59fa133a"
server_key_iv: "8fc0ba40021e9dd90157e60d5efcf49d"
server_key_version: "encryptionkey@0"
I20260811 05:12:28.782944 31414 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424853995437-27391-0/minicluster-data/master-0/wal/instance:
uuid: "d0d236310eab46faaf1b14c68d5d4b6a"
format_stamp: "Formatted at 2026-08-11 05:12:28 on dist-test-slave-x5fp"
server_key: "3222e9e3f911bef4876e3a0f59fa133a"
server_key_iv: "8fc0ba40021e9dd90157e60d5efcf49d"
server_key_version: "encryptionkey@0"
I20260811 05:12:28.784350 31414 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 05:12:28.785229 31438 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:12:28.785439 31414 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 05:12:28.785558 31414 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424853995437-27391-0/minicluster-data/master-0/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424853995437-27391-0/minicluster-data/master-0/wal
uuid: "d0d236310eab46faaf1b14c68d5d4b6a"
format_stamp: "Formatted at 2026-08-11 05:12:28 on dist-test-slave-x5fp"
server_key: "3222e9e3f911bef4876e3a0f59fa133a"
server_key_iv: "8fc0ba40021e9dd90157e60d5efcf49d"
server_key_version: "encryptionkey@0"
I20260811 05:12:28.785643 31414 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424853995437-27391-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424853995437-27391-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424853995437-27391-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:12:28.792232 31414 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:12:28.794835 31414 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:12:28.795032 31414 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:12:28.799793 31414 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.254:33603
I20260811 05:12:28.799856 31514 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.254:33603 every 8 connection(s)
I20260811 05:12:28.800417 31414 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424853995437-27391-0/minicluster-data/master-0/data/info.pb
I20260811 05:12:28.801206 31516 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:12:28.802214 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 31414
I20260811 05:12:28.802325 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424853995437-27391-0/minicluster-data/master-0/wal/instance
I20260811 05:12:28.802528 27391 external_mini_cluster.cc:1428] Setting key 1808c3c9d33b94dead44102573d03910
I20260811 05:12:28.802891 31516 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.191.254" port: 33603 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 05:12:28 dist-test-slave-x5fp krb5kdc[31388](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425148, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.254@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.26.191.253@KRBTEST.COM; defaulting to no policy
I20260811 05:12:28.814316 31519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:28.803656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51748 (local address 127.26.191.254:33603)
0811 05:12:28.803826 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:28.803843 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:28.803962 (+ 119us) server_negotiation.cc:407] Connection header received
0811 05:12:28.804803 (+ 841us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:28.804806 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:28.804833 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:28.804943 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:12:28.805494 (+ 551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:28.806600 (+ 1106us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:28.808019 (+ 1419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:28.808362 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:28.808447 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:12:28.810988 (+ 2541us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:12:28.810996 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:12:28.810997 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:12:28.811005 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:12:28.812789 (+ 1784us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:12:28.813245 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:12:28.813248 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:12:28.813249 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:12:28.813332 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:12:28.813550 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:12:28.813551 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:12:28.813551 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:12:28.813760 (+ 209us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:12:28.813824 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 05:12:28.814026 (+ 202us) server_negotiation.cc:299] Negotiation successful
0811 05:12:28.814164 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":54,"server-negotiator.queue_time_us":134,"thread_start_us":70,"threads_started":1}
I20260811 05:12:28.814431 31518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:28.803569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:33603 (local address 127.0.0.1:51748)
0811 05:12:28.803782 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0811 05:12:28.803829 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 05:12:28.804570 (+ 741us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:12:28.804970 (+ 400us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:12:28.804972 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:12:28.805221 (+ 249us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:12:28.805377 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:12:28.805381 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:12:28.806711 (+ 1330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:12:28.806712 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:12:28.807915 (+ 1203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:12:28.807919 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:12:28.808465 (+ 546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:12:28.808467 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:12:28.808567 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:12:28.809162 (+ 595us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:12:28.809173 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:12:28.810890 (+ 1717us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:12:28.812881 (+ 1991us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:12:28.812889 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:12:28.812891 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:12:28.813130 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:12:28.813397 (+ 267us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:12:28.813398 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:12:28.813398 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:12:28.813487 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:12:28.813830 (+ 343us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:12:28.813837 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:12:28.813899 (+ 62us) client_negotiation.cc:769] Sending connection context
0811 05:12:28.813979 (+ 80us) client_negotiation.cc:240] Negotiation successful
0811 05:12:28.814111 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":108,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.191.253@KRBTEST.COM" created.
I20260811 05:12:28.815351 31516 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.191.253" port: 44323 } has no permanent_uuid. Determining permanent_uuid...
I20260811 05:12:28.815778 31518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:28.815606 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.253:44323 (local address 127.0.0.1:58416)
0811 05:12:28.815675 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0811 05:12:28.815742 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.253:44323: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260811 05:12:28.815964 31440 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.191.253:44323: connect: Connection refused (error 111)
I20260811 05:12:28.816459 31518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:28.816337 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.253:44323 (local address 127.0.0.1:58426)
0811 05:12:28.816390 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0811 05:12:28.816426 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.253:44323: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260811 05:12:28.816646 31516 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.191.253:44323: Network error: Client connection negotiation failed: client connection to 127.26.191.253:44323: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.191.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.253.keytab.
Entry for principal kudu/127.26.191.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.253.keytab.
I20260811 05:12:28.832618 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424853995437-27391-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424853995437-27391-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424853995437-27391-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424853995437-27391-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.253:44323
--webserver_interface=127.26.191.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.253.keytab
--principal=kudu/127.26.191.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:45999
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.191.254:33603,127.26.191.253:44323,127.26.191.252:34555
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 05:12:28.866021 31516 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.191.253" port: 44323 } attempt: 1
I20260811 05:12:28.866616 31518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:28.866447 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.253:44323 (local address 127.0.0.1:58436)
0811 05:12:28.866522 (+ 75us) negotiation.cc:107] Waiting for socket to connect
0811 05:12:28.866575 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.253:44323: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260811 05:12:28.867117 31518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:28.867014 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.253:44323 (local address 127.0.0.1:58450)
0811 05:12:28.867063 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0811 05:12:28.867094 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.253:44323: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260811 05:12:28.867256 31516 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.191.253:44323: Network error: Client connection negotiation failed: client connection to 127.26.191.253:44323: connect: Connection refused (error 111)
W20260811 05:12:28.919415 31523 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 05:12:28.919644 31523 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:12:28.919663 31523 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:12:28.919685 31523 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:12:28.920926 31523 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:12:28.920969 31523 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:12:28.921000 31523 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:12:28.921016 31523 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:12:28.921028 31523 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:12:28.922610 31523 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:45999
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424853995437-27391-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424853995437-27391-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.26.191.254:33603,127.26.191.253:44323,127.26.191.252:34555
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.253.keytab
--principal=kudu/127.26.191.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.253:44323
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424853995437-27391-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.26.191.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31523
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424853995437-27391-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:12:28.922896 31523 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:12:28.923141 31523 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:12:28.928359 31533 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:12:28.928359 31530 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:12:28.928332 31529 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:12:28.928531 31523 server_base.cc:1034] running on GCE node
I20260811 05:12:28.928920 31523 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:12:28.929232 31523 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:12:28.930426 31523 hybrid_clock.cc:648] HybridClock initialized: now 1786425148930377 us; error 65 us; skew 500 ppm
Aug 11 05:12:28 dist-test-slave-x5fp krb5kdc[31388](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425148, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:12:28.933205 31523 init.cc:377] Logged in from keytab as kudu/127.26.191.253@KRBTEST.COM (short username kudu)
I20260811 05:12:28.933691 31523 webserver.cc:460] Webserver started at http://127.26.191.253:32861/ using document root <none> and password file <none>
I20260811 05:12:28.933887 31523 fs_manager.cc:359] Metadata directory not provided
I20260811 05:12:28.933925 31523 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:12:28.934094 31523 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:12:28.935235 31523 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424853995437-27391-0/minicluster-data/master-1/data/instance:
uuid: "f23486eb92924653b3a4d47af70a22af"
format_stamp: "Formatted at 2026-08-11 05:12:28 on dist-test-slave-x5fp"
server_key: "b0e3f9ba501e8d79e7311c604994065f"
server_key_iv: "19f11a928fea42b6159d78a118a82877"
server_key_version: "encryptionkey@0"
I20260811 05:12:28.935464 31516 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.191.253" port: 44323 } attempt: 2
I20260811 05:12:28.935644 31523 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424853995437-27391-0/minicluster-data/master-1/wal/instance:
uuid: "f23486eb92924653b3a4d47af70a22af"
format_stamp: "Formatted at 2026-08-11 05:12:28 on dist-test-slave-x5fp"
server_key: "b0e3f9ba501e8d79e7311c604994065f"
server_key_iv: "19f11a928fea42b6159d78a118a82877"
server_key_version: "encryptionkey@0"
I20260811 05:12:28.935961 31518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:28.935804 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.253:44323 (local address 127.0.0.1:58466)
0811 05:12:28.935864 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0811 05:12:28.935916 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.253:44323: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260811 05:12:28.936434 31518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:28.936312 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.253:44323 (local address 127.0.0.1:58478)
0811 05:12:28.936369 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0811 05:12:28.936403 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.253:44323: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260811 05:12:28.936563 31516 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.191.253:44323: Network error: Client connection negotiation failed: client connection to 127.26.191.253:44323: connect: Connection refused (error 111)
I20260811 05:12:28.937451 31523 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260811 05:12:28.938284 31546 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:12:28.938517 31523 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:12:28.938616 31523 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424853995437-27391-0/minicluster-data/master-1/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424853995437-27391-0/minicluster-data/master-1/wal
uuid: "f23486eb92924653b3a4d47af70a22af"
format_stamp: "Formatted at 2026-08-11 05:12:28 on dist-test-slave-x5fp"
server_key: "b0e3f9ba501e8d79e7311c604994065f"
server_key_iv: "19f11a928fea42b6159d78a118a82877"
server_key_version: "encryptionkey@0"
I20260811 05:12:28.938696 31523 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424853995437-27391-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424853995437-27391-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424853995437-27391-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:12:28.962460 31523 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:12:28.964578 31523 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:12:28.964798 31523 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:12:28.969223 31523 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.253:44323
I20260811 05:12:28.969293 31625 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.253:44323 every 8 connection(s)
I20260811 05:12:28.969671 31523 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424853995437-27391-0/minicluster-data/master-1/data/info.pb
I20260811 05:12:28.970592 31626 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:12:28.972288 31626 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.191.254" port: 33603 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 05:12:28 dist-test-slave-x5fp krb5kdc[31388](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425148, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.253@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
I20260811 05:12:28.978989 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 31523
I20260811 05:12:28.979101 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424853995437-27391-0/minicluster-data/master-1/wal/instance
I20260811 05:12:28.979312 27391 external_mini_cluster.cc:1428] Setting key 9ac9d3907a34a753cd1b364a63be2c75
I20260811 05:12:28.982355 31519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:28.973195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51758 (local address 127.26.191.254:33603)
0811 05:12:28.973277 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:28.973279 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:28.973471 (+ 192us) server_negotiation.cc:407] Connection header received
0811 05:12:28.973976 (+ 505us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:28.973978 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:28.973993 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:28.974059 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:12:28.974715 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:28.975257 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:28.976315 (+ 1058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:28.976539 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:28.976601 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:12:28.979046 (+ 2445us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:12:28.979047 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:12:28.979048 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:12:28.979056 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:12:28.980638 (+ 1582us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:12:28.981239 (+ 601us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:12:28.981240 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:12:28.981241 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:12:28.981315 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:12:28.981571 (+ 256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:12:28.981572 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:12:28.981572 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:12:28.981767 (+ 195us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:12:28.981854 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0811 05:12:28.982129 (+ 275us) server_negotiation.cc:299] Negotiation successful
0811 05:12:28.982223 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 05:12:28.982383 31632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:28.973144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:33603 (local address 127.0.0.1:51758)
0811 05:12:28.973339 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0811 05:12:28.973380 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 05:12:28.973853 (+ 473us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:12:28.974137 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:12:28.974140 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:12:28.974395 (+ 255us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:12:28.974600 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:12:28.974604 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:12:28.975369 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:12:28.975370 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:12:28.976220 (+ 850us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:12:28.976223 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:12:28.976642 (+ 419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:12:28.976643 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:12:28.976816 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:12:28.977393 (+ 577us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:12:28.977413 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:12:28.978876 (+ 1463us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:12:28.980755 (+ 1879us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:12:28.980764 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:12:28.980767 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:12:28.981120 (+ 353us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:12:28.981389 (+ 269us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:12:28.981390 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:12:28.981390 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:12:28.981503 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:12:28.981848 (+ 345us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:12:28.981853 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:12:28.981999 (+ 146us) client_negotiation.cc:769] Sending connection context
0811 05:12:28.982085 (+ 86us) client_negotiation.cc:240] Negotiation successful
0811 05:12:28.982212 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":111,"threads_started":1}
I20260811 05:12:28.983031 31626 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.191.253" port: 44323 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 05:12:28 dist-test-slave-x5fp krb5kdc[31388](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425148, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.253@KRBTEST.COM for kudu/127.26.191.253@KRBTEST.COM
WARNING: no policy specified for kudu/127.26.191.252@KRBTEST.COM; defaulting to no policy
I20260811 05:12:28.990936 31632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:28.983335 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.253:44323 (local address 127.0.0.1:58488)
0811 05:12:28.983387 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0811 05:12:28.983400 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 05:12:28.983450 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:12:28.983729 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:12:28.983729 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:12:28.983874 (+ 145us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:12:28.983937 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:12:28.983938 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:12:28.984824 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:12:28.984825 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:12:28.985318 (+ 493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:12:28.985319 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:12:28.985816 (+ 497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:12:28.985817 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:12:28.985901 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:12:28.986388 (+ 487us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:12:28.986393 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:12:28.987680 (+ 1287us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:12:28.989781 (+ 2101us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:12:28.989781 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:12:28.989782 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:12:28.989961 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:12:28.990196 (+ 235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:12:28.990197 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:12:28.990197 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:12:28.990255 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:12:28.990572 (+ 317us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:12:28.990573 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:12:28.990615 (+ 42us) client_negotiation.cc:769] Sending connection context
0811 05:12:28.990687 (+ 72us) client_negotiation.cc:240] Negotiation successful
0811 05:12:28.990795 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260811 05:12:28.990953 31634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:28.983408 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58488 (local address 127.26.191.253:44323)
0811 05:12:28.983595 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:28.983599 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:28.983615 (+ 16us) server_negotiation.cc:407] Connection header received
0811 05:12:28.983632 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:28.983634 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:28.983644 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:28.983729 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:12:28.984016 (+ 287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:28.984708 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:28.985408 (+ 700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:28.985727 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:28.985807 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:12:28.987792 (+ 1985us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:12:28.987803 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:12:28.987803 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:12:28.987810 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:12:28.989681 (+ 1871us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:12:28.990061 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:12:28.990064 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:12:28.990065 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:12:28.990127 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:12:28.990325 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:12:28.990326 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:12:28.990326 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:12:28.990489 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:12:28.990583 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0811 05:12:28.990725 (+ 142us) server_negotiation.cc:299] Negotiation successful
0811 05:12:28.990851 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":56,"server-negotiator.queue_time_us":160,"thread_start_us":106,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.191.252@KRBTEST.COM" created.
I20260811 05:12:28.991786 31626 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.191.252" port: 34555 } has no permanent_uuid. Determining permanent_uuid...
I20260811 05:12:28.992182 31632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:28.992052 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.252:34555 (local address 127.0.0.1:39974)
0811 05:12:28.992103 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0811 05:12:28.992151 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.252:34555: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260811 05:12:28.992372 31547 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.191.252:34555: connect: Connection refused (error 111)
I20260811 05:12:28.992825 31632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:28.992745 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.252:34555 (local address 127.0.0.1:39976)
0811 05:12:28.992775 (+ 30us) negotiation.cc:107] Waiting for socket to connect
0811 05:12:28.992805 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.252:34555: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":18}
W20260811 05:12:28.992928 31626 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.191.252:34555: Network error: Client connection negotiation failed: client connection to 127.26.191.252:34555: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.191.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.252.keytab.
Entry for principal kudu/127.26.191.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.252.keytab.
I20260811 05:12:29.009931 27391 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVmtCMs/build/release/bin/kudu
/tmp/dist-test-taskVmtCMs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424853995437-27391-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424853995437-27391-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424853995437-27391-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424853995437-27391-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.252:34555
--webserver_interface=127.26.191.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.252.keytab
--principal=kudu/127.26.191.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.191.212:45999
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.191.254:33603,127.26.191.253:44323,127.26.191.252:34555
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424853995437-27391-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424853995437-27391-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424853995437-27391-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 05:12:29.027755 31516 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.191.253" port: 44323 } attempt: 3
Aug 11 05:12:29 dist-test-slave-x5fp krb5kdc[31388](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425148, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.254@KRBTEST.COM for kudu/127.26.191.253@KRBTEST.COM
I20260811 05:12:29.035562 31634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:29.028319 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58494 (local address 127.26.191.253:44323)
0811 05:12:29.028392 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:29.028395 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:29.028407 (+ 12us) server_negotiation.cc:407] Connection header received
0811 05:12:29.028459 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:29.028460 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:29.028475 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:29.028548 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:12:29.029007 (+ 459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:29.029521 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:29.030246 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:29.030485 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:29.030562 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:12:29.032762 (+ 2200us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:12:29.032764 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:12:29.032764 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:12:29.032772 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:12:29.034290 (+ 1518us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:12:29.034765 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:12:29.034767 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:12:29.034767 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:12:29.034834 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:12:29.035063 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:12:29.035063 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:12:29.035064 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:12:29.035183 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:12:29.035250 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 05:12:29.035413 (+ 163us) server_negotiation.cc:299] Negotiation successful
0811 05:12:29.035488 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 05:12:29.035596 31518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:29.028257 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.253:44323 (local address 127.0.0.1:58494)
0811 05:12:29.028317 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0811 05:12:29.028332 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 05:12:29.028392 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:12:29.028554 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:12:29.028555 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:12:29.028821 (+ 266us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:12:29.028916 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:12:29.028918 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:12:29.029611 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:12:29.029612 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:12:29.030150 (+ 538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:12:29.030151 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:12:29.030574 (+ 423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:12:29.030575 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:12:29.030659 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:12:29.031200 (+ 541us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:12:29.031205 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:12:29.032639 (+ 1434us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:12:29.034380 (+ 1741us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:12:29.034382 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:12:29.034382 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:12:29.034615 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:12:29.034920 (+ 305us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:12:29.034921 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:12:29.034921 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:12:29.034995 (+ 74us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:12:29.035254 (+ 259us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:12:29.035255 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:12:29.035309 (+ 54us) client_negotiation.cc:769] Sending connection context
0811 05:12:29.035385 (+ 76us) client_negotiation.cc:240] Negotiation successful
0811 05:12:29.035493 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":23}
I20260811 05:12:29.036247 31516 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.191.252" port: 34555 } has no permanent_uuid. Determining permanent_uuid...
I20260811 05:12:29.036653 31518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:29.036536 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.252:34555 (local address 127.0.0.1:39980)
0811 05:12:29.036587 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0811 05:12:29.036625 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.252:34555: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260811 05:12:29.037056 31518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:29.036935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.252:34555 (local address 127.0.0.1:39990)
0811 05:12:29.037001 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0811 05:12:29.037033 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.252:34555: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260811 05:12:29.037191 31516 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.191.252:34555: Network error: Client connection negotiation failed: client connection to 127.26.191.252:34555: connect: Connection refused (error 111)
I20260811 05:12:29.042176 31626 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.191.252" port: 34555 } attempt: 1
I20260811 05:12:29.042589 31632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:29.042480 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.252:34555 (local address 127.0.0.1:39994)
0811 05:12:29.042523 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0811 05:12:29.042560 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.252:34555: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":18}
I20260811 05:12:29.043017 31632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:29.042915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.252:34555 (local address 127.0.0.1:40004)
0811 05:12:29.042967 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0811 05:12:29.042996 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.252:34555: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260811 05:12:29.043118 31626 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.191.252:34555: Network error: Client connection negotiation failed: client connection to 127.26.191.252:34555: connect: Connection refused (error 111)
I20260811 05:12:29.068377 31516 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.191.252" port: 34555 } attempt: 1
I20260811 05:12:29.068989 31518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:29.068841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.252:34555 (local address 127.0.0.1:40018)
0811 05:12:29.068910 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0811 05:12:29.068955 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.252:34555: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260811 05:12:29.069428 31518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:29.069301 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.252:34555 (local address 127.0.0.1:40030)
0811 05:12:29.069369 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0811 05:12:29.069402 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.252:34555: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260811 05:12:29.069567 31516 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.191.252:34555: Network error: Client connection negotiation failed: client connection to 127.26.191.252:34555: connect: Connection refused (error 111)
W20260811 05:12:29.099436 31638 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 05:12:29.099670 31638 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:12:29.099689 31638 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:12:29.099711 31638 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:12:29.100860 31638 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:12:29.100901 31638 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:12:29.100915 31638 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:12:29.100929 31638 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:12:29.100940 31638 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:12:29.102419 31638 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.191.212:45999
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424853995437-27391-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424853995437-27391-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.26.191.254:33603,127.26.191.253:44323,127.26.191.252:34555
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424853995437-27391-0/krb5kdc/kudu_127.26.191.252.keytab
--principal=kudu/127.26.191.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.191.252:34555
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424853995437-27391-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.26.191.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31638
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424853995437-27391-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 03:53:23 UTC on ccycloud.quasar-rvwgcx.root.comops.site
build id 4579567
I20260811 05:12:29.102623 31638 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:12:29.102810 31638 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:12:29.108098 31646 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:12:29.108144 31647 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:12:29.108088 31651 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:12:29.108326 31638 server_base.cc:1034] running on GCE node
I20260811 05:12:29.108687 31638 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:12:29.109067 31638 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:12:29.110240 31638 hybrid_clock.cc:648] HybridClock initialized: now 1786425149110223 us; error 44 us; skew 500 ppm
I20260811 05:12:29.111281 31626 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.191.252" port: 34555 } attempt: 2
I20260811 05:12:29.111758 31632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:29.111596 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.252:34555 (local address 127.0.0.1:40032)
0811 05:12:29.111670 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0811 05:12:29.111715 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.252:34555: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260811 05:12:29.112150 31632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:29.112035 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.252:34555 (local address 127.0.0.1:40042)
0811 05:12:29.112089 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0811 05:12:29.112122 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.191.252:34555: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260811 05:12:29.112255 31626 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.191.252:34555: Network error: Client connection negotiation failed: client connection to 127.26.191.252:34555: connect: Connection refused (error 111)
Aug 11 05:12:29 dist-test-slave-x5fp krb5kdc[31388](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425149, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:12:29.113389 31638 init.cc:377] Logged in from keytab as kudu/127.26.191.252@KRBTEST.COM (short username kudu)
I20260811 05:12:29.113870 31638 webserver.cc:460] Webserver started at http://127.26.191.252:42887/ using document root <none> and password file <none>
I20260811 05:12:29.114140 31638 fs_manager.cc:359] Metadata directory not provided
I20260811 05:12:29.114190 31638 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:12:29.114346 31638 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:12:29.115487 31638 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424853995437-27391-0/minicluster-data/master-2/data/instance:
uuid: "f83b8ba9f33c487dadd1a98e62467a65"
format_stamp: "Formatted at 2026-08-11 05:12:29 on dist-test-slave-x5fp"
server_key: "8f41b0ff835e675302942616709a5290"
server_key_iv: "ea5669dbcca4faec0a965695cb7f4603"
server_key_version: "encryptionkey@0"
I20260811 05:12:29.115877 31638 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424853995437-27391-0/minicluster-data/master-2/wal/instance:
uuid: "f83b8ba9f33c487dadd1a98e62467a65"
format_stamp: "Formatted at 2026-08-11 05:12:29 on dist-test-slave-x5fp"
server_key: "8f41b0ff835e675302942616709a5290"
server_key_iv: "ea5669dbcca4faec0a965695cb7f4603"
server_key_version: "encryptionkey@0"
I20260811 05:12:29.117408 31638 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 05:12:29.118255 31663 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:12:29.118468 31638 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:12:29.118587 31638 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424853995437-27391-0/minicluster-data/master-2/data,/tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424853995437-27391-0/minicluster-data/master-2/wal
uuid: "f83b8ba9f33c487dadd1a98e62467a65"
format_stamp: "Formatted at 2026-08-11 05:12:29 on dist-test-slave-x5fp"
server_key: "8f41b0ff835e675302942616709a5290"
server_key_iv: "ea5669dbcca4faec0a965695cb7f4603"
server_key_version: "encryptionkey@0"
I20260811 05:12:29.118670 31638 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424853995437-27391-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424853995437-27391-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424853995437-27391-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:12:29.126884 31638 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:12:29.129238 31638 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:12:29.129423 31638 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:12:29.133652 31638 rpc_server.cc:307] RPC server started. Bound to: 127.26.191.252:34555
I20260811 05:12:29.133689 31739 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.191.252:34555 every 8 connection(s)
I20260811 05:12:29.134116 31638 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424853995437-27391-0/minicluster-data/master-2/data/info.pb
I20260811 05:12:29.135089 31740 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:12:29.136288 27391 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVmtCMs/build/release/bin/kudu as pid 31638
I20260811 05:12:29.136399 27391 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVmtCMs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424853995437-27391-0/minicluster-data/master-2/wal/instance
I20260811 05:12:29.136620 27391 external_mini_cluster.cc:1428] Setting key a56b9ad5a9744d7928be0c3c5ab078ba
I20260811 05:12:29.137001 31740 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.191.254" port: 33603 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 05:12:29 dist-test-slave-x5fp krb5kdc[31388](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425149, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.252@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
Aug 11 05:12:29 dist-test-slave-x5fp krb5kdc[31388](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425148, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.191.252@KRBTEST.COM
I20260811 05:12:29.144765 31516 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.191.252" port: 34555 } attempt: 2
I20260811 05:12:29.146852 31519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:29.137802 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51770 (local address 127.26.191.254:33603)
0811 05:12:29.137853 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:29.137854 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:29.138017 (+ 163us) server_negotiation.cc:407] Connection header received
0811 05:12:29.138158 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:29.138160 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:29.138171 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:29.138260 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:12:29.138792 (+ 532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:29.139283 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:29.140336 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:29.140633 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:29.140703 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:12:29.143392 (+ 2689us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:12:29.143393 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:12:29.143394 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:12:29.143402 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:12:29.145134 (+ 1732us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:12:29.145642 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:12:29.145643 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:12:29.145644 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:12:29.145711 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:12:29.146055 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:12:29.146056 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:12:29.146057 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:12:29.146214 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:12:29.146262 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 05:12:29.146668 (+ 406us) server_negotiation.cc:299] Negotiation successful
0811 05:12:29.146758 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 05:12:29.147364 31746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:29.137694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.254:33603 (local address 127.0.0.1:51770)
0811 05:12:29.137876 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0811 05:12:29.137930 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0811 05:12:29.138058 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:12:29.138278 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:12:29.138281 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:12:29.138545 (+ 264us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:12:29.138700 (+ 155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:12:29.138704 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:12:29.139362 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:12:29.139363 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:12:29.140258 (+ 895us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:12:29.140260 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:12:29.140735 (+ 475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:12:29.140736 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:12:29.140866 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:12:29.141499 (+ 633us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:12:29.141509 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:12:29.143287 (+ 1778us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:12:29.145235 (+ 1948us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:12:29.145241 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:12:29.145243 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:12:29.145561 (+ 318us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:12:29.145790 (+ 229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:12:29.145791 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:12:29.145792 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:12:29.145963 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:12:29.146304 (+ 341us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:12:29.146311 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:12:29.146504 (+ 193us) client_negotiation.cc:769] Sending connection context
0811 05:12:29.146633 (+ 129us) client_negotiation.cc:240] Negotiation successful
0811 05:12:29.146791 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":107,"threads_started":1}
I20260811 05:12:29.147464 31744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:29.137204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40058 (local address 127.26.191.252:34555)
0811 05:12:29.137380 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:29.137391 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:29.137441 (+ 50us) server_negotiation.cc:407] Connection header received
0811 05:12:29.138006 (+ 565us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:29.138015 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:29.138066 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:29.138155 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:12:29.138828 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:29.139807 (+ 979us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:29.140705 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:29.141150 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:29.141236 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:12:29.143861 (+ 2625us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:12:29.143870 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:12:29.143871 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:12:29.143878 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:12:29.145829 (+ 1951us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:12:29.146220 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:12:29.146223 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:12:29.146224 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:12:29.146288 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:12:29.146513 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:12:29.146514 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:12:29.146514 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:12:29.146691 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:12:29.147228 (+ 537us) server_negotiation.cc:1035] Waiting for connection context
0811 05:12:29.147293 (+ 65us) server_negotiation.cc:299] Negotiation successful
0811 05:12:29.147374 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":125,"thread_start_us":91,"threads_started":1}
I20260811 05:12:29.148334 31740 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.191.253" port: 44323 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 05:12:29 dist-test-slave-x5fp krb5kdc[31388](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425148, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.254@KRBTEST.COM for kudu/127.26.191.252@KRBTEST.COM
Aug 11 05:12:29 dist-test-slave-x5fp krb5kdc[31388](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425149, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.252@KRBTEST.COM for kudu/127.26.191.253@KRBTEST.COM
I20260811 05:12:29.153961 31518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:29.145078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.252:34555 (local address 127.0.0.1:40064)
0811 05:12:29.145134 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0811 05:12:29.145145 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 05:12:29.145187 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:12:29.145412 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:12:29.145413 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:12:29.145554 (+ 141us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:12:29.145593 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:12:29.145594 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:12:29.146420 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:12:29.146422 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:12:29.147238 (+ 816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:12:29.147242 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:12:29.147753 (+ 511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:12:29.147755 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:12:29.147822 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:12:29.148247 (+ 425us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:12:29.148252 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:12:29.149868 (+ 1616us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:12:29.152111 (+ 2243us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:12:29.152112 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:12:29.152112 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:12:29.152296 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:12:29.153240 (+ 944us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:12:29.153240 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:12:29.153241 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:12:29.153312 (+ 71us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:12:29.153618 (+ 306us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:12:29.153619 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:12:29.153668 (+ 49us) client_negotiation.cc:769] Sending connection context
0811 05:12:29.153719 (+ 51us) client_negotiation.cc:240] Negotiation successful
0811 05:12:29.153822 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37}
I20260811 05:12:29.154368 31747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:29.145116 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40064 (local address 127.26.191.252:34555)
0811 05:12:29.145286 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:29.145288 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:29.145294 (+ 6us) server_negotiation.cc:407] Connection header received
0811 05:12:29.145311 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:29.145312 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:29.145320 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:29.145399 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:12:29.145679 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:29.146323 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:29.147323 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:29.147643 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:29.147977 (+ 334us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:12:29.149975 (+ 1998us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:12:29.149976 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:12:29.149976 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:12:29.149983 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:12:29.152023 (+ 2040us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:12:29.152384 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:12:29.152386 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:12:29.152387 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:12:29.152466 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:12:29.153388 (+ 922us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:12:29.153389 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:12:29.153390 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:12:29.153532 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:12:29.154087 (+ 555us) server_negotiation.cc:1035] Waiting for connection context
0811 05:12:29.154133 (+ 46us) server_negotiation.cc:299] Negotiation successful
0811 05:12:29.154219 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":151,"thread_start_us":87,"threads_started":1}
Aug 11 05:12:29 dist-test-slave-x5fp krb5kdc[31388](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425148, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.191.254@KRBTEST.COM
I20260811 05:12:29.156659 31746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:29.148670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.253:44323 (local address 127.0.0.1:58510)
0811 05:12:29.148707 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0811 05:12:29.148737 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0811 05:12:29.148772 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:12:29.148960 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:12:29.148961 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:12:29.149109 (+ 148us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:12:29.149158 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:12:29.149160 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:12:29.149853 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:12:29.149854 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:12:29.150510 (+ 656us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:12:29.150513 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:12:29.150914 (+ 401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:12:29.150915 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:12:29.150988 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:12:29.152118 (+ 1130us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:12:29.152124 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:12:29.153596 (+ 1472us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:12:29.155479 (+ 1883us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:12:29.155480 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:12:29.155480 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:12:29.155688 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:12:29.155954 (+ 266us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:12:29.155955 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:12:29.155955 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:12:29.156029 (+ 74us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:12:29.156341 (+ 312us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:12:29.156342 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:12:29.156383 (+ 41us) client_negotiation.cc:769] Sending connection context
0811 05:12:29.156468 (+ 85us) client_negotiation.cc:240] Negotiation successful
0811 05:12:29.156565 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":21}
I20260811 05:12:29.156831 31516 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d0d236310eab46faaf1b14c68d5d4b6a: Bootstrap starting.
I20260811 05:12:29.157052 31634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:29.148786 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58510 (local address 127.26.191.253:44323)
0811 05:12:29.148833 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:29.148835 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:29.148842 (+ 7us) server_negotiation.cc:407] Connection header received
0811 05:12:29.148866 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:29.148867 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:29.148876 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:29.148942 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:12:29.149242 (+ 300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:29.149774 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:29.150616 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:29.150840 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:29.150915 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:12:29.153692 (+ 2777us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:12:29.153693 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:12:29.153694 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:12:29.153702 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:12:29.155371 (+ 1669us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:12:29.155786 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:12:29.155788 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:12:29.155788 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:12:29.155865 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:12:29.156104 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:12:29.156105 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:12:29.156105 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:12:29.156243 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:12:29.156288 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0811 05:12:29.156530 (+ 242us) server_negotiation.cc:299] Negotiation successful
0811 05:12:29.156937 (+ 407us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 05:12:29.157634 31516 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d0d236310eab46faaf1b14c68d5d4b6a: Neither blocks nor log segments found. Creating new log.
I20260811 05:12:29.157940 31516 log.cc:824] T 00000000000000000000000000000000 P d0d236310eab46faaf1b14c68d5d4b6a: Log is configured to *not* fsync() on all Append() calls
I20260811 05:12:29.158468 31740 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.191.252" port: 34555 } has no permanent_uuid. Determining permanent_uuid...
I20260811 05:12:29.159065 31519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:29.148748 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51776 (local address 127.26.191.254:33603)
0811 05:12:29.148902 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:29.148904 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:29.148912 (+ 8us) server_negotiation.cc:407] Connection header received
0811 05:12:29.148933 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:29.148933 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:29.148942 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:29.148995 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:12:29.149646 (+ 651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:29.150309 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:29.150980 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:29.151269 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:29.151342 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:12:29.155826 (+ 4484us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:12:29.155827 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:12:29.155827 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:12:29.155834 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:12:29.157550 (+ 1716us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:12:29.157950 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:12:29.157951 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:12:29.157952 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:12:29.158010 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:12:29.158260 (+ 250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:12:29.158261 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:12:29.158261 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:12:29.158491 (+ 230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:12:29.158831 (+ 340us) server_negotiation.cc:1035] Waiting for connection context
0811 05:12:29.158879 (+ 48us) server_negotiation.cc:299] Negotiation successful
0811 05:12:29.158971 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133}
I20260811 05:12:29.159202 31516 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d0d236310eab46faaf1b14c68d5d4b6a: No bootstrap required, opened a new log
I20260811 05:12:29.161610 31516 raft_consensus.cc:348] T 00000000000000000000000000000000 P d0d236310eab46faaf1b14c68d5d4b6a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0d236310eab46faaf1b14c68d5d4b6a" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 33603 } } peers { permanent_uuid: "f23486eb92924653b3a4d47af70a22af" member_type: VOTER last_known_addr { host: "127.26.191.253" port: 44323 } } peers { permanent_uuid: "f83b8ba9f33c487dadd1a98e62467a65" member_type: VOTER last_known_addr { host: "127.26.191.252" port: 34555 } }
I20260811 05:12:29.161782 31516 raft_consensus.cc:729] T 00000000000000000000000000000000 P d0d236310eab46faaf1b14c68d5d4b6a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0d236310eab46faaf1b14c68d5d4b6a, State: Initialized, Role: FOLLOWER
I20260811 05:12:29.161886 31516 consensus_queue.cc:260] T 00000000000000000000000000000000 P d0d236310eab46faaf1b14c68d5d4b6a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0d236310eab46faaf1b14c68d5d4b6a" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 33603 } } peers { permanent_uuid: "f23486eb92924653b3a4d47af70a22af" member_type: VOTER last_known_addr { host: "127.26.191.253" port: 44323 } } peers { permanent_uuid: "f83b8ba9f33c487dadd1a98e62467a65" member_type: VOTER last_known_addr { host: "127.26.191.252" port: 34555 } }
I20260811 05:12:29.162200 31749 sys_catalog.cc:455] T 00000000000000000000000000000000 P d0d236310eab46faaf1b14c68d5d4b6a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0d236310eab46faaf1b14c68d5d4b6a" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 33603 } } peers { permanent_uuid: "f23486eb92924653b3a4d47af70a22af" member_type: VOTER last_known_addr { host: "127.26.191.253" port: 44323 } } peers { permanent_uuid: "f83b8ba9f33c487dadd1a98e62467a65" member_type: VOTER last_known_addr { host: "127.26.191.252" port: 34555 } } }
I20260811 05:12:29.162276 31516 sys_catalog.cc:564] T 00000000000000000000000000000000 P d0d236310eab46faaf1b14c68d5d4b6a [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:12:29.162377 31749 sys_catalog.cc:458] T 00000000000000000000000000000000 P d0d236310eab46faaf1b14c68d5d4b6a [sys.catalog]: This master's current role is: FOLLOWER
W20260811 05:12:29.164484 31769 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d0d236310eab46faaf1b14c68d5d4b6a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 05:12:29.164605 31769 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
Aug 11 05:12:29 dist-test-slave-x5fp krb5kdc[31388](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425149, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.252@KRBTEST.COM for kudu/127.26.191.252@KRBTEST.COM
Aug 11 05:12:29 dist-test-slave-x5fp krb5kdc[31388](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425148, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.191.253@KRBTEST.COM
I20260811 05:12:29.168339 31746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:29.158748 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.252:34555 (local address 127.0.0.1:40076)
0811 05:12:29.158783 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0811 05:12:29.158794 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 05:12:29.158833 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:12:29.160935 (+ 2102us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:12:29.160936 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:12:29.161087 (+ 151us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:12:29.161117 (+ 30us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:12:29.161118 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:12:29.161788 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:12:29.161789 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:12:29.162504 (+ 715us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:12:29.162507 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:12:29.162956 (+ 449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:12:29.162957 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:12:29.163032 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:12:29.163467 (+ 435us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:12:29.163472 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:12:29.165060 (+ 1588us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:12:29.167041 (+ 1981us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:12:29.167041 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:12:29.167042 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:12:29.167255 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:12:29.167460 (+ 205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:12:29.167461 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:12:29.167461 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:12:29.167514 (+ 53us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:12:29.167775 (+ 261us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:12:29.167776 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:12:29.167809 (+ 33us) client_negotiation.cc:769] Sending connection context
0811 05:12:29.167868 (+ 59us) client_negotiation.cc:240] Negotiation successful
0811 05:12:29.168234 (+ 366us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":18}
I20260811 05:12:29.168910 31747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:29.158807 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40076 (local address 127.26.191.252:34555)
0811 05:12:29.160815 (+ 2008us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:29.160816 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:29.160824 (+ 8us) server_negotiation.cc:407] Connection header received
0811 05:12:29.160851 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:29.160851 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:29.160861 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:29.160934 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:12:29.161201 (+ 267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:29.161683 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:29.162585 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:29.162884 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:29.162952 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:12:29.165148 (+ 2196us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:12:29.165149 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:12:29.165150 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:12:29.165156 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:12:29.166934 (+ 1778us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:12:29.167329 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:12:29.167331 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:12:29.167331 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:12:29.167384 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:12:29.167574 (+ 190us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:12:29.167575 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:12:29.167575 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:12:29.167697 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:12:29.167754 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 05:12:29.168467 (+ 713us) server_negotiation.cc:299] Negotiation successful
0811 05:12:29.168826 (+ 359us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1988}
I20260811 05:12:29.166085 31414 master_runner.cc:186] Error getting master registration for 127.26.191.253:44323: OK, instance_id { permanent_uuid: "f23486eb92924653b3a4d47af70a22af" instance_seqno: 1786425148967997 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 05:12:29.169142 31414 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 05:12:29.170564 31740 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f83b8ba9f33c487dadd1a98e62467a65: Bootstrap starting.
I20260811 05:12:29.170866 31634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:29.159717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58514 (local address 127.26.191.253:44323)
0811 05:12:29.159754 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:29.159756 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:29.160990 (+ 1234us) server_negotiation.cc:407] Connection header received
0811 05:12:29.161092 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:29.161093 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:29.161103 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:29.161150 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:12:29.161937 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:29.162630 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:29.163570 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:29.164535 (+ 965us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:29.164586 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:12:29.167702 (+ 3116us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:12:29.167704 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:12:29.167704 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:12:29.167711 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:12:29.169455 (+ 1744us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:12:29.169872 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:12:29.169873 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:12:29.169874 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:12:29.169938 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:12:29.170149 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:12:29.170150 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:12:29.170150 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:12:29.170294 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:12:29.170456 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0811 05:12:29.170691 (+ 235us) server_negotiation.cc:299] Negotiation successful
0811 05:12:29.170784 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260811 05:12:29.171394 31740 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f83b8ba9f33c487dadd1a98e62467a65: Neither blocks nor log segments found. Creating new log.
I20260811 05:12:29.171739 31740 log.cc:824] T 00000000000000000000000000000000 P f83b8ba9f33c487dadd1a98e62467a65: Log is configured to *not* fsync() on all Append() calls
I20260811 05:12:29.172526 27391 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 05:12:29.172626 31740 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f83b8ba9f33c487dadd1a98e62467a65: No bootstrap required, opened a new log
I20260811 05:12:29.173616 31476 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "d0d236310eab46faaf1b14c68d5d4b6a"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51776
I20260811 05:12:29.173780 31476 raft_consensus.cc:482] T 00000000000000000000000000000000 P d0d236310eab46faaf1b14c68d5d4b6a [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 05:12:29.173835 31476 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d0d236310eab46faaf1b14c68d5d4b6a [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:12:29.174531 31476 raft_consensus.cc:504] T 00000000000000000000000000000000 P d0d236310eab46faaf1b14c68d5d4b6a [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0d236310eab46faaf1b14c68d5d4b6a" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 33603 } } peers { permanent_uuid: "f23486eb92924653b3a4d47af70a22af" member_type: VOTER last_known_addr { host: "127.26.191.253" port: 44323 } } peers { permanent_uuid: "f83b8ba9f33c487dadd1a98e62467a65" member_type: VOTER last_known_addr { host: "127.26.191.252" port: 34555 } }
I20260811 05:12:29.174737 31740 raft_consensus.cc:348] T 00000000000000000000000000000000 P f83b8ba9f33c487dadd1a98e62467a65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0d236310eab46faaf1b14c68d5d4b6a" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 33603 } } peers { permanent_uuid: "f23486eb92924653b3a4d47af70a22af" member_type: VOTER last_known_addr { host: "127.26.191.253" port: 44323 } } peers { permanent_uuid: "f83b8ba9f33c487dadd1a98e62467a65" member_type: VOTER last_known_addr { host: "127.26.191.252" port: 34555 } }
I20260811 05:12:29.174815 31476 leader_election.cc:288] T 00000000000000000000000000000000 P d0d236310eab46faaf1b14c68d5d4b6a [CANDIDATE]: Term 1 election: Requested vote from peers f23486eb92924653b3a4d47af70a22af (127.26.191.253:44323), f83b8ba9f33c487dadd1a98e62467a65 (127.26.191.252:34555)
I20260811 05:12:29.174893 31740 raft_consensus.cc:729] T 00000000000000000000000000000000 P f83b8ba9f33c487dadd1a98e62467a65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f83b8ba9f33c487dadd1a98e62467a65, State: Initialized, Role: FOLLOWER
I20260811 05:12:29.174978 31740 consensus_queue.cc:260] T 00000000000000000000000000000000 P f83b8ba9f33c487dadd1a98e62467a65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0d236310eab46faaf1b14c68d5d4b6a" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 33603 } } peers { permanent_uuid: "f23486eb92924653b3a4d47af70a22af" member_type: VOTER last_known_addr { host: "127.26.191.253" port: 44323 } } peers { permanent_uuid: "f83b8ba9f33c487dadd1a98e62467a65" member_type: VOTER last_known_addr { host: "127.26.191.252" port: 34555 } }
I20260811 05:12:29.175314 31740 sys_catalog.cc:564] T 00000000000000000000000000000000 P f83b8ba9f33c487dadd1a98e62467a65 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:12:29.175415 31706 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d0d236310eab46faaf1b14c68d5d4b6a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "f83b8ba9f33c487dadd1a98e62467a65"
I20260811 05:12:29.175534 31706 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f83b8ba9f33c487dadd1a98e62467a65 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:12:29.176533 31706 raft_consensus.cc:2454] T 00000000000000000000000000000000 P f83b8ba9f33c487dadd1a98e62467a65 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0d236310eab46faaf1b14c68d5d4b6a in term 1.
I20260811 05:12:29.176832 31439 leader_election.cc:302] T 00000000000000000000000000000000 P d0d236310eab46faaf1b14c68d5d4b6a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d0d236310eab46faaf1b14c68d5d4b6a, f83b8ba9f33c487dadd1a98e62467a65; no voters:
I20260811 05:12:29.176975 31749 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d0d236310eab46faaf1b14c68d5d4b6a [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:12:29.177167 31749 raft_consensus.cc:686] T 00000000000000000000000000000000 P d0d236310eab46faaf1b14c68d5d4b6a [term 1 LEADER]: Becoming Leader. State: Replica: d0d236310eab46faaf1b14c68d5d4b6a, State: Running, Role: LEADER
I20260811 05:12:29.177277 31749 consensus_queue.cc:237] T 00000000000000000000000000000000 P d0d236310eab46faaf1b14c68d5d4b6a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0d236310eab46faaf1b14c68d5d4b6a" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 33603 } } peers { permanent_uuid: "f23486eb92924653b3a4d47af70a22af" member_type: VOTER last_known_addr { host: "127.26.191.253" port: 44323 } } peers { permanent_uuid: "f83b8ba9f33c487dadd1a98e62467a65" member_type: VOTER last_known_addr { host: "127.26.191.252" port: 34555 } }
I20260811 05:12:29.178308 31803 sys_catalog.cc:455] T 00000000000000000000000000000000 P d0d236310eab46faaf1b14c68d5d4b6a [sys.catalog]: SysCatalogTable state changed. Reason: New leader d0d236310eab46faaf1b14c68d5d4b6a. Latest consensus state: current_term: 1 leader_uuid: "d0d236310eab46faaf1b14c68d5d4b6a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0d236310eab46faaf1b14c68d5d4b6a" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 33603 } } peers { permanent_uuid: "f23486eb92924653b3a4d47af70a22af" member_type: VOTER last_known_addr { host: "127.26.191.253" port: 44323 } } peers { permanent_uuid: "f83b8ba9f33c487dadd1a98e62467a65" member_type: VOTER last_known_addr { host: "127.26.191.252" port: 34555 } } }
I20260811 05:12:29.178419 31803 sys_catalog.cc:458] T 00000000000000000000000000000000 P d0d236310eab46faaf1b14c68d5d4b6a [sys.catalog]: This master's current role is: LEADER
I20260811 05:12:29.178821 31805 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:12:29.179036 31805 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:12:29.180549 31706 raft_consensus.cc:1261] T 00000000000000000000000000000000 P f83b8ba9f33c487dadd1a98e62467a65 [term 1 FOLLOWER]: Refusing update from remote peer d0d236310eab46faaf1b14c68d5d4b6a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:12:29.180867 31803 consensus_queue.cc:1035] T 00000000000000000000000000000000 P d0d236310eab46faaf1b14c68d5d4b6a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f83b8ba9f33c487dadd1a98e62467a65" member_type: VOTER last_known_addr { host: "127.26.191.252" port: 34555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:12:29.180099 31638 master_runner.cc:186] Error getting master registration for 127.26.191.253:44323: OK, instance_id { permanent_uuid: "f23486eb92924653b3a4d47af70a22af" instance_seqno: 1786425148967997 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 05:12:29.182591 31638 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 05:12:29.184579 31803 sys_catalog.cc:455] T 00000000000000000000000000000000 P d0d236310eab46faaf1b14c68d5d4b6a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d0d236310eab46faaf1b14c68d5d4b6a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0d236310eab46faaf1b14c68d5d4b6a" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 33603 } } peers { permanent_uuid: "f23486eb92924653b3a4d47af70a22af" member_type: VOTER last_known_addr { host: "127.26.191.253" port: 44323 } } peers { permanent_uuid: "f83b8ba9f33c487dadd1a98e62467a65" member_type: VOTER last_known_addr { host: "127.26.191.252" port: 34555 } } }
I20260811 05:12:29.184664 31803 sys_catalog.cc:458] T 00000000000000000000000000000000 P d0d236310eab46faaf1b14c68d5d4b6a [sys.catalog]: This master's current role is: LEADER
I20260811 05:12:29.185544 31807 mvcc.cc:205] Tried to move back new op lower bound from 7317197411040956416 to 7317197411030831104. Current Snapshot: MvccSnapshot[applied={T|T < 7317197411040956416}]
I20260811 05:12:29.186549 31810 mvcc.cc:205] Tried to move back new op lower bound from 7317197411040956416 to 7317197411030831104. Current Snapshot: MvccSnapshot[applied={T|T < 7317197411040956416}]
I20260811 05:12:29.186832 31817 sys_catalog.cc:455] T 00000000000000000000000000000000 P f83b8ba9f33c487dadd1a98e62467a65 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d0d236310eab46faaf1b14c68d5d4b6a. Latest consensus state: current_term: 1 leader_uuid: "d0d236310eab46faaf1b14c68d5d4b6a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0d236310eab46faaf1b14c68d5d4b6a" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 33603 } } peers { permanent_uuid: "f23486eb92924653b3a4d47af70a22af" member_type: VOTER last_known_addr { host: "127.26.191.253" port: 44323 } } peers { permanent_uuid: "f83b8ba9f33c487dadd1a98e62467a65" member_type: VOTER last_known_addr { host: "127.26.191.252" port: 34555 } } }
I20260811 05:12:29.187394 31519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:29.176610 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51790 (local address 127.26.191.254:33603)
0811 05:12:29.178052 (+ 1442us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:29.178054 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:29.178364 (+ 310us) server_negotiation.cc:407] Connection header received
0811 05:12:29.178669 (+ 305us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:29.178671 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:29.178680 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:29.178710 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:12:29.179597 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:29.180336 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:29.181663 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:29.181954 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:29.181996 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:12:29.183726 (+ 1730us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:12:29.183727 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:12:29.183727 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:12:29.183735 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:12:29.185873 (+ 2138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:12:29.186342 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:12:29.186343 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:12:29.186344 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:12:29.186407 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:12:29.186651 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:12:29.186652 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:12:29.186652 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:12:29.186814 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:12:29.186912 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0811 05:12:29.187212 (+ 300us) server_negotiation.cc:299] Negotiation successful
0811 05:12:29.187296 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1422}
I20260811 05:12:29.187237 31817 sys_catalog.cc:458] T 00000000000000000000000000000000 P f83b8ba9f33c487dadd1a98e62467a65 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 05:12:29.187703 31634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:29.176163 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58518 (local address 127.26.191.253:44323)
0811 05:12:29.176206 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:29.176208 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:29.178235 (+ 2027us) server_negotiation.cc:407] Connection header received
0811 05:12:29.178383 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:29.178384 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:29.178395 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:29.178458 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:12:29.180915 (+ 2457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:29.181630 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:29.182659 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:29.182956 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:29.183003 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:12:29.184587 (+ 1584us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:12:29.184589 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:12:29.184589 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:12:29.184597 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:12:29.186421 (+ 1824us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:12:29.186815 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:12:29.186816 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:12:29.186817 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:12:29.186872 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:12:29.187089 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:12:29.187090 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:12:29.187091 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:12:29.187222 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:12:29.187301 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 05:12:29.187518 (+ 217us) server_negotiation.cc:299] Negotiation successful
0811 05:12:29.187618 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 05:12:29.187618 31817 sys_catalog.cc:455] T 00000000000000000000000000000000 P f83b8ba9f33c487dadd1a98e62467a65 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d0d236310eab46faaf1b14c68d5d4b6a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0d236310eab46faaf1b14c68d5d4b6a" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 33603 } } peers { permanent_uuid: "f23486eb92924653b3a4d47af70a22af" member_type: VOTER last_known_addr { host: "127.26.191.253" port: 44323 } } peers { permanent_uuid: "f83b8ba9f33c487dadd1a98e62467a65" member_type: VOTER last_known_addr { host: "127.26.191.252" port: 34555 } } }
I20260811 05:12:29.188319 31805 catalog_manager.cc:1347] Generated new cluster ID: d10b89bec7774d39bda31d8bb220e9eb
I20260811 05:12:29.188369 31805 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:12:29.188711 31809 sys_catalog.cc:455] T 00000000000000000000000000000000 P f83b8ba9f33c487dadd1a98e62467a65 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d0d236310eab46faaf1b14c68d5d4b6a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0d236310eab46faaf1b14c68d5d4b6a" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 33603 } } peers { permanent_uuid: "f23486eb92924653b3a4d47af70a22af" member_type: VOTER last_known_addr { host: "127.26.191.253" port: 44323 } } peers { permanent_uuid: "f83b8ba9f33c487dadd1a98e62467a65" member_type: VOTER last_known_addr { host: "127.26.191.252" port: 34555 } } }
I20260811 05:12:29.188956 31809 sys_catalog.cc:458] T 00000000000000000000000000000000 P f83b8ba9f33c487dadd1a98e62467a65 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 05:12:29.188176 31817 sys_catalog.cc:458] T 00000000000000000000000000000000 P f83b8ba9f33c487dadd1a98e62467a65 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 05:12:29.191057 31802 catalog_manager.cc:1259] Loaded cluster ID: d10b89bec7774d39bda31d8bb220e9eb
I20260811 05:12:29.191133 31802 catalog_manager.cc:1552] T 00000000000000000000000000000000 P f83b8ba9f33c487dadd1a98e62467a65: loading cluster ID for follower catalog manager: success
W20260811 05:12:29.191272 31802 catalog_manager.cc:1576] T 00000000000000000000000000000000 P f83b8ba9f33c487dadd1a98e62467a65: acquiring CA information for follower catalog manager: Not found: root CA entry not found
W20260811 05:12:29.191326 31802 catalog_manager.cc:873] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry
I20260811 05:12:29.192222 31747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:29.176962 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40086 (local address 127.26.191.252:34555)
0811 05:12:29.177004 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:29.177006 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:29.178518 (+ 1512us) server_negotiation.cc:407] Connection header received
0811 05:12:29.178587 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:29.178588 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:29.178599 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:29.178663 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:12:29.185404 (+ 6741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:29.186100 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:29.187113 (+ 1013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:29.187408 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:29.187455 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:12:29.189042 (+ 1587us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:12:29.189043 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:12:29.189043 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:12:29.189050 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:12:29.190810 (+ 1760us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:12:29.191302 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:12:29.191303 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:12:29.191304 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:12:29.191363 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:12:29.191619 (+ 256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:12:29.191620 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:12:29.191620 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:12:29.191744 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:12:29.191840 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0811 05:12:29.192045 (+ 205us) server_negotiation.cc:299] Negotiation successful
0811 05:12:29.192129 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 05:12:29.199864 31805 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:12:29.200650 31805 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:12:29.203392 31626 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.191.252" port: 34555 } attempt: 3
Aug 11 05:12:29 dist-test-slave-x5fp krb5kdc[31388](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786425148, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.191.253@KRBTEST.COM for kudu/127.26.191.252@KRBTEST.COM
I20260811 05:12:29.213856 31632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:29.203657 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.191.252:34555 (local address 127.0.0.1:40102)
0811 05:12:29.203770 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0811 05:12:29.203784 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 05:12:29.203830 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:12:29.204027 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:12:29.204028 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:12:29.204219 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:12:29.204266 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:12:29.204267 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:12:29.205238 (+ 971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:12:29.205239 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:12:29.206089 (+ 850us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:12:29.206092 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:12:29.206650 (+ 558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:12:29.206651 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:12:29.206707 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:12:29.207311 (+ 604us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:12:29.207316 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:12:29.209117 (+ 1801us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:12:29.212183 (+ 3066us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:12:29.212185 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:12:29.212185 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:12:29.212461 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:12:29.212918 (+ 457us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:12:29.212919 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:12:29.212919 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:12:29.213003 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:12:29.213487 (+ 484us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:12:29.213488 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:12:29.213551 (+ 63us) client_negotiation.cc:769] Sending connection context
0811 05:12:29.213609 (+ 58us) client_negotiation.cc:240] Negotiation successful
0811 05:12:29.213731 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":89}
I20260811 05:12:29.214839 31747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:29.203723 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40102 (local address 127.26.191.252:34555)
0811 05:12:29.203904 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:29.203906 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:29.203912 (+ 6us) server_negotiation.cc:407] Connection header received
0811 05:12:29.203931 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:29.203932 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:29.203942 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:29.203983 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:12:29.204343 (+ 360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:29.205134 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:29.206208 (+ 1074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:29.206532 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:29.206591 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:12:29.209239 (+ 2648us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:12:29.209241 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:12:29.209241 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:12:29.209267 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:12:29.212021 (+ 2754us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:12:29.212603 (+ 582us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:12:29.212604 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:12:29.212605 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:12:29.212699 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:12:29.213084 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:12:29.213085 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:12:29.213085 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:12:29.213351 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:12:29.214412 (+ 1061us) server_negotiation.cc:1035] Waiting for connection context
0811 05:12:29.214490 (+ 78us) server_negotiation.cc:299] Negotiation successful
0811 05:12:29.214672 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155}
I20260811 05:12:29.216919 31626 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f23486eb92924653b3a4d47af70a22af: Bootstrap starting.
I20260811 05:12:29.217706 31626 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f23486eb92924653b3a4d47af70a22af: Neither blocks nor log segments found. Creating new log.
I20260811 05:12:29.218035 31626 log.cc:824] T 00000000000000000000000000000000 P f23486eb92924653b3a4d47af70a22af: Log is configured to *not* fsync() on all Append() calls
I20260811 05:12:29.219242 31626 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f23486eb92924653b3a4d47af70a22af: No bootstrap required, opened a new log
I20260811 05:12:29.221339 31626 raft_consensus.cc:348] T 00000000000000000000000000000000 P f23486eb92924653b3a4d47af70a22af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0d236310eab46faaf1b14c68d5d4b6a" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 33603 } } peers { permanent_uuid: "f23486eb92924653b3a4d47af70a22af" member_type: VOTER last_known_addr { host: "127.26.191.253" port: 44323 } } peers { permanent_uuid: "f83b8ba9f33c487dadd1a98e62467a65" member_type: VOTER last_known_addr { host: "127.26.191.252" port: 34555 } }
I20260811 05:12:29.221544 31626 raft_consensus.cc:729] T 00000000000000000000000000000000 P f23486eb92924653b3a4d47af70a22af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f23486eb92924653b3a4d47af70a22af, State: Initialized, Role: FOLLOWER
I20260811 05:12:29.221643 31626 consensus_queue.cc:260] T 00000000000000000000000000000000 P f23486eb92924653b3a4d47af70a22af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0d236310eab46faaf1b14c68d5d4b6a" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 33603 } } peers { permanent_uuid: "f23486eb92924653b3a4d47af70a22af" member_type: VOTER last_known_addr { host: "127.26.191.253" port: 44323 } } peers { permanent_uuid: "f83b8ba9f33c487dadd1a98e62467a65" member_type: VOTER last_known_addr { host: "127.26.191.252" port: 34555 } }
I20260811 05:12:29.221993 31626 sys_catalog.cc:564] T 00000000000000000000000000000000 P f23486eb92924653b3a4d47af70a22af [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:12:29.222126 31583 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f23486eb92924653b3a4d47af70a22af [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:12:29.223130 31583 raft_consensus.cc:1261] T 00000000000000000000000000000000 P f23486eb92924653b3a4d47af70a22af [term 1 FOLLOWER]: Refusing update from remote peer d0d236310eab46faaf1b14c68d5d4b6a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:12:29.223443 31584 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d0d236310eab46faaf1b14c68d5d4b6a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "f23486eb92924653b3a4d47af70a22af"
I20260811 05:12:29.223470 31749 consensus_queue.cc:1035] T 00000000000000000000000000000000 P d0d236310eab46faaf1b14c68d5d4b6a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f23486eb92924653b3a4d47af70a22af" member_type: VOTER last_known_addr { host: "127.26.191.253" port: 44323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:12:29.224205 31805 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d0d236310eab46faaf1b14c68d5d4b6a: Generated new TSK 0
I20260811 05:12:29.224439 31805 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 05:12:29.224650 31584 raft_consensus.cc:2454] T 00000000000000000000000000000000 P f23486eb92924653b3a4d47af70a22af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0d236310eab46faaf1b14c68d5d4b6a in term 1.
I20260811 05:12:29.224992 31822 sys_catalog.cc:455] T 00000000000000000000000000000000 P f23486eb92924653b3a4d47af70a22af [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0d236310eab46faaf1b14c68d5d4b6a" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 33603 } } peers { permanent_uuid: "f23486eb92924653b3a4d47af70a22af" member_type: VOTER last_known_addr { host: "127.26.191.253" port: 44323 } } peers { permanent_uuid: "f83b8ba9f33c487dadd1a98e62467a65" member_type: VOTER last_known_addr { host: "127.26.191.252" port: 34555 } } }
I20260811 05:12:29.225076 31822 sys_catalog.cc:458] T 00000000000000000000000000000000 P f23486eb92924653b3a4d47af70a22af [sys.catalog]: This master's current role is: FOLLOWER
I20260811 05:12:29.226321 31822 sys_catalog.cc:455] T 00000000000000000000000000000000 P f23486eb92924653b3a4d47af70a22af [sys.catalog]: SysCatalogTable state changed. Reason: New leader d0d236310eab46faaf1b14c68d5d4b6a. Latest consensus state: current_term: 1 leader_uuid: "d0d236310eab46faaf1b14c68d5d4b6a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0d236310eab46faaf1b14c68d5d4b6a" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 33603 } } peers { permanent_uuid: "f23486eb92924653b3a4d47af70a22af" member_type: VOTER last_known_addr { host: "127.26.191.253" port: 44323 } } peers { permanent_uuid: "f83b8ba9f33c487dadd1a98e62467a65" member_type: VOTER last_known_addr { host: "127.26.191.252" port: 34555 } } }
I20260811 05:12:29.226432 31822 sys_catalog.cc:458] T 00000000000000000000000000000000 P f23486eb92924653b3a4d47af70a22af [sys.catalog]: This master's current role is: FOLLOWER
I20260811 05:12:29.226480 31822 sys_catalog.cc:455] T 00000000000000000000000000000000 P f23486eb92924653b3a4d47af70a22af [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d0d236310eab46faaf1b14c68d5d4b6a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0d236310eab46faaf1b14c68d5d4b6a" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 33603 } } peers { permanent_uuid: "f23486eb92924653b3a4d47af70a22af" member_type: VOTER last_known_addr { host: "127.26.191.253" port: 44323 } } peers { permanent_uuid: "f83b8ba9f33c487dadd1a98e62467a65" member_type: VOTER last_known_addr { host: "127.26.191.252" port: 34555 } } }
I20260811 05:12:29.226529 31822 sys_catalog.cc:458] T 00000000000000000000000000000000 P f23486eb92924653b3a4d47af70a22af [sys.catalog]: This master's current role is: FOLLOWER
I20260811 05:12:29.226933 31835 mvcc.cc:205] Tried to move back new op lower bound from 7317197411197321216 to 7317197411030831104. Current Snapshot: MvccSnapshot[applied={T|T < 7317197411040956416}]
I20260811 05:12:29.229327 31834 catalog_manager.cc:1259] Loaded cluster ID: d10b89bec7774d39bda31d8bb220e9eb
I20260811 05:12:29.229375 31834 catalog_manager.cc:1552] T 00000000000000000000000000000000 P f23486eb92924653b3a4d47af70a22af: loading cluster ID for follower catalog manager: success
I20260811 05:12:29.230580 31834 catalog_manager.cc:1574] T 00000000000000000000000000000000 P f23486eb92924653b3a4d47af70a22af: acquiring CA information for follower catalog manager: success
I20260811 05:12:29.230893 31834 catalog_manager.cc:1602] T 00000000000000000000000000000000 P f23486eb92924653b3a4d47af70a22af: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260811 05:12:29.258708 31634 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:12:29.256964 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58534 (local address 127.26.191.253:44323)
0811 05:12:29.257014 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:29.257017 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:29.257987 (+ 970us) server_negotiation.cc:407] Connection header received
0811 05:12:29.258105 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:29.258106 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:29.258118 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:29.258149 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:12:29.258629 (+ 480us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58534: BlockingRecv error: recv got EOF from 127.0.0.1:58534 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
W20260811 05:12:29.264299 31519 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:12:29.257387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51798 (local address 127.26.191.254:33603)
0811 05:12:29.257429 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:29.257431 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:29.259186 (+ 1755us) server_negotiation.cc:407] Connection header received
0811 05:12:29.259289 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:29.259290 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:29.259303 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:29.259333 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:12:29.264202 (+ 4869us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51798: BlockingRecv error: recv got EOF from 127.0.0.1:51798 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260811 05:12:29.281311 31747 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:12:29.257702 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40108 (local address 127.26.191.252:34555)
0811 05:12:29.257741 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:29.257743 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:29.265908 (+ 8165us) server_negotiation.cc:407] Connection header received
0811 05:12:29.265944 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:29.265946 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:29.265958 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:29.266022 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:12:29.281230 (+ 15208us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40108: BlockingRecv error: recv got EOF from 127.0.0.1:40108 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 05:12:29.292093 31634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:29.283381 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58538 (local address 127.26.191.253:44323)
0811 05:12:29.283428 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:29.283430 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:29.288546 (+ 5116us) server_negotiation.cc:407] Connection header received
0811 05:12:29.288678 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:29.288679 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:29.288751 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:29.288798 (+ 47us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:12:29.289046 (+ 248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:29.289840 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:29.291072 (+ 1232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:29.291381 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:29.291422 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:12:29.291653 (+ 231us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:12:29.291789 (+ 136us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:12:29.291837 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 05:12:29.291967 (+ 130us) server_negotiation.cc:299] Negotiation successful
0811 05:12:29.291992 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
W20260811 05:12:29.305052 31747 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:12:29.300974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40120 (local address 127.26.191.252:34555)
0811 05:12:29.301022 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:29.301024 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:29.304376 (+ 3352us) server_negotiation.cc:407] Connection header received
0811 05:12:29.304500 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:29.304502 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:29.304522 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:29.304553 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:12:29.304986 (+ 433us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40120: BlockingRecv error: recv got EOF from 127.0.0.1:40120 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 05:12:29.324771 31634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:29.313146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58546 (local address 127.26.191.253:44323)
0811 05:12:29.313192 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:29.313195 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:29.321471 (+ 8276us) server_negotiation.cc:407] Connection header received
0811 05:12:29.321666 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:29.321668 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:29.321681 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:29.321711 (+ 30us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:12:29.321943 (+ 232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:29.322765 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:29.323977 (+ 1212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:29.324228 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:29.324266 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:12:29.324471 (+ 205us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:12:29.324508 (+ 37us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:12:29.324536 (+ 28us) server_negotiation.cc:1035] Waiting for connection context
0811 05:12:29.324639 (+ 103us) server_negotiation.cc:299] Negotiation successful
0811 05:12:29.324661 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
W20260811 05:12:29.335031 31747 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:12:29.327646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40132 (local address 127.26.191.252:34555)
0811 05:12:29.327687 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:29.327689 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:29.334342 (+ 6653us) server_negotiation.cc:407] Connection header received
0811 05:12:29.334459 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:29.334460 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:29.334474 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:29.334505 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:12:29.334962 (+ 457us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40132: BlockingRecv error: recv got EOF from 127.0.0.1:40132 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 05:12:29.356066 31634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:29.341496 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58558 (local address 127.26.191.253:44323)
0811 05:12:29.341543 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:29.341546 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:29.352950 (+ 11404us) server_negotiation.cc:407] Connection header received
0811 05:12:29.353075 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:29.353077 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:29.353090 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:29.353122 (+ 32us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:12:29.353331 (+ 209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:29.354063 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:29.355196 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:29.355477 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:29.355526 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:12:29.355756 (+ 230us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:12:29.355793 (+ 37us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:12:29.355822 (+ 29us) server_negotiation.cc:1035] Waiting for connection context
0811 05:12:29.355951 (+ 129us) server_negotiation.cc:299] Negotiation successful
0811 05:12:29.355975 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
W20260811 05:12:29.365566 31747 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:12:29.358994 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40140 (local address 127.26.191.252:34555)
0811 05:12:29.359041 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:29.359043 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:29.364909 (+ 5866us) server_negotiation.cc:407] Connection header received
0811 05:12:29.365032 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:29.365034 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:29.365048 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:29.365078 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:12:29.365495 (+ 417us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40140: BlockingRecv error: recv got EOF from 127.0.0.1:40140 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 05:12:29.382275 31634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:29.371122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58560 (local address 127.26.191.253:44323)
0811 05:12:29.371168 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:29.371170 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:29.379169 (+ 7999us) server_negotiation.cc:407] Connection header received
0811 05:12:29.379300 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:29.379302 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:29.379314 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:29.379345 (+ 31us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:12:29.379546 (+ 201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:29.380305 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:29.381470 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:29.381766 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:29.381805 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:12:29.382008 (+ 203us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:12:29.382043 (+ 35us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:12:29.382068 (+ 25us) server_negotiation.cc:1035] Waiting for connection context
0811 05:12:29.382164 (+ 96us) server_negotiation.cc:299] Negotiation successful
0811 05:12:29.382184 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
W20260811 05:12:29.385531 31747 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:12:29.384549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40152 (local address 127.26.191.252:34555)
0811 05:12:29.384597 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:29.384599 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:29.384914 (+ 315us) server_negotiation.cc:407] Connection header received
0811 05:12:29.385023 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:29.385024 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:29.385038 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:29.385069 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:12:29.385474 (+ 405us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40152: BlockingRecv error: recv got EOF from 127.0.0.1:40152 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 05:12:29.399935 31634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:29.395119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58566 (local address 127.26.191.253:44323)
0811 05:12:29.395188 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:29.395190 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:29.396802 (+ 1612us) server_negotiation.cc:407] Connection header received
0811 05:12:29.396841 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:29.396842 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:29.396855 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:29.396922 (+ 67us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:12:29.397130 (+ 208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:29.397889 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:29.399073 (+ 1184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:29.399367 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:29.399429 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:12:29.399652 (+ 223us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:12:29.399689 (+ 37us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:12:29.399717 (+ 28us) server_negotiation.cc:1035] Waiting for connection context
0811 05:12:29.399824 (+ 107us) server_negotiation.cc:299] Negotiation successful
0811 05:12:29.399846 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
W20260811 05:12:29.403826 31747 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:12:29.402882 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40168 (local address 127.26.191.252:34555)
0811 05:12:29.402931 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:29.402933 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:29.403209 (+ 276us) server_negotiation.cc:407] Connection header received
0811 05:12:29.403314 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:29.403315 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:29.403328 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:29.403358 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:12:29.403759 (+ 401us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40168: BlockingRecv error: recv got EOF from 127.0.0.1:40168 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 05:12:29.425858 31634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:29.421652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58574 (local address 127.26.191.253:44323)
0811 05:12:29.421701 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:29.421703 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:29.421979 (+ 276us) server_negotiation.cc:407] Connection header received
0811 05:12:29.422047 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:29.422078 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:29.422105 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:29.422208 (+ 103us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:12:29.422435 (+ 227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:29.423709 (+ 1274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:29.424909 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:29.425279 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:29.425361 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:12:29.425552 (+ 191us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:12:29.425594 (+ 42us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:12:29.425648 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 05:12:29.425718 (+ 70us) server_negotiation.cc:299] Negotiation successful
0811 05:12:29.425740 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
W20260811 05:12:29.429751 31747 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:12:29.429062 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40182 (local address 127.26.191.252:34555)
0811 05:12:29.429114 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:29.429116 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:29.429150 (+ 34us) server_negotiation.cc:407] Connection header received
0811 05:12:29.429220 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:29.429221 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:29.429234 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:29.429302 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:12:29.429671 (+ 369us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40182: BlockingRecv error: recv got EOF from 127.0.0.1:40182 (error 108)
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 05:12:29.465745 31634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:29.463106 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58584 (local address 127.26.191.253:44323)
0811 05:12:29.463184 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:29.463187 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:29.463267 (+ 80us) server_negotiation.cc:407] Connection header received
0811 05:12:29.463345 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:29.463346 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:29.463358 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:29.463402 (+ 44us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:12:29.463569 (+ 167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:29.464069 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:29.464993 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:29.465207 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:29.465284 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:12:29.465458 (+ 174us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:12:29.465499 (+ 41us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:12:29.465558 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 05:12:29.465616 (+ 58us) server_negotiation.cc:299] Negotiation successful
0811 05:12:29.465637 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
W20260811 05:12:29.468933 31747 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:12:29.468335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40190 (local address 127.26.191.252:34555)
0811 05:12:29.468419 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:29.468421 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:29.468428 (+ 7us) server_negotiation.cc:407] Connection header received
0811 05:12:29.468450 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:29.468451 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:29.468460 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:29.468528 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:12:29.468871 (+ 343us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40190: BlockingRecv error: recv got EOF from 127.0.0.1:40190 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 05:12:29.536756 31634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:29.534218 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58598 (local address 127.26.191.253:44323)
0811 05:12:29.534279 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:29.534282 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:29.534316 (+ 34us) server_negotiation.cc:407] Connection header received
0811 05:12:29.534441 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:29.534442 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:29.534452 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:29.534519 (+ 67us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:12:29.534638 (+ 119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:29.535174 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:29.535956 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:29.536160 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:29.536242 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:12:29.536421 (+ 179us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:12:29.536453 (+ 32us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:12:29.536534 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 05:12:29.536590 (+ 56us) server_negotiation.cc:299] Negotiation successful
0811 05:12:29.536614 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
W20260811 05:12:29.539279 31747 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:12:29.538633 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40200 (local address 127.26.191.252:34555)
0811 05:12:29.538679 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:29.538681 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:29.538712 (+ 31us) server_negotiation.cc:407] Connection header received
0811 05:12:29.538774 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:29.538774 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:29.538784 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:29.538831 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:12:29.539219 (+ 388us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40200: BlockingRecv error: recv got EOF from 127.0.0.1:40200 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 05:12:29.671190 31634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:29.668699 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58606 (local address 127.26.191.253:44323)
0811 05:12:29.668816 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:29.668819 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:29.668923 (+ 104us) server_negotiation.cc:407] Connection header received
0811 05:12:29.668978 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:29.668979 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:29.668991 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:29.669053 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:12:29.669209 (+ 156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:29.669703 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:29.670504 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:29.670702 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:29.670778 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:12:29.670904 (+ 126us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:12:29.670935 (+ 31us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:12:29.670975 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0811 05:12:29.671027 (+ 52us) server_negotiation.cc:299] Negotiation successful
0811 05:12:29.671044 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
W20260811 05:12:29.673833 31747 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:12:29.673222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40216 (local address 127.26.191.252:34555)
0811 05:12:29.673300 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:29.673302 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:29.673312 (+ 10us) server_negotiation.cc:407] Connection header received
0811 05:12:29.673340 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:29.673341 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:29.673353 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:29.673405 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:12:29.673758 (+ 353us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40216: BlockingRecv error: recv got EOF from 127.0.0.1:40216 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 05:12:29.693197 31749 sys_catalog.cc:455] T 00000000000000000000000000000000 P d0d236310eab46faaf1b14c68d5d4b6a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d0d236310eab46faaf1b14c68d5d4b6a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0d236310eab46faaf1b14c68d5d4b6a" member_type: VOTER last_known_addr { host: "127.26.191.254" port: 33603 } } peers { permanent_uuid: "f23486eb92924653b3a4d47af70a22af" member_type: VOTER last_known_addr { host: "127.26.191.253" port: 44323 } } peers { permanent_uuid: "f83b8ba9f33c487dadd1a98e62467a65" member_type: VOTER last_known_addr { host: "127.26.191.252" port: 34555 } } }
I20260811 05:12:29.693406 31749 sys_catalog.cc:458] T 00000000000000000000000000000000 P d0d236310eab46faaf1b14c68d5d4b6a [sys.catalog]: This master's current role is: LEADER
I20260811 05:12:29.933660 31634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:29.931193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58608 (local address 127.26.191.253:44323)
0811 05:12:29.931290 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:29.931292 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:29.931304 (+ 12us) server_negotiation.cc:407] Connection header received
0811 05:12:29.931334 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:29.931335 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:29.931345 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:29.931428 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:12:29.931552 (+ 124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:29.932042 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:29.932939 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:29.933121 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:29.933174 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:12:29.933363 (+ 189us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:12:29.933401 (+ 38us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:12:29.933464 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 05:12:29.933565 (+ 101us) server_negotiation.cc:299] Negotiation successful
0811 05:12:29.933588 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
W20260811 05:12:29.936210 31747 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:12:29.935581 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40232 (local address 127.26.191.252:34555)
0811 05:12:29.935632 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:29.935634 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:29.935641 (+ 7us) server_negotiation.cc:407] Connection header received
0811 05:12:29.935665 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:29.935665 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:29.935674 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:29.935723 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:12:29.936144 (+ 421us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40232: BlockingRecv error: recv got EOF from 127.0.0.1:40232 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 05:12:30.192693 31802 catalog_manager.cc:1574] T 00000000000000000000000000000000 P f83b8ba9f33c487dadd1a98e62467a65: acquiring CA information for follower catalog manager: success
I20260811 05:12:30.193317 31802 catalog_manager.cc:1602] T 00000000000000000000000000000000 P f83b8ba9f33c487dadd1a98e62467a65: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 05:12:30.452325 32022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:30.449420 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55326 (local address 127.26.191.253:44323)
0811 05:12:30.449585 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:30.449587 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:30.449598 (+ 11us) server_negotiation.cc:407] Connection header received
0811 05:12:30.449628 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:30.449629 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:30.449641 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:30.449733 (+ 92us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:12:30.449953 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:30.450463 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:30.451378 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:30.451609 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:30.451682 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:12:30.451964 (+ 282us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:12:30.452011 (+ 47us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:12:30.452164 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0811 05:12:30.452213 (+ 49us) server_negotiation.cc:299] Negotiation successful
0811 05:12:30.452240 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":101,"threads_started":1}
I20260811 05:12:30.457597 32035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:30.454709 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43320 (local address 127.26.191.252:34555)
0811 05:12:30.454888 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:30.454890 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:30.454898 (+ 8us) server_negotiation.cc:407] Connection header received
0811 05:12:30.454926 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:30.454927 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:30.454991 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:30.455089 (+ 98us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:12:30.455232 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:30.455737 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:30.456502 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:30.456813 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:30.457017 (+ 204us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:12:30.457208 (+ 191us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:12:30.457341 (+ 133us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:12:30.457446 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0811 05:12:30.457469 (+ 23us) server_negotiation.cc:299] Negotiation successful
0811 05:12:30.457493 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122,"thread_start_us":55,"threads_started":1}
I20260811 05:12:30.462466 32022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:30.459581 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55332 (local address 127.26.191.253:44323)
0811 05:12:30.459631 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:30.459634 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:30.459794 (+ 160us) server_negotiation.cc:407] Connection header received
0811 05:12:30.459832 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:30.459834 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:30.459850 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:30.459926 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:12:30.460066 (+ 140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:30.460627 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:30.461660 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:30.461966 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:30.462049 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:12:30.462192 (+ 143us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:12:30.462230 (+ 38us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:12:30.462282 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 05:12:30.462349 (+ 67us) server_negotiation.cc:299] Negotiation successful
0811 05:12:30.462374 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 05:12:30.462845 32035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:30.459768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43324 (local address 127.26.191.252:34555)
0811 05:12:30.459845 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:30.459847 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:30.459925 (+ 78us) server_negotiation.cc:407] Connection header received
0811 05:12:30.460016 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:30.460017 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:30.460027 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:30.460071 (+ 44us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:12:30.460217 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:30.460987 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:30.461970 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:30.462257 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:30.462296 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:12:30.462492 (+ 196us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:12:30.462529 (+ 37us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:12:30.462624 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0811 05:12:30.462735 (+ 111us) server_negotiation.cc:299] Negotiation successful
0811 05:12:30.462764 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 05:12:30.463500 32050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:12:30.459657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35144 (local address 127.26.191.254:33603)
0811 05:12:30.459800 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0811 05:12:30.459803 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:12:30.459922 (+ 119us) server_negotiation.cc:407] Connection header received
0811 05:12:30.459986 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:12:30.459987 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:12:30.460050 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:12:30.460134 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:12:30.460246 (+ 112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:30.461035 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:30.461904 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:12:30.462236 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:12:30.462297 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:12:30.462566 (+ 269us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:12:30.462719 (+ 153us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:12:30.462783 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 05:12:30.463391 (+ 608us) server_negotiation.cc:299] Negotiation successful
0811 05:12:30.463425 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":82,"threads_started":1}
I20260811 05:12:30.465345 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 31414
I20260811 05:12:30.477033 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 31523
I20260811 05:12:30.490150 27391 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVmtCMs/build/release/bin/kudu with pid 31638
2026-08-11T05:12:30Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (3234 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (6423 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (296501 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST